Deep Dive into Handling Apache Spark Data Skew chengzhizhao.com/deep-dive-into…
#data #apacheSpark #data skew #data engineering

5 Lessons I Learned From a Totaled Car Accident dlvr.it/SypXR5

Airflow Schedule Interval 101 dlvr.it/Sw4lW1

Bidding War on Housing Market? Let’s Use R For Exploratory Data Analysis dlvr.it/Sv8FB9

When it comes to visualizing data with histogram with multiple groups, it can be pretty challenging. A useful ggplot2 extension called ggridges has been helpful for my exploratory tasks. Here is what I learned buff.ly/3rWyGcF

#RStats R Markdown #DataScience

Visualizing Data with ggridges: Techniques to Eliminate Density Plot Overlaps in ggplot2 dlvr.it/StJBrD

Union operation in Spark are often discussed widely. However, a hidden fact that has been less discussed is the performance caveat associated with the union operator.

#DataEngineering #ApacheSpark #ETL #DataPipeline #DataScience #DataAnalytics

buff.ly/3OlPHWE

Discover the Essential Reading List for Data Engineers: 10 Classic Books You Can’t-Miss.

#DataEngineering #BigData #ETL #DataPipeline #DataWarehouse #DataArchitecture #Hadoop #DataScience #DataAnalytics #MachineLearning

buff.ly/3OkA95t

The data engineering space is evolving. Here are the resources I collected for practical data engineering resources.

#DataEngineering #BigData #ETL #DataPipeline #DataWarehouse #DataArchitecture #Hadoop #DataScience #DataAnalytics #MachineLearning

buff.ly/44fQLAC

Unlocking the Secrets of Slowly Changing Dimension (SCD): A Comprehensive View of 8 Types by Chengzhi Zhao buff.ly/3OjzmBN

Tools are great, but many data engineering problems cannot be resolved by using the newest tool but by human — Data Engineers. Here are my thoughts on 'Why data engineering is about much more than just the tools.'
#data science #data #data engineering
buff.ly/44LvXRh

Slowly Changing Dimension (SCD) is critical to dimensional modeling. I will discuss the eight types of SCDs. By the end, you will clearly understand each type and can differentiate SCD types in dimensional modeling
#data science #data #SQL #data warehouse
buff.ly/452gVaj

This article revisits the topic of visualizing monthly expenses comprehensively, updating the original tooling to be more interactive and user-friendly by continuing development in R.buff.ly/3D16W8T #data #rstats #data engineering #sankey #data viz

Sometimes writing SQL can be frustrating, especially when encountering NULL values. I hope this article can help you better understand these tricky NULL in SQL.

#data #data science #bigdata #SQL #data base

buff.ly/43gNDmX

The data engineering space is evolving. Here are the resources I collected for practical data engineering resources.

#data #data science #apachespark #bigdata #data engineering

buff.ly/44fQLAC

“Why my Spark job is running slow?” is an inevitable question while working with Apache Spark. One of the most common scenarios regarding Apache Spark performance tuning is data skew.

#data #data science #apachespark #bigdata #data engineering

buff.ly/3NJhcYm

Demystifying Null in SQL: A Comprehensive Guide for Data Professionals dlvr.it/SrpN0w

How I Built a Tool to Visualize Expense In Sankey Diagram dlvr.it/SrpN0v

Data Engineering: Why It’s About Much More Than Just the Tools You Use dlvr.it/SrpN0t

Building Better Data Warehouses with Dimensional Modeling: A Guide for Data Engineers dlvr.it/SrpN0q