List: Data Engineering | Curated by Leihua Ye, PhD

Nov 21, 2023
19 stories
Data Engineering
In
Netflix TechBlog
by
Netflix Technology Blog
Streamlining Membership Data Engineering at Netflix with PsybergBy Abhinaya Shetty, Bharath Mummadisetty
Nov 15, 2023
12
Nov 15, 2023
12
In
Netflix TechBlog
by
Netflix Technology Blog
Psyberg: Automated end to end catch upBy Abhinaya Shetty, Bharath Mummadisetty
Nov 15, 2023
Nov 15, 2023
In
Art of Data Engineering
by
Tim Webster
5 Missed Opportunities in My Data Engineering Career (Succeed Where I Failed)What I Wish I Had Known Sooner Going into Data Engineering
Sep 19, 2023
1
Sep 19, 2023
1
Maxime Beauchemin
Functional Data Engineering — a modern paradigm for batch data processingBatch data processing — historically known as ETL — is extremely challenging. It’s time-consuming, brittle, and often unrewarding. Not only…
Jan 8, 2018
26
Jan 8, 2018
26
Muhammad Tayyab
Best 5 Books on Data EngineeringDive deep into the world of data engineering with these top 5 essential reads that empower, enlighten, and engage
Oct 26, 2023
Oct 26, 2023
In
Data Engineer Things
by
Vino Duraisamy
CI/CD for Data — How to enhance data quality and increase data engineering velocity?Step by step implementation of CI/CD for your data pipelines in 20 mins.
Mar 23, 2023
4
Mar 23, 2023
4
In
Snowflake Builders Blog: Data Engineers, App Developers, AI/ML, & Data Science
by
Vino Duraisamy
Step by step roadmap to becoming a Snowflake Data Engineer in 2023Hint — SQL & Python is all you need. Yeah, no kidding!!
Aug 15, 2023
10
Aug 15, 2023
10
Tamunopriye Dagogo-George
A Data Engineer’s Playground: My Beginners Roadmap from Clueless to Slightly Less CluelessSix months ago I started my official Journey into Data Engineering, and by this point, I had already secured my first offer as a Junior…
Sep 20, 2023
6
Sep 20, 2023
6
Analytics at Meta
Data engineering at Meta: High-Level Overview of the internal tech stackThis article provides an overview of the internal tech stack that we use on a daily basis as data engineers at Meta. The idea is to shed…
Oct 10, 2023
31
Oct 10, 2023
31
Sam Zamany
Unit Testing in Data Engineering: A Practical GuideIn the realm of data engineering, one often overlooked practice is unit testing. Many might think that unit tests are merely a software…
Jul 12, 2023
5
Jul 12, 2023
5
In
Data Engineer Things
by
Ravish Kumar
Apache Arrow: The Future of Data EngineeringHow this open-source project is making data processing faster, easier, and more efficient.
Jul 28, 2023
6
Jul 28, 2023
6
In
Robinhood
by
Vineet Goel
Why Robinhood uses AirflowRobinhood relies on batch processing jobs at set schedules for a large number of tasks. These jobs range from data analysis and metric…
May 9, 2017
8
May 9, 2017
8
In
We’ve moved to freeCodeCamp.org/news
by
Maxime Beauchemin
The Rise of the Data EngineerI joined Facebook in 2011 as a business intelligence engineer. By the time I left in 2013, I was a data engineer.
Jan 20, 2017
50
Jan 20, 2017
50
Maxime Beauchemin
The Downfall of the Data EngineerThis post follows up on The Rise of the Data Engineer, a recent post that was an attempt at defining data engineering and described how…
Aug 28, 2017
15
Aug 28, 2017
15
In
SeattleDataGuy By SeattleDataGuy
by
Ben Rogojan
Data Engineering Roadmap For 202112 Steps To Help You Go From 0 To Data Engineering
Jul 9, 2021
7
Jul 9, 2021
7
Robert Chang
A Beginner’s Guide to Data Engineering — Part IData Engineering: The Close Cousin of Data Science
Jan 8, 2018
45
Jan 8, 2018
45
Robert Chang
A Beginner’s Guide to Data Engineering — Part IIData Modeling, Data Partitioning, Airflow, and ETL Best Practices
Feb 20, 2018
22
Feb 20, 2018
22
Robert Chang
A Beginner’s Guide to Data Engineering — The Series FinaleFrom ETL Pipelines To Data Engineering Frameworks
Jun 24, 2018
12
Jun 24, 2018
12
In
TDS Archive
by
Frank Liang
An Introduction to Apache AirflowA great pipeline automation tool to learn as a data scientist
Apr 17, 2021
2
Apr 17, 2021
2