List: Airflow | Curated by Paul Fry

Jan 12, 2025
59 stories
Airflow
In
Data Engineering Space
by
Chengzhi Zhao
Apache Airflow 3.0 Is Coming Soon: Here’s What You Can ExpectApache Airflow 3.0: A First Look at the New Feature
Jan 8
113
Jan 8
113
In
Data Engineer Things
by
JBarti
Airflow 3.0 promises us REAL event driven schedulingThis new feature is a great step towards the modernization of Airflow that has kept to its roots of time-based scheduling for so long.
Dec 10, 2024
260
3
Dec 10, 2024
260
3
Nelson Alfonso
Mastering Real-Time Monitoring in Apache Airflow: A Comprehensive GuideIntroduction
Sep 24, 2024
65
3
Sep 24, 2024
65
3
Nelson Alfonso
Setting Up Apache Airflow with OpenTelemetry: A Comprehensive GuideIntroduction
Nov 9, 2024
9
Nov 9, 2024
9
Nelson Alfonso
Top 10 Apache Airflow Best Practices for Data EngineersOptimize your workflows and pipelines with these essential Airflow guidelines.
Sep 19, 2024
168
2
Sep 19, 2024
168
2
In
Astrafy
by
Charles Verleyen
Airflow 2.10 is just wowIntroduction
Aug 20, 2024
394
1
Aug 20, 2024
394
1
Prem Vishnoi(cloudvala)
Airflow SLA SetupAirflow allows you to set Service Level Agreements (SLAs) for tasks within your DAGs, ensuring they succeed within a specified timeframe…
Feb 12, 2024
16
Feb 12, 2024
16
In
Apache Airflow
by
Fabio Barbazza
Airflow DAGs must-haveCreate standardized Airflow DAGs based on a pre-defined set of parameters.
Apr 24, 2024
36
Apr 24, 2024
36
In
Apache Airflow
by
Alexandre Magno Lima Martins
What we learned after running Airflow on Kubernetes for 2 yearsApache Airflow is one of the most important components in our Data Platform, used by different teams inside the business. It powers all of…
Feb 6, 2024
1K
22
Feb 6, 2024
1K
22
In
Lyft Engineering
by
Tao Feng
Securing Apache Airflow UI With DAG Level AccessBy Tao Feng and Andrew Stahlman
Oct 22, 2019
258
4
Oct 22, 2019
258
4
In
Apache Airflow
by
RNHTTR
Unsticking Airflow: Stuck Queued Tasks are No More in 2.6.0Consolidating logic for stuck queued tasks and making this pesky bug a thing of the past
Apr 19, 2023
63
5
Apr 19, 2023
63
5
In
Apache Airflow
by
Bhavani Ravi
Apache Airflow Bad vs. Best Practices In Production — 2023The open-ended nature of Airflow gives room for a variety of customization. While this is a good thing, there are no bound for…
Jan 25, 2023
57
Jan 25, 2023
57
Ali Masri
Generating Airflow DAGs using Jinja
Jul 13, 2022
312
1
Jul 13, 2022
312
1
In
Nerd For Tech
by
Amit Singh Rathore
Airflow features — Callback, Trigger & Clsuter PolicyLesser discussed features of Airflow
Aug 18, 2022
33
1
Aug 18, 2022
33
1
Montadhar REKAYA
Apache Airflow Testing GuideApache airflow testing can be very challenging. It’s the tricky and gray area of airflow. Multiple teams are using Apache Airflow hosted on…
Mar 17, 2022
119
Mar 17, 2022
119
In
Accredian
by
Mukesh Kumar
Executors in Apache-Airflow(A High-level Overview of Executors in Apache-Airflow)
Aug 18, 2022
101
1
Aug 18, 2022
101
1
 This story is no longer available
In
SeattleDataGuy By SeattleDataGuy
by
Ben Rogojan
Should You Use Apache Airflow?Why Data Engineers Love/Hate Airflow
Jul 20, 2022
138
2
Jul 20, 2022
138
2
In
Dev Genius
by
Amit Singh Rathore
Airflow Task ParallelismHow to control concurrency
Sep 15, 2022
27
Sep 15, 2022
27
Iuliia Volkova
How to load use several dag_folders? Airflow DAGBags.This article describes an easy way how to load DAGs from different DAG folders with using just one little script with 10 lines.
Nov 14, 2018
355
8
Nov 14, 2018
355
8