🎉 29 Days of #Airflow 2.9: Day 16

🔄 Today’s focus: an on_skipped_callback function in the BaseOperator. It enables automatic execution of custom actions when tasks are skipped, enhancing workflow control and flexibility.

Learn more: github.com/apache/airflow…

#29daysofairflow29

🎉 29 Days of #Airflow 2.9: Day 15

📦 Use object storage (AWS S3, Google Cloud Storage, Azure Blob Storage) for #XCom backends. This enables scalable, secure data storage/retrieval, capable of handling larger & more complex data types. bit.ly/3UBF4kd

#29daysofairflow29

🎉 29 Days of #Airflow 2.9: Day 14

🚦Today's feature: Automatically set a #DAG to 'off' after consecutive failures. This preserves system integrity & resources by preventing repeated failures and reducing manual cleanup.

Learn more: bit.ly/3USln87

#29daysofairflow29

#Airflow has become foundational in supporting AI Apps with an easy-to-use platform to build advanced data workflows.

Join us May 15th, when #AI / #ML experts from Astronomer & Dosu will share best practices for getting #GenAI into production: bit.ly/4diAPT0

🎉 29 Days of #Airflow 2.9: Day 13

📦 Today's feature: Dataset support for object storage. This streamlines workflows with Dataset integration across AWS S3, Google Cloud & Azure Blob Storage, enhancing data management and automation. bit.ly/44vCaSA

#29daysofairflow29

🌉 Join us on May 15th at the Amazon office in #SanFrancisco for an Apache Airflow #meetup .

Discover how Vibrant Planet uses #Airflow and learn about the exciting new features in Airflow 2.9! 🌟

🔗 Secure your spot! bit.ly/4af0Yj0

🎉 29 Days of #Airflow 2.9: Day 12

🔄 #Airflow 2.9 now supports multiple XCom outputs in the BaseOperator. This enhances task communication and data exchange, increases workflow flexibility, and supports complex data scenarios. github.com/apache/airflow…

#29daysofairflow29

Join Astronomer for #GenerativeAI World Tools, Infra & Open Source Demo Days 💻 At this free virtual event, we will cover the latest in unified #dataorchestration and #GenAI pipelines with #ApacheAirflow 💨 bit.ly/44rE1rN

#Airflow #datapipelines #aipipelines #MLOps

🎉 29 Days of Airflow 2.9: Day 11

📊 The #Airflow Gantt chart now shows task failures. Including #TaskFail entries gives a fuller view of task performance and health, improving problem identification and troubleshooting.

🔗 Lean more: github.com/apache/airflow…

#29daysofairflow29

#𝐌𝐚𝐲𝐭𝐡𝐞𝐅𝐨𝐮𝐫𝐭𝐡 𝐛𝐞 𝐖𝐢𝐭𝐡 𝐘𝐨𝐮: 𝐔𝐧𝐥𝐨𝐜𝐤 #𝐀𝐢𝐫𝐟𝐥𝐨𝐰 𝐰𝐢𝐭𝐡 𝐀𝐬𝐭𝐫𝐨, 𝐘𝐨𝐮 𝐌𝐮𝐬𝐭

Sign up for a free trial of Astro with a business email address and get a 'Yoda Best' mug.

Ends 5/31. US & CA only. Embrace the Force now! bit.ly/3QuoiSS

🎉 29 Days of #Airflow 2.9: Day 10

🔗 Today's feature: Implementing Dataset URI formats. This simplifies dataset referencing in workflows and enhances integration with external systems, promoting scalable data architecture. Learn more: bit.ly/4a2crCr

#29daysofairflow29

Catch the Windy City 💨 vibes as Matt Shancer, Staff Data Engineer, discuss how Grindr utilizes #Airflow to streamline their data processes.

Join us at mHUB on May 16th for the Chicago Airflow #Meetup ! 🏙️ bit.ly/3Ql5i9s

🎉 29 Days of #Airflow 2.9: Day 9

🎨 Color formatting for ANSI characters in task logs improves readability by distinguishing warnings, errors, and info, streamlining troubleshooting and monitoring.

🔗 See color formatting in action: bit.ly/4b4buLq

#29daysofairflow29

🎉 29 Days of Airflow 2.9: Day 8

🚀 Today's second feature spotlight: Implementing the task duration page in React to speed up interactions and enhance aesthetics and usability.

🔗 Learn more: bit.ly/4a2IK42

#29daysofairflow29

🎉 29 Days of #Airflow 2.9: Day 8

🖥️ Today's update: Task log grouping to enhance UI clarity. This simplifies monitoring and troubleshooting with a more structured log view, improving usability.

See task log grouping in action: bit.ly/4dgdPUN

#29daysofairflow29

🎉 29 Days of Airflow 2.9: Day 7

📊 New feature: Dataset conditions in the next run datasets modal. Precisely control task triggers by datasets, ensuring tasks run only when specific conditions are met, optimizing workflow & resources. bit.ly/3wpbGFH

#29daysofairflow29

Astro is up for the DBTA Magazine Readers’ Choice Awards in 2 categories: Best #AI Solution and Best Data Platform!

☑️ Don’t forget to vote for #Astro and your favorite data solutions at the link below ⤵️ bit.ly/3JvFmUz

🎉 29 Days of #Airflow 2.9: Day 6 🎉

⏲️ Today's spotlight: the ability to change the default cron timetable dictating task scheduling. This enables more tailored scheduling to better fit project & operational timelines.

🔗 Learn more: bit.ly/3QgCoak

#29daysofairflow29

🌌✨ Tune into the NYSE 🏛 TV interview with Trinity Chavez and our SVP of Data + AI, Steven Hillion, as they explore how #AI -driven technology and large language models are transforming decision-making across industries.

🎥 Watch now: bit.ly/3w8c37x

#airflow #LLM

🎉 29 Days of #Airflow 2.9: Day 5

⚙️ Today’s focus: Custom weight_rule implementations to calculate Task Instance (TI) priority_weight. Design rules that align with your specific operational goals and workflow demands.

🔗 Learn how: bit.ly/3xUvwcv

#29daysofairflow29