In this session, Hongyue Zhang and Luciano Resende 🇧🇷🇺🇸 will leverage Apache Iceberg as the scalable table format with ACID guarantee, Apache Toree’s interactive computation capabilities and orchestrate the automated data workflow on Apache Airflow.
🏆 Big congratulations to Astronomer's own Cody Rich, Field Engineer, and Deeptansh Aggarwal, Senior SDET, for being named Apache Airflow Champions!
Learn more about their #Airflow journey: bit.ly/44dqCmJ
#ApacheAirflow #Champions
The top 21 Apache Airflow interview questions and how to answer them. 👇
Master your next data engineering interview with 21 Airflow questions and answers, including core concepts, advanced techniques, and more.
🔗 ow.ly/xEZu50RvHrJ
I've just started an end to end series on Data Engineering for Data Lakehouses with #ApacheAirflow , #Minio , #ApacheKafka , #ApacheSpark and #ApacheFlink .
The article has been published on medium.
ICYMI:
link.medium.com/tgveggcIiJb
For 25 years, ASF projects have provided software for the public good. Did you know that Apache Airflow supports cancer research?
Want to learn more about ASF public good stories? bit.ly/4cEqC2Y #ASF25Years
This in-depth tutorial from iNeuron.ai shows how DVC and Apache Airflow work together to streamline your MLOps projects.
You will learn how to:
🔹Manage Data Versioning.
🔹Orchestrate Tasks and build robust pipelines.
Link: youtube.com/live/WwwvtPgjp…
This enables teams to…
🚀Je partage ma vidéo en FR 🇫🇷 avec un exemple concret de gestion d’erreurs et de #monitoring efficace avec Apache Airflow and #CloudComposer dans Google Cloud Tech
💡Le système utilise un intercepteur d’erreurs et du 'separation of concern'
youtu.be/EsAzdUce77U
#GoogleCloud
⚡⬅ Flashback to July 2023, when we explained how we use ClickHouse for our internal data warehouse. Dmitry Pavlov describes our architecture, the data sources we’re working with, and other tools we use like Fivetran Apache Superset Apache Airflow
clickhou.se/3WqT2rT
🚀📢I created a new video with a concrete use case of how we can apply #errorhandling and #monitoring efficiently with Apache Airflow and #CloudComposer in Google Cloud Tech
💡The system uses a Failures interceptor and separation of concern
youtu.be/8lTz06_cHCc
#GoogleCloud
🔍 SpotHero is hiring Data Engineer (Full Time - On-site)
🔗 Apply Now: skillexchange.xyz/job/data-engin…
#Hiring #Jobs #JobSearch #Engineering #DataScience #Marketing #ApacheAirflow #ApacheSpark #Docker #Python
Tamara Fingerlin Astronomer 👉 Learn more about our GenAI Infra & OSS event: mlopsworld.com/tools/
#MLOps #Chatbots #RAG #MLOps #ApacheAirflow #GenerativeAI
