How Tables Grew a Brain: Iceberg → DuckLake Snapshots → incremental → stream-native → catalog-first. Metadata is now the bottleneck. 💡 More insights → dataengineeringweekly.com 🔗 Full story → medium.com/fresha-data-en…

I wrote my thoughts on Supporting Our AI Overlords. dataengineeringweekly.com/p/what-support…

How Tables Got Smarter: Iceberg → DuckLake. From batch snapshots to stream-native updates and smart metadata, your data just leveled up. Stop fighting table chaos—choose by intent, not hype. Subscribe →dataengineeringweekly.com Full story → medium.com/fresha-data-en…

Airbnb built a next-gen key-value store supporting real-time ingestion + bulk uploads with sub-second latency, enabling feature stores & fraud detection. Read the full story here: dataengineeringweekly.com/i/174788425/ai…

As a data engineer, you can't treat zero-party (consent) and third-party (inferred) data the same way. This distinction is critical for building systems that are scalable, private, and trustworthy. Here’s my guide: dataengineeringweekly.com/p/engineering-…

Should we update the definition of an "Analytical Engineer"?

Fivetran and dbt form a strong foundation for modern data infrastructure, known for bringing simplicity to complex engineering workflows. That said, calling it “open” data infrastructure feels like a stretch.

Revisiting Medallion Architecture: Data Vault in Silver, Dimensional Modeling in Gold, by Ananth Packkildurai dataengineeringweekly.com/p/revisiting-m…

🚀 Data Vault vs. Dimensional Modeling vs. Medallion Architecture — When viewed through a modern enterprise data lens, these techniques interlock. I break down how in Part 2 of my “Revisiting the Medallion Architecture” series. dataengineeringweekly.com/p/revisiting-m…