It’s time to start Confitura

The Amazon Builders' Library is an hidden gem: it consists of articles written by some of the most senior AWS engineers covering foundational patterns and principles used when building AWS services. Most learnings can be applied anywhere. Here are my favourite articles:

Finally!

What’s the best way to partition time-series data in #BigQuery? mkuthan.github.io/blog/2023/08/0…

👋 Hey everyone! Exciting news – I've moved to Mastodon! 🐘 Join me on this awesome decentralized platform where we can connect, share, and explore new horizons. Follow me at fosstodon.org/@mkuthan and let's continue the journey together 🌟 #Mastodon #NewBeginnings

Blogged about the power of Unified Batch and Stream Processing! Seamlessly combine real-time for insights while managing historical data efficiently mkuthan.github.io/blog/2023/09/2… Don't miss my code samples: github.com/mkuthan/stream… #DataProcessing #Streaming #BigData #ApacheBeam #Scala

Today's article goes into details of this... interesting graph. Read it here: blog.pragmaticengineer.com/aws-azure-and-…

🚀 Discover the power of TDD for data engineering! Reduce your development cycle time from 30 minutes to 10 seconds and boost code quality. mkuthan.github.io/blog/2023/11/0… #TDD #DataEngineering #DataProcessing #ApacheBeam #BigData #Scala

Lessons from Google's Zanzibar: Building a Planet-Scale Authorization System I've been reading timeless whitepapers lately. Today I wanted to share key learnings from Google's paper on their distributed authorization system, Zanzibar: - Zanzibar stores access control lists

🙏 The first edition of Checkpoint Chronicle includes links out to content from folk across the data and streaming space, including Responsive' Rohan Desai, @cloudflare's Matt Boyle, Andrea Medda, Robert Metzger, Yaroslav Tkachenko, Tabular (now part of Databricks)'s Ryan Blue, Vinoth Chandar, Ali Ghodsi,

"Flink SQL: the Challenges of Implementing a Streaming SQL Engine" That's a great slide set by Jark Wu from #FlinkForward the other week. Looking forward to the recording, too. speakerdeck.com/jark/flink-sql…

Join us during #39 event from the #AllegroTechTalk series. This time we will share with you approaches that can change... your approach to working with data. 🧠 Check the meeting details at: app.evenea.pl/event/allegro-…

🗣️ "We present the first detailed, empirical evaluation of three popular and increasingly-adopted formats and evaluate their suitability to be used as a native format in a DBMS" ApacheArrow, Apache Parquet, Apache ORC compared, by Chunwei Liu et al. vldb.org/pvldb/vol16/p3…

No work items left unturned: How Dataflow mitigates stragglers cloud.google.com/blog/products/…, Google Cloud why do you publish articles with links to the internal resources not available for public audience?

mkuthan.github.io/blog/2024/05/3… hot or not? #DIY #hi-fi

New post on #AllegroTechBlog Check out Jakub Dropia’s insights on the Pragmatic Engineer Test and see how Allegro measures up in tech stack, approach, and profitability. Read more here: bit.ly/4bPATsq #PragmaticEngineer #SoftwareEngineer

My tech interests zigzag like a caffeinated electron! ⚡️Recently, I geeked out on building a Hi-Fi amplifier—now, I’m diving into the gear that powers my homelab. mkuthan.github.io/blog/2024/06/3… #homelab #diy

My new book, Building Resilient Distributed Systems, is now available in early access form O'Reilly Media. A few chapters are available at this stage, ahead of the planned publication in August next year. You can find out more about the book here: samnewman.io/books/building…

The new native Apache Kafka container image is dope for unit testing. Compiled into a native binary via #GraalVM, a single-node broker is starting in ~150 ms on my laptop; an entire test via Testcontainers completes in less than two seconds 🥳. 👉 cwiki.apache.org/confluence/dis…

ververica.com/blog/embracing… #flink