CK Gan
@chengkuangan
Associate Principal Specialist Solution Architect @ redhat but not specialized, blogger @ braindose.blog, lazy YouTuber :-)
ID: 119330275
http://braindose.blog 03-03-2010 09:29:53
348 Tweet
43 Takipรงi
89 Takip Edilen
ZOMG, the latest Thoughtworks Tech Radar puts #Debezium on "assess" level! ๐ "Debezium is an excellent choice [for] Change Data Capture and streaming data updates ... Weโre using it in a few projects and it has worked very well for us."
"#Debezium JDBC sink -- Initial Commit" Woot, woot, super-cool to see this effort progressing, bringing full end-to-end DB connectivity to Debezium Project. Excellent work by Hossein Torabi and Chris Cranford! github.com/debezium/debezโฆ
What are the most common ๐จ๐๐ฒ ๐๐ฎ๐๐ฒ๐ ๐ณ๐ผ๐ฟ ๐๐ฎ๐ณ๐ธ๐ฎ? We have covered lots of concepts around Kafka already. But what are the most common use cases for The System that you are very likely to run into as a Data Engineer? ๐๐ฒ๐โ๐ ๐๐ฎ๐ธ๐ฒ ๐ฎ ๐ฐ๐น๐ผ๐๐ฒ๐ฟ ๐น๐ผ๐ผ๐ธ:
Here is a short refresher on ๐๐๐๐ ๐ฃ๐ฟ๐ผ๐ฝ๐ฒ๐ฟ๐๐ถ๐ฒ๐ ๐ผ๐ณ ๐๐๐ ๐ฆ (๐๐ฎ๐๐ฎ๐ฏ๐ฎ๐๐ฒ ๐ ๐ฎ๐ป๐ฎ๐ด๐ฒ๐บ๐ฒ๐ป๐ ๐ฆ๐๐๐๐ฒ๐บ). It could be that you are taking ACID Properties for granted when you are using transactional databases. If you are interviewing for Data Engineering
The latest Kafka release, 3.6.0, introduced support for Tiered Storage. If you want to get started with that new feature, I published a blog post demonstrating how to use it: developers.redhat.com/articles/2023/โฆ Red Hat Developer
Two KIPs (Apache Kafka improvement proposals) to keep an eye on: - KIP-975 "Docker Image for Apache Kafka", already resolved for 3.7.0: cwiki.apache.org/confluence/disโฆ - KIP-974 "Docker Image for GraalVM based Native Kafka Broker": cwiki.apache.org/confluence/disโฆ Kafka as a native binary, nice!
โ๏ธ "Checkpoint Chronicle" 01/2024 is out! #Flink, #Kafka, #Debezium, #Postgres, #DuckDB--The latest edition of our monthly collection of exciting resources in the data and streaming space has it all, brought to you by Robin Moffatt ๐ป๐๐ฅ and Gunnar Morling ๐. ๐ dcbl.link/cc-jan24-01
๐ฃ๏ธ "With XFS, the number of produce requests exceeding 65ms (our SLO) was lowered by 82%" Excellent write-up on identifying and mitigating high tail latencies with Apache Kafka writes, by Maciej Moลcicki and Piotr Rลผysko of allegro.tech ๐. blog.allegro.tech/2024/03/kafka-โฆ