Kaiming @ AutoMQ (@wan0573) 's Twitter Profile
Kaiming @ AutoMQ

@wan0573

Architect & Lead Evangelist @AutoMQ_lab. Formerly lead CDC Platform @alibaba_cloud & co-founder @CloudCanal. Interested in data streaming & CDC.

ID: 2610978415

linkhttps://www.automq.com calendar_today08-07-2014 03:36:51

142 Tweet

106 Followers

727 Following

Xinyu Zhou @AutoMQ (@xinyubest) 's Twitter Profile Photo

AutoMQ shared storage architecture offers low latency EBS WAL and inter-AZ traffic-free S3 WAL, all in a single, seamless setup. 🌟 But that’s not all! AutoMQ Cloud supports both Bring Your Own Cloud (BYOC) and SaaS models with a single codebase. 💡 With a decade of cloud

Kaiming @ AutoMQ (@wan0573) 's Twitter Profile Photo

BladePipe has many years of accumulation in the CDC field, especially in dealing with CDC scenarios of enterprise-level databases such as Oracle, DB2, etc., it is a highly recommended product. They now also support AutoMQ, welcome to try it. #kafka #apachekafka #cdc #automq

Kaivalya Apte - The Geek Narrator (@thegeeknarrator) 's Twitter Profile Photo

State of the art, is to move the “state” to the object storage. Yes there are challenges, but also amazing benefits. - stateless nodes which leads to ease of operations - cost efficiency - high durability - bottomless storage Here is how AutoMQ does it: youtu.be/sFIqo1QUE_Y

AutoMQ: Cost-Effective Auto-Scaling Kafka (@automq_lab) 's Twitter Profile Photo

AutoMQ is a new generation of low-cost, ultra-fast elastic Kafka built on S3. If you're looking for a better Kafka alternative, don't miss AutoMQ. Thanks to Kaivalya's video, this can help developers better and quickly understand why AutoMQ is a better Kafka. #apachekafka

Kaiming @ AutoMQ (@wan0573) 's Twitter Profile Photo

The expensive cross-AZ traffic fees on AWS are essentially a flexible tool prepared for its sales. It can gain competitiveness by adjusting its discounts when competing with third-party vendors. Now, AutoMQ has helped Kafka break this shackle. #kafka #streaming #automq

Kaiming @ AutoMQ (@wan0573) 's Twitter Profile Photo

Scaling Kafka clusters has always been a challenging task. Kafka uses the ISR multi-replica mechanism to ensure data persistence. However, in 2024, when cloud computing is very mature, this design seems a bit outdated.#apachekafka #streaming #cruisecontrol

Brij Pandey (@brijpandeyji) 's Twitter Profile Photo

The Evolution of Kafka Storage Architecture When implementing Kafka at scale, choosing the right storage strategy is critical. Let's examine four key approaches that have emerged: 1. Traditional Local Storage The classic Kafka setup uses local disks exclusively, offering: -

Kaiming @ AutoMQ (@wan0573) 's Twitter Profile Photo

👍👍Thanks to Gurubase for providing AI Q&A capabilities to the AutoMQ community. Now you can learn and understand AutoMQ more conveniently by asking AI. #apachekafka #streaming #automq

AutoMQ: Cost-Effective Auto-Scaling Kafka (@automq_lab) 's Twitter Profile Photo

#AutoMQ is on the right path. It's truly amazing 🎉 , #AutoMQ has already supported hashtag #AWS S3 table on the first day of its new feature release. In December, AutoMQ's Table Topic capability is about to be launched, which can support storing Kafka's topic directly in the

#AutoMQ is on the right path. It's truly amazing 🎉 , #AutoMQ has already supported hashtag #AWS S3 table on the first day of its new feature release. In December, AutoMQ's Table Topic capability is about to be launched, which can support storing Kafka's topic directly in the
Kaiming @ AutoMQ (@wan0573) 's Twitter Profile Photo

We have released a specific video tutorial here. In just 5 minutes, you can see how AutoMQ completely unifies stream and analysis. 🎉 #apachekafka #automq #s3table

Timeplus (@timeplusdata) 's Twitter Profile Photo

🎙️ We are excited to partner with AutoMQ: Cost-Effective Auto-Scaling Kafka for their 1st #AWS #meetup in 2025, in-person (Singapore) & online (YouTube Live). Hear about enhancing data streaming efficiency from engineers from Grab & Amazon Web Services, & Xinyu Zhou @AutoMQ from AutoMQ. linkedin.com/events/awsmeet…

🐿️Ben Gamble🦯 (@bengamble7) 's Twitter Profile Photo

One of the cool things about being in Hangzhou is running into some of the interesting streaming devs out here. I spent the afternoon with the AutoMQ team 😁 I didn't know they powered rednote!

One of the cool things about being in Hangzhou is running into some of the interesting streaming devs out here.
I spent the afternoon with the AutoMQ team 😁
I didn't know they powered rednote!
Kaiming @ AutoMQ (@wan0573) 's Twitter Profile Photo

Inspired by Stanislav Kozlovski 's posts for #Confluent. We have also summarized 14 innovations that #AutoMQ has made over Kafka. We hope this helps you quickly understand AutoMQ's innovations to #Kafka. Which of these innovations do you like the most? 🤔🤔

Inspired by <a href="/BdKozlovski/">Stanislav Kozlovski</a> 's posts for #Confluent. We have also summarized 14 innovations that #AutoMQ has made over Kafka. We hope this helps you quickly understand AutoMQ's innovations to #Kafka. 

Which of these innovations do you like the most? 🤔🤔
AutoMQ: Cost-Effective Auto-Scaling Kafka (@automq_lab) 's Twitter Profile Photo

🎉 The First Developers' Meetup in Malaysia is Here! AutoMQ invites Malaysian developers to join our first in-person tech exchange! Featuring Confluent Solutions Engineer Karthikayan Muthuramalingam and AutoMQ CTO Xin Yu Zhou, we'll delve into Apache Kafka®️ core tech, stream

🎉 The First Developers' Meetup in Malaysia is Here!

AutoMQ invites Malaysian developers to join our first in-person tech exchange! Featuring Confluent Solutions Engineer Karthikayan Muthuramalingam and AutoMQ CTO Xin Yu Zhou, we'll delve into Apache Kafka®️ core tech, stream
Aurimas Griciūnas (@aurimas_gr) 's Twitter Profile Photo

This is how 𝗔𝗜 𝗔𝗴𝗲𝗻𝘁 𝗠𝗲𝗺𝗼𝗿𝘆 works. In general, the memory for an agent is something that we provide via context in the prompt passed to LLM that helps the agent to better plan and react given past interactions or data not immediately available. It is useful to

Kaiming @ AutoMQ (@wan0573) 's Twitter Profile Photo

🚀 Live Now! Join us for a special session with AutoMQ: Cost-Effective Auto-Scaling Kafka and Confluent in Malaysia, diving deep into Kafka knowledge! 📚🔍 📺 Watch now: youtube.com/watch?v=AfGLG0… #Kafka #AutoMQ #Confluent #Malaysia #LiveStream #TechTalk #DataStreaming #ApacheKafka

AutoMQ: Cost-Effective Auto-Scaling Kafka (@automq_lab) 's Twitter Profile Photo

🚀 What if "waiting" actually makes your Kafka producer faster? 🔎For years, the “best practice” for low-latency Kafka was simple: send immediately (linger.ms=0). But Apache Kafka 4.0 redefines low-latency best practices—changing the default to

🚀 What if "waiting" actually makes your Kafka producer faster?

🔎For years, the “best practice” for low-latency Kafka was simple: send immediately (linger.ms=0).

But Apache Kafka 4.0 redefines low-latency best practices—changing the default to
AutoMQ: Cost-Effective Auto-Scaling Kafka (@automq_lab) 's Twitter Profile Photo

🚀 Breaking: AutoMQ now supports AWS FSx WAL! This architecture resolves the dilemma of running Kafka on AWS: ❌ EBS: Low latency, but high Cross-AZ costs. ❌ S3-only: Cost-efficient, but high write latency. The AutoMQ x FSx Way: 📉 Latency: Sub-10ms writes via multi-AZ shared

🚀 Breaking: AutoMQ now supports AWS FSx WAL!

This architecture resolves the dilemma of running Kafka on AWS:
❌ EBS: Low latency, but high Cross-AZ costs.
❌ S3-only: Cost-efficient, but high write latency.

The AutoMQ x FSx Way: 
📉 Latency: Sub-10ms writes via multi-AZ shared