Check out this article by Alex Merced | Open Data Lakehouse Advocate that covers the architecture of Apache Iceberg, apachehudi, and Delta Lake
-> dremio.com/blog/exploring…
#DataLake #DataLake house #DataEngineering #DataAnalytics
🏬📉📊 Today's State of Data Engineering 2023 presented by lakeFS features Metastores and Open Table Formats.
#DatabricksUnityCatalog , AzurePurview, Tabular, #CloudDataproc , Apache Hive, Cloudera, #AWSGlue , Onehouse, Apache Iceberg, apachehudi, Delta Lake, Apache ORC
Anyscale {Jules Damji}=💻📚📝 #DataAISummit Hugging Face ray Reynold Xin Databricks Possibly one of the most important announcements in the #OpenSource #DataEngineering space recently:
Delta Lake 3.0 brings a universal #Metadata format to all leading #OpenTableFormats - Delta Lake, Apache Iceberg, and apachehudi!!!
#opensource #BigData #DataAISummit
So does the reason why databricks open sources Delta Lake, without the server (metadata management): because this is exactly the baseline/boundary apachehudi and Apache Iceberg can do at the moment.
Join us tomorrow to learn more about Apache Doris & Apache Hudi's integration!
🗓️ 13th March 2024 | 8 AM PT | 11 AM ET
With #uniform Databricks just eliminated the barriers between Delta Lake, apachehudi and Apache Iceberg. They are all #Lakehouse formats.
While Apache Iceberg and apachehudi are in a hot war, Apache Flink and RisingWave: Serverless stream processing are enjoying love and peace ☮️☮️☮️😇😇😇
❓❓❓HOW LAKEHOUSE TABLE FORMAT WORKS❓❓❓
1. Engine reads table format metadata
2. Builds list of files with relevant data based on metadata
3. Scans those files and executes query
#DataEngineering #DataAnalytics #BigData #DataLakehouse #ApacheIceberg #ApacheHudi …
Developing Streaming Data Lakes with Hudi and @MinIO
hackernoon.com/developing-str…
#datascience #minio #apachehudi #datalakes
🔗hubs.la/Q01Sn75T0 - StarRocks Q&A - #ApacheHudi community call⚡️In addition to the detailed demonstration, we received a ton of intriguing questions from the Hudi community! 🧐 Curious to discover what were asked? You're just one click away from joining the conversation!
#Snowflake basically confirmed the customers moving towards an #open #datalakehouse . Glad we were caught up to 2021 now, but this conveniently ignores the largest of #datalakes up & running on #ApacheHudi , among other things. we still confuse specific technologies with end-state…
Check out this article by Alex Merced | Open Data Lakehouse Advocate that covers the architecture of Apache Iceberg, apachehudi, and Delta Lake
-> dremio.com/blog/exploring…
#DataLake #DataLake house #DataEngineering #DataAnalytics
Hello World 👋 OneTable has a new name and is now incubating in the Apache Software Foundation as Apache XTable™ (Incubating). The GH repo moved under Apache and more details are in this blog: xtable.apache.org/blog/OneTable-…
#apacheiceberg #apachehudi #deltalake #datalakehouse
Came across a recent blog post on table format war winner with an “open spec”. Sharing my thoughts in response medium.com/@simpsons/the-…
#ApacheHudi #Deltalake #ApacheIceberg #Datalakehouse #Datalakes #TableFormat #Spec #Databricks #opensource
apachehudi: From Zero To One (9/10) introducing HoodieStreamer - a Swiss Army knife for ingestion!
#apachehudi #apachespark #apachekafka #distributedsystems #dataprocessing #cdc #dataengineering #databases #datalake #lakehouse
blog.datumagic.com/p/apache-hudi-…
I wish I had more reach on X bc I have some questions about building middleware with Apache Camel Apache NiFi apachehudi ++ Redis ++ Airflow …. And maybe Apache Kafka #Help