TIL about ParadeDB: high-perf OLAP capabilities for #Postgres , based on #Parquet for storage and #DataFusion for query execution. Amazing to see all these OSS building blocks out there for making things like this possible without starting from scratch.

github.com/paradedb/parad…

I built a new PC today. I like how it matches my bookshelf 😎

Here is a paper I helped write that is in VLDB this year. vldb.org/pvldb/vol17/p1… Among other things it confirms my believe that join ordering is not a solved problem in databases. Maybe someone will use DataFusion to explore better algorithms 🎣

I had a great time meeting some fellow DataFusion contributors today in Austin. Many thanks to Andrew Lamb, Paul Dix, and other InfluxData folks for arranging this!

I am pretty excited about the growth in projects built with ApacheArrow DataFusion. Here is the official announcement of Comet, created by Engineers from Apple to accelerate Spark. arrow.apache.org/blog/2024/03/0…

There is a cool opportunity in my remote team at Coralogix for a Software Engineer to contribute to an ambitious distributed query engine based on DataFusion / Ballista. The job is open for US candidates as well. Feel free to send me a DM for questions.

coralogix.com/careers/co/rem…

Microsoft is hiring for a new Rust tooling team! We're currently looking for a Software Engineering Manager to 'play a pivotal role in supporting diverse Rust initiatives throughout the entire Microsoft engineering ecosystem.'

#rust #rust lang

jobs.careers.microsoft.com/global/en/shar…

Reason why devs are overengineering projects at work is they don’t have side projects to overengineer

Boring Data Tool (bdt) has now moved to the datafusion-contrib GitHub org. I think this is a nice example of building CLI data tools with ApacheArrow and #DataFusion

github.com/datafusion-con…

😝, The first Apache Iceberg #Rust release is under voting!

lists.apache.org/thread/1rnk9c1…

Another opportunity to get paid to work with/on DataFusion at Coralogix coralogix.com/careers/co/rem…

Anyone out there using Ballista? Seems like a really interesting project.

Apache Arrow nanoarrow 0.4.0 is released! This project is one of my favourite things to work on - it's a C library with R and Python (new!) bindings that makes it easier than ever before to import and export tabular data using the Arrow format.

Bluesky seems like a promising alternative to X and some of the data community is already over there.

Bluesky is no longer invite-only.

You can find me at bsky.app/profile/andygr…

TIL about Apache DafaFusion Comet. @apple has replaced Apache Spark's guts with ApacheArrow DataFusion. And they're donating it. 🤯

github.com/apache/arrow-d…

This is an alternative to Meta Open Source's Velox Spark implementation.

facebookincubator.github.io/velox/spark_fu…

/ht Philippe Noël