I wrote a blog post today

Process terabytes of data without needing terabytes of memory: blog.lancedb.com/columnar-file-… We continue our deep dive into the #Lance file format and explain how Lance uses #backpressure to balance parallelism, speedy I/O, streaming computation, and limited RAM usage. In this blog,

I just posted on 'ArcGIS Pro Ideas' about adding GeoParquet support. Not sure how much of a difference it makes, but if you support the idea then sound in on it at community.esri.com/t5/arcgis-pro-…

Talking about ApacheArrow and the Arrow format at PyDay Barcelona today!

We're looking for an exceptional Rust engineer to work with us on the Spice ApacheDataFusion based database engine. (West-Coast US for time zone sanity). x.com/i/jobs/1775948…

PostgreSQL Conference Japan 2024での David Li の ADBCの話の資料だよー（私のサポートなしでも大丈夫だった！すごい！） gist.github.com/lidavidm/0752a… #pgcon24j

2025 is shaping up to be a breakout year for fast query result transfer with ApacheArrow. But what exactly makes it so fast? David Li, Matt Topol, and I break it down in this new blog post: arrow.apache.org/blog/2025/01/1…

The ApacheArrow community is happy to announce the release of v18.1.0 of the Arrow #Golang libraries! This includes packages for Arrow, Parquet, Flight and FlightSQL! Check out the announcement at arrow.apache.org/blog/2025/01/1…

🎉 After 47 releases, Spice.ai OSS is production ready with the 1.0-stable milestone! Already deployed at enterprises like Twilio, Barracuda, and NRC Health, Spice accelerates data access for mission-critical workloads and mitigates AI hallucinations.

Battle-tested in production at scale, Spice has reached the 1.0-stable milestone!

Our very own Apache - The ASF Matt Topol is making an irrefutable point that ApacheArrow is the best transport for your AI tensors. And as a proper millennial his meme game is second to none

A lot of people are ignoring that Go is becoming a commonly used language for prompting pipelines. Python in prototypes and Go in production is another common combo.

I’m excited about xorq! Ibis and DataFusion brought together to orchestrate multi-engine data pipelines, all powered by ApacheArrow github.com/xorq-labs/xorq

Please join Matt Topol at the Atlanta Cloud Conference on April 26th for Apache Arrow: The Great Library Unifier. Register at ticketleap.events/tickets/develo…

🚀 Introducing Bauplan A serverless, code-native platform for building data and AI pipelines — directly on your object store. No clusters. No notebooks. No GUI based workflows. Just Python + SQL + S3. 👉 bauplanlabs.com/blog/hello-bau…

1/5. ParadeDB has raised a $12M Series A to bring Elasticsearch workloads to Postgres. 🧵 techcrunch.com/2025/07/15/par…

Excited to see continued improvements in embedded query processing in the ApacheArrow C++ project: arrow.apache.org/blog/2025/07/1…

In September the Columnar crew are headed to PyData Paris 2025 and the first ever ApacheArrow Summit. The organizer QuantStack is a dedicated supporter of Apache Arrow. We’re delighted to be sponsoring the event.

Its happening -- DataFusion will (finally) get spilling hash joins. The march to completeness begins