My deepscatter library now allows plotting directly on ApacheArrow tables, for datasets with 'only' a few million points. Example Observable notebook downloads + animates the NYC Taxi dataset using DuckDB. observablehq.com/@bmschmidt/tax…

Monday starting 17:00 UTC Pablo Galindo Salgado will be releasing Python 3.11 *live*. Expect cameos by some other core devs. Watch the live stream: youtube.com/watch?v=PGZPSW…

I'll be happy to talk at Python Ireland about ApacheArrow and more specifically about PyArrow, as a full stack solution for data engineering. From disk to network. It's my second time at PyCon Ireland and I really enjoyed my time there in the past. Great community!

I demoed DuckDB to 10 data scientists last Friday & they used it regularly for the week. Feedback - * Speed is the most impressive thing about DuckDB. * It's not exactly a Pandas replacement ( not yet) * Most of them found out the real power of ApacheArrow 1st time

We've released ApacheArrow 10.0.0, including three months of work from over 100 contributors! Read all about the new features and improvements here: arrow.apache.org/blog/2022/10/3…

Just signed up for Post, the goal seems good, we will see if it's achieved: post.news/?r=n20kE

I was pleased to discover that the Web Browser Engineering book ( browser.engineering ) on how Web Browsers work actually uses my DukPy project ( pypi.org/project/dukpy ) to implement Javascript support in the custom web browser built through the book.

I was finally able to find the time to cut releases of my #Python projects Depot ( pypi.org/project/filede… ) and DukPy ( pypi.org/project/dukpy/ ). So sorry it took me so long to make them available with Python 3.12 support

I finally found the time to cut the release, so I'm happy to share that Beaker #session #caching #locking management framework for #python version 13.0.0 is now out with support for redis clusters as backend. pypi.org/project/Beaker/

Ended up having to make my own bot, but I was finally able to have in place crossposting between micro.blog, mastodon and twitter

Version 16 of #python #arrow PyArrow arrow.apache.org/docs/python/ge… adds a very interesting feature for AI and ML: the support for converting Tables and RecordBatches to Tensors. This makes very fast and convenient to use Dataframe like structures with ML libraries

Substrait-Python ( the interoperable query format ) 0.17 has support for query plans in JSON which makes more convenient to share query plans t.ly/3K2tV #python #analytics

The growth of PyArrow, surpassing 120M downloads/month, is a good indicator of how the composable data ecosystem is actually working in the real world already #python #arrow #data

Arrow FlightSQL protocol provided a 10x speed up in Apache Doris for #datawarehouse, and it can be leveraged via the #python ADBC driver. See dev.to/apachedor…

Recently found out that Perspective ( perspective.finos.org ) internally uses a delta format based on Arrow when streaming data to the visualization part.

I have been finally able to get to work on OSS projects those past weeks, and wow… I really missed that. Did in 2 weeks more than I could get done in the past year