Great opportunity to work with Dhruv Balwada, one of most innovative physical oceanographers in the world, at LDEO in NYC!

We’re hosting a webinar on Tuesday, October 22 from 12- 1 PM EST to discuss what Icechunk means for the scientific data community and answer questions from attendees. Register here: share.hsforms.com/1SCOFqe2kTjipo…

🎉 Source Cooperative is now open source! The web application - github.com/source-coopera… - and the data proxy - github.com/source-coopera… - have been opened up & updated with documentation on how to get it running locally. More documentation coming soon + tasks for new developers!

⚡️ Icechunk is fast! What does this mean for users? Reduced cost for all data-intensive compute jobs and enhanced productivity for the data scientists who work with data all day long. Icechunk, Earthmover's new transactional cloud-native storage engine for array / tensor

We've talked a lot about #Icechunk's performance this week 🚀. But the Zarr-Python 3 results are also very encouraging! We're a few weeks away from the 3.0 launch but what this chart shows is that the new AsyncIO + multi-threading functionality in Zarr is going to be really good.

Come learn about recent Xarray GroupBy improvements at tomorrow's (Wed, Nov 13) Pangeo Showcase! discourse.pangeo.io/t/pangeo-showc…

I'll also be there if you want to join me working on Xarray , DataTree, or VirtualiZarr!

Joe Morrison Ryan Abernathey Beto Earthmover @steadyflux That said, it isn't 100% clear that NASA's best move is to immediately convert 10000+ data sets into cutting edge ARCO formats. Kerchunk and Virtual Zarr offer benefits of ARCO while keeping data in the native formats.

Completely agree - "in theory" we have the simple scalability of the cloud, but in practice it's often a headache, for no good reason, which prevents adoption by most users (including many scientists)

🌤️ #AMS2025 is just around the corner! We are taking AMS by storm with an exhibitor booth (booth 353), two talks from Joe Hamman and Ryan Abernathey , and hosting a Pangeo Community Happy Hour (register here: lu.ma/ddtba5f5)!

Our friend's over at zarr_dev made a big release today! Xarray v2025.01.1 was also released today with full support for Zarr-Python 3 🚀

We're moving over to BlueSky and LinkedIn for all our future announcements. Follow us at bsky.app/profile/pangeo… to find out more about tomorrow's showcase 😉 (p.s., it's on Xpublish at Scale at 4 PM EST 🚀) Connect with us on LinkedIn at linkedin.com/company/pangeo…

Science needs a social network for sharing big data hackmd.io/@TomNicholas/H… by Tom Nicholas