Really cool opportunity. Whoever ends up in this role is going to have a ton of fun working on these projects!

Also in 2006: Travis Oliphant released the first version of Numpy, unifying the array libraries in Python-land and starting a multi-decade revolution in scalable, vectorized computing for everyone. It paved the way for modern machine learning and AI.

"@CMU_Stats' Rebecca Nugent has been visionary and relentless — and I'm very excited to see her work recognized nationally." — Dean Richard Scheines on Nugent's recent honor from the National Academies (National Academies) cmu.is/nugent #TartanProud

Basically my plan for how a bunch of open source science nerds can reshape humanity: Step 1. Make scikit-learn, Project Jupyter, etc. Step 2. Get millions of people learning how to use ML & AI to augment their own wisdom, make better predictions Step 3. Global prediction markets

This month's big announcement from Prefect was like the finale of a fireworks display where the big BOOMs just kept coming one after another.

If you’ve learned SQL and are trying to find a full time role in data or you are an analyst wondering what’s next... Learn dbt, find some data and open source your project. Far more companies hiring for dbt roles than there are candidates.

Katerina Wu, Penguins data scientist, on entering the sports analytics field: "This is perfect for me." Read more about Wu, the first woman and Asian-American involved in scouting and evaluation for Pittsburgh's hockey operations staff: pens.pe/3de4Tku

Data and AI operations startup Coiled nabs $21M wp.me/p8wLEc-bhRD by Kyle Wiggers

Had fun giving one of the keynotes at the Dask Summit with my colleague Jie Lou this morning on our use of Dask & Prefect for machine learning on healthcare data at @SymphonyRM. My favorite slide on Prefect giving us the right paradigm for data workflows:

Dask gets deployed in many ways. 💻Some folks run on a single machine. ⌨️Some SSH to more machines. 🏢Some run on HPC. ☁️Some scale to the cloud. 🚀Some build entire Dask platforms. Thought I'd write up a common path that I've seen many folks take. blog.dask.org/2021/06/01/das…

Big Data Workflow Automation with Prefect and Coiled🔥 In this post, we discuss when and how to use Dask and Coiled to leverage parallelism in your Prefect workflows, either locally or in the cloud. coiled.io/blog/big-data-…

Few companies, let alone start-ups, have the courage to leapfrog their own successful product to keep pushing the envelope of innovation. The Prefect team continues to be the leader in data workflow orchestration, this time by blowing up the long-standing DAG-based approach.

Building the product you wish you had isn’t enough for a successful startup. Other people have to wish for it, too.

Modal Congrats!

We were able to embed all of Wikipedia in < 15 minutes on Modal Labs for ~ 17$. Here's what this actually means for an organization: 1. Unrestricted Rates: Eliminates the bottleneck of rate limits for large-scale operations. 2. Rapid Experimentation: Allows quick iterations of

Ok time to come out of my serverless GPU closet: Modal is the best, and it’s not even close. We had many competitors at Banana, with users notorious for always shopping around. The one exception was Modal. A black hole of user retention in an otherwise commodity market.

DocETL continues to evolve as a powerful system for LLM-powered data processing & analysis pipelines. Since I'm at UIST this week, this deep dive focuses on UI/UX insights for transforming unstructured data with LLMs--on complex tasks and the art of prompt engineering 🧠🔧

Thrilled to share four milestones we hit in July: 🚀 Record‑breaking quarter: we just posted the strongest in company history. 🏁 Profitable: we’ll affirm this milestone in the next few weeks. 🤩 Customer momentum: +70 % net growth in just six months. 📈 Exploding usage: