Need a Postgres DB for a quick demo, experiment, or random thingy? Free Postgres - no signup, no credit card, nothing. Spins up in milliseconds, claim it later :) 👉 neon.new

Databricks AI/BI Genie is now GA! Over 4,000 organizations have already adopted AI/BI Genie in Preview – including HP Inc., 7-Eleven and SEGA Europe – to democratize data and to empower their non-technical users. Building on these innovations, we’re excited to announce the

1/N 📢 Introducing UCCL (Ultra & Unified CCL), an efficient collective communication library for ML training and inference, outperforming NCCL by up to 2.5x 🚀 Code: github.com/uccl-project/u… Blog: uccl-project.github.io/posts/about-uc… Results: AllReduce on 6 HGX across 2 racks over RoCE RDMA

Gemini is a fantastic set of models with unique reasoning and long context capabilities. Excited to bring them at scale to our customers on Databricks!

.Michael Armbrust, Distinguished Software Engineer at Databricks, talked to VentureBeat Apache Spark™ Declarative Pipelines: a proven declarative API for building robust data pipelines with a fraction of the work. “You declare a series of datasets and data flows, and Apache

If you are: - An early-stage startup - Have raised up to $5M in venture funding - And are using Postgres, Apply to our Startup Program and get up to $100k in credits: neon.com/startups

Clean Rooms now support multi-party collaborations across all clouds! The latest advancements in Databricks Clean Rooms help users unlock richer insights. Take a look at what's new: - Databricks Clean Rooms now GA in GCP, enabling seamless cross-collaborations - Multi-party

Calling learning natural-language rules “not real learning” is so backwards. Interacting with an environment to generate abstract hypotheses and turn them into actionable natural-language rules is as “learning” as the word’s natural connotations get. Though gradient-based

Scaled up (not scale out) Postgres can power most high traffic websites today.

SIGMOD is happening (almost) in my back garden this year so I'll be there next week. We have a paper presenting our work on Databricks Lakeguard, come say hi! And if you're a talented engineer... we're hiring 🚀

Today, I’m launching a deeply personal project. I’m betting $100M that we can help computer scientists create more upside impact for humanity. Built for and by researchers, including Jeff Dean & Joelle Pineau on the board, Laude Institute catalyzes research with real-world impact.

This is a pretty good article on how we are rethinking OLTP databases with Lakebase!

DSPy DSPy is my context engineering tool of choice

✨Release: We upgraded SkyRL into a highly-modular, performant RL framework for training LLMs. We prioritized modularity—easily prototype new algorithms, environments, and training logic with minimal overhead. 🧵👇 Blog: novasky-ai.notion.site/skyrl-v01 Code: github.com/NovaSky-AI/Sky…

We just published a Databricks App template that shows how to: - Deploy a LangGraph agent asa Databricks app with a chat UI - Automatically monitor MLflow 3.0 traces on Databricks (including syncing to delta tables, with Unity Catalog governance of traces) I've also embedded my

I will be at #ICML next week! It'll be great to catch up with friends, old and new. Happy to chat about our work on Data + AI at Databricks Mosaic Research. We're growing our team and have openings for researchers and engineers in areas such as document intelligence, knowledge assistant, data

As AI agents near real-world use, how do we know what they can actually do? Reliable benchmarks are critical but agentic benchmarks are broken! Example: WebArena marks "45+8 minutes" on a duration calculation task as correct (real answer: "63 minutes"). Other benchmarks