We're excited about how our 1M Context Length AI at Meta Llama-3 70B performed against RULER. Dive into the results or checkout how we made this possible (e.g. scaling rotational embeddings). ✅ RULER Results: gradient.ai/blog/ruler-vs-… ✅ Made Possible By: gradient.ai/blog/scaling-r…

I loved chopping it up with Alessio Fanelli and swyx. We certainly covered some breadth of topics from distributed training, positional encodings, evals and what's next.

What an episode! Join our Co-Founder & Chief Architect, Mark Huang, as he breaks down the intricacies of scaling Llama3 beyond a 1M context window on the latest episode on Latent.Space! 🔗 latent.space/p/gradient ✅ History of Long Context ✅ Intro to RoPE, ALiBi, and

We did a thing! Honor to be right behind cohere in the rankings. Thanks NVIDIA team for our submission onto the RULER Leaderboard. We aren't done, long context evaluations are still an open area of research.

Excited to be part of the lineup Sapphire Ventures pulled out a deep bag here

Couldn’t catch my talk at AI & Big Data Expo hit the Gradient team up at booth 85!

We back baby! Honored to be speaking again at the The AI Conference

Join our Fireside chat 🔥 on Wednesday with Mark Huang , co-founder of Gradient and Sage Elliott as they discuss how longer LLM context can improve agentic workflows! eventbrite.com/e/improve-agen…

Dropping some bangers next Tuesday. Looking forward to catching up with folks next week!

Had a blast chatting with Sean Falconer and talking about how Gradient is supporting Enterprise AI Automation.

Just a testament to the cracked team we assembled Gradient (grateful for the pretraining too from Meta and the compute from Crusoe ) So many use cases and applications still to be explored in AI automation applications. [email protected] 👈

I recently talked to a team from Crusoe and Gradient on their effort to create an open LLM with a one-million-token context window. Thanks to Leo Pekelis Ethan and Peter McGregor for sharing key lessons learned from the project. venturebeat.com/ai/how-gradien…

Mark Huang recently sat down with Amanda_robs and Timothy Chen from Open Source Startup Podcast🎙 to catch up on everything we've been working on 🔥 🎥 podcasters.spotify.com/pod/show/ossst… ✅ Enterprise AI Automation ✅ Long Context Models ✅ Enterprise Industry Use Cases Thank you both for having us!

It was such a pleasure discussing the Gradient founder journey. If you want to hear about: - Enterprise AI Automation - The hard things about hard things - Long Context Agents This is the episode to tune into. As always Amanda_robs and Timothy Chen were the best hosts!

Sharing the first series of content on what we’ve learned about the AI in Healthcare. We’re building the foundation for organizations to implement their AI use cases on top. Let us know what you think!

This why I fucking love meeting current or former quants. Nobody knows better how to get the most out of scarce resources. Set them off and let them cook!

I had to get my wallet ready for o3 💰