.Lepton AI surpasses all other providers in throughput (P50 & P90) for both Llama-2-70B and Mixtral on a small service load for short input long output prompts. A P50 of 130 tks/s is the fastest throughput we've observed among all model offerings by all providers View this

Introducing Samba-CoE v0.3, our latest Composition of Experts (CoE) model that surpasses DBRX by Databricks Mosaic Research and Grok-1 314B by @xAIGrokInu on the OpenLLM Leaderboard Hugging Face! 🏆 Samba-CoE-v0.3 is now available on Lepton AI Yangqing Jia, try now: lepton.ai/playground/sam…. #AI

We are so proud to announce our extended partnership with FastGPU FastGPU via AI OG innovators, the mighty LeptonAI Lepton AI . Now you can deploy on-Demand RTX4090’s with Enterprise AI Infrastructure IN SECONDS with Exabits on FastGPU. Just pay for what you use, as you go.

Achieving more than 99.9% uptime and quick turnaround times for collaboration between teams after partnering with #DigitalOcean, Lepton AI’s CEO, Yangqing Jia, is realizing his goal of growing 10x over the next year. 🚀 Watch to learn how ⤵ youtube.com/watch?v=NLtQHg…

Talk to Llama 3.2-3B 🦙🗣️⚡️ Powered by Lepton AI (blazing fast LLM inference, ASR, and TTS all in one!) and Gradio 's ergonomic WebRTC Streaming ⚡️ Building this took me about 30 minutes despite never using Lepton before.

We've achieved a >99.5% uptime for large scale GPU clusters, with a great collaboration between Lepton AI and DigitalOcean. This is much better than industry standard SLAs which roams around 98%. It's done via proactive monitoring solutions like our open source GPUD, the cloud

Nvidia nears a deal to buy Lepton AI, a GPU reseller, for several hundred million. 💰 This move expands Nvidia's cloud and enterprise software push. Read more: theinformation.com/articles/nvidi… #Nvidia

Crusoe is bringing compute resources to DGX Cloud Lepton marketplace to meet AI demand. 🚀 Learn more and join early access! nvidianews.nvidia.com/news/nvidia-dg… NVIDIA AI

🚨 NVIDIA launches DGX Cloud Lepton to commoditize inference compute across clouds, threatening neocloud margins. DGX Cloud Lepton is a new layer abstracting inference compute across multiple neoclouds. It gives users a consistent interface while automatically routing workloads

7/ NVIDIA and Hugging Face offer DGX Cloud Lepton for instant global GPU access. Train, fine-tune, and deploy models at scale with ease. Fast, flexible, and collaborative.

DGX Cloud Lepton is a new layer that standardizes AI inference across multiple cloud providers, offering a unified interface and automatic workload routing.

Xfinity: Make something nobody wants