🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Hugging Face Transformers is now a first-class citizen in vLLM LLM-Compressor!

Hope you enjoy this great discussion I had with brian stevens on Technically Speaking. The future of open source AI inference!

Honored to represent Red Hat at @fastcompany.com's Most Innovative Companies Summit this week! Even more exciting—celebrating Red Hat’s recognition as one of Fast Company’s Most Innovative Companies of 2025 in the Enterprise category!

Join us this Thursday for vLLM Office Hours #27 as we deep dive into llm-d, a Kubernetes-native framework for distributed AI inference built on top of vLLM. ✅ Why use llm-d ✅ How it works ✅ Live demo 🗓️ Thurs, June 12 @ 2PM ET 📍 GMeet 🔗 Sign up: red.ht/office-hours

Join us at AI Plumbers Conference on June 15 in Berlin, hosted by Hugging Face! 🇩🇪 Red Hat's Marta Blaszczyk and Karsten Gresch will demo how to go from a notebook sketch to production-ready LLM apps using #opensource tools like Podman AI Lab and Instruct Lab. lu.ma/vqx423ct

We’re diving deep into distributed LLM inference with llm-d (llm-d) this Thursday at 2:00pm ET during our bi-weekly vLLM office hours. Not on the calendar invite yet? Fill out this form and we’ll get you added: red.ht/office-hours

⬆️ uv pip install -U vllm --extra-index-url wheels.vllm.ai/0.9.1rc1 --torch-backend=auto Try out Magistral on with vLLM 0.9.1rc1 today! 🔮

How can we teach LLMs specialized knowledge and, just as importantly, make them unlearn knowledge? 🤔 Join our next #RandomSamples AI seminar to explore unified frameworks for LLM knowledge learning & unlearning. 🗓️ Friday, June 13th | 11:30 AM ET l youtube.com/watch?v=Rzq3Cs…

vLLM Office Hours #27 – Distributed Inference with llm-d x.com/i/broadcasts/1…

Catch up on our latest vLLM Office Hours! We covered v0.9.1 updates (Magistral, FlexAttention, multi-node serving, etc,) and a deep dive + live demo of llm-d, a Kubernetes-native distributed inference framework. Slides: docs.google.com/presentation/d… Video: youtu.be/pYujrc3rGjk

In Singapore this week and working with vLLM? Join us for a super casual meetup + happy hour. No talks, just drinks and good convo. 📍 Southbridge rooftop bar 🗓️ June 19, 6:30 PM 🔗 RSVP: lu.ma/r2y1sqr4 Drinks sponsored by Red Hat AI, bring a friend!