🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

The more I look at this the more I feel like we should have a GPU tier list that ranks both vendors and neoclouds on how good they are at running PyTorch and CUDA

Registration ends tomorrow for the grand prize but you can still compete for glory until May 27 This is probably the hardest problem we've designed so far so glhf!

At this point submitting your company reference kernels to the GPU MODE kernel leaderboard is the easiest way to accelerate them. All submissions will be made public at the end of every competition so please use the fast code and hire the cracked engineers who produced it

I've seen surprisingly few people complaining about 5090 PyTorch and Triton performance. Did y'all get past the scalpers? Should we make things go super fast?

At the Mojo hackathon today I went over how PyTorch is making it easier to spin up new backends for all the new languages and hardware we're seeing this year and a WIP backend we've been collaborating on with the Mojo team docs.google.com/presentation/d…

Thank you for the collaboration and the talk Mark. I think 🔥+PyTorch are a beautiful combination - a new flame for the torch! It was great to get to spend the day with you yesterday

Just wrote an illustrated deep-dive into overlapping the compute and comms in TP+SP using Async TP. My eyeballs hurt now so hopefully somebody finds it useful :) danielvegamyhre.github.io/ml/performance…

Will be live-coding over the best performance tricks we saw from our kernel competition

Work w/ Griffiths Computational Cognitive Science Lab, Karthik Narasimhan, and Ofir Press Paper: arxiv.org/abs/2505.18134 Code:github.com/alexzhang13/vi… Website: vgbench.com Discord: discord.gg/W89VqYhQcy Our platform is completely open source and super easy to modify / plug into!

We've run thousands of LLM inference serving benchmarks at Modal. We're releasing the results so you don't have to. We're releasing the code so that you can. Introducing: The LLM Engineer's Almanac. Just in time for the AI Engineer World's Fair.

anyone interested in building the best codegen LLM for GPU kernels with the GPU MODE team, completely open-source? lmk

ColorsWind the team that won the AMD $100K grand prize just OSS'd their code github.com/RadeonFlow/Rad…