This is starting in 10 min - learn how to get started on youtube.com/watch?v=dNWv3q…

🔥🔥🔥🔥🔥🔥

Woah - We are now down to 183.429μs for FP8 GEMM on MI300X (We started at 890.743μs) on the leaderboard !!! Lets Go!!! gpumode.com/leaderboard/399

📣 Problem 2, the fused Mixture-of-Experts kernel 🍿 for MI300s, is now OPEN for the AMD x GPU MODE $100k competition! Go compete now for huge cash prizes -- registration ends SOON! Good luck everyone!

Livestream starting with GPU MODE! 🔥 youtube.com/live/yOMflrCRy…

ICYMI GPU MODE at GTC brought together leading voices in machine learning systems for an evening of sharp talks and fresh perspectives. 🎥 youtu.be/mdDVkBeFy9A From KernelBench to Thunderkittens, see what’s next in ML systems with speakers from Stanford, NVIDIA, PyTorch,

Tomorrow (5/17), The CuTe creator, Cris Cecka, will teach CuTe himself on GPU Mode. youtube.com/watch?v=ufa4pm…

This is has been an amazing collaboration between teams at Stanford University AI at Meta GPU MODE PyTorch If you're interested in making GPU programming dramatically more accessible then join us! There's a lot more stuff we're cooking! gpu-mode.github.io/popcorn/

I will be giving a talk in GPU MODE tomorrow (May 24 12pm PST) about Disaggregated Inference. Come if you're interested! youtube.com/live/uc6TnOszz…

I will be giving a talk in GPU MODE tomorrow (May 31 12pm PST) about FastVideo/STA/VSA. Come if you're interested! youtube.com/watch?v=x44iGp…

This is a write-up of the 2nd place entry in the FP8 matmul kernel competition for AMD GPUs. Very insightful: github.com/seb-v/amd_chal…

Been excited about this talk for a while, Songlin Yang on efficient architecture! Just started! youtube.com/watch?v=j4zJbr…

Yay :) I gave this talk on WebGPU for general purpose GPU computation last year GPU MODE youtube.com/watch?v=Ll5Sr1…

the follow up to Andrej Karpathy neural networks: zero to hero course is being built. singularity systems: zero to hero builds pytorch1/2 clones from scratch, training gpt2. looking for hardcore hackers to join the core team. come join the work group in the GPU MODE discord.

kind of a surreal moment being on stage with Lisa Su as she announces & thanks us for the competition we built the past year building w/ Matej Sirovatka Mark Saroufim, Ben, & Erik (all in our free time :p) on GPU MODE has been genuinely incredible, can’t thank you guys enough ❤️

Announcing a new GPU MODE kernel writing competition: our first featuring both NVIDIA and AMD hardware! The first problem will be the Triangle Multiplication operator essential to the AlphaFold 🧬 models! It's a particularly tricky problem with no good public implementation!

If you want to hack on your own GPU schedules instead of being stuck with whatever the compiler gives you then join us in 30 min!

The biggest dataset of human written GPU Code all open-source? 👀 YES Please! We at GPU MODE have released around 40k 🚀 human written code samples spanning Triton, Hip and PyTorch and it's all open on the Hugging Face Hub. Train the new GPT to make GPTs faster ⚡️ Link below ⬇️

If you’re curious to learn more. Joe is talking to us at noon PST today

I solved every single problem in the CUDA mode book. A quick thread summarizing this experience and what I learned 1/x