getting a PR merged in transformers, making torch.compile work, ... be like: youtu.be/Trkxjp0qERg?t=… and the list could go one

huggingface.co/chat/ with llama 3 70B + web search feature is pretty useful IMO, straight to the point, filtering out the bullshit search results, quoting precise sources you can ctrl+F. Next for me is to use an equivalent directly in VSCode for debugging :)

I'll be in Seattle next week attending Microsoft Build, if you're around and would like to chat feel free to drop me a message!

Does H100 actually have 85GB HBM? cudaMemGetInfo gives me 85.17 GB, and nvidia-smi gives me 85.52 GB. Yet the GPU is named "NVIDIA H100 80GB HBM3"

Beautiful doc by efxmarty to monitor your LLM deployments (Prom + Grafana) huggingface.co/docs/text-gene…

I'll be presenting today at 5:00 pm CET the work we have been doing at HF on TGI x ROCm, feel free to drop by: streamyard.com/watch/iMZUvJnm…

Meta models user experience: "Your request to access this repo has been rejected by the repo's authors." DeepSeek user experience: `huggingface-cli download deepseek-ai/DeepSeek-R1` let's goooo