LLNL has unveiled the most powerful supercomputer and first #Exascale machine dedicated to #NationalSecurity. With a sustained performance of 1.742 exaFLOPs on the TOP500, El Capitan becomes the first HPC machine to surpass the 2 exaFlOP barrier! livermorelab.info/4gbFg31

Big day at #SC24!! Excited to announce El Capitan, powered by AMD is now the world's fastest supercomputer at 1.742 exaflops! We now power 5 of the top 10 and 21 of the top 50 supercomputers in the world. Thanks to HPE, Lawrence Livermore National Laboratory, U.S. Department of Energy for their partnership!

We had a lot of fun presenting a tutorial on Distributed Deep Learning on GPGPU clusters at #SC24. We still have more t-shirts and stickers, come to one of our talks or to the UMD booth. #HPC # AI

A team of parallel computing and machine learning experts from UMD Science and UMIACS has been named a finalist in a global competition recognizing outstanding contributions in high-performance computing. The team—led by Abhinav Bhatele and Tom Goldstein—is one of six vying for

Hyperion Research Announces Winners Of 2024 HPC Innovation Excellence Awards ow.ly/cBuC50Uc6Qt #HyperionResearch #HPC #TCIwire

Double congratulations to Siddharth Singh, because our work was also a finalist for the Gordon Bell Prize at #SC24 this year! 🚀🚨

Congratulations to the winners of the #HPC User Forum Innovation awards at #SC24 o Siddharth Singh and Abhinav Bhatele o Eric Nielsen o Nils Helset hpcuserforum.com/innovationawar…

🏆 Researchers from the Univ. of Maryland received the HPC Innovation Excellence Award from Hyperion Research for their work on AxoNN—a scalable framework that’s pushing the limits of Large Language Model (LLM) training! 🚀 💫 bit.ly/3CsmjKM 🏆 bit.ly/3V9HFTw

Why is addition hard for next token predictors? Come hear about our fix for this at #NeurIPS! We’re presenting Abacus Embeddings 🧮 tomorrow (Friday) from 11-2 in the East Exhibit hall at poster 2907. Drop by to see how we can improve your language model.

Come see our #NeurIPS2024 poster today on" Loki: Low-rank Keys for Efficient Sparse Attention" Paper: arxiv.org/abs/2406.02542 Code: github.com/hpcgroup/loki Loki is a sparse attention method that reduces the computational and memory costs of LLM inference! By exploiting the

Poster session in progress … if you miss us and want to chat, you can find more information on pssg.cs.umd.edu.

We have a postdoc opening in our group on the intersection of HPC and AI, specifically on developing and applying Code LLMs to HPC software development. Please help us spread the word: umd.wd1.myworkdayjobs.com/en-US/UMCP/det… Position will remain open until filled. #HPC #AI

Incredibly proud moment for me as an advisor. The first cohort of students in Parallel Software and Systems Group started in 2020 and they are now starting to graduate. Also a bittersweet moment as we bid adieu to some senior students this Spring & welcome new ones in the Fall. Congrats Daniel Nichols!

Riken, including our center R-CCS, is hiring researchers big time, from PIs to postdocs to interns. We have the best support for international researches; in fact the % of non-JP researchers at R-CCS is approaching 50 % now. Come work with us! riken.jp/en/careers/ope…

Congrats Siddharth Singh! Siddharth is going to join NVIDIA after he graduates to continue working on parallel training and inference. Follow him to keep track of what interesting stuff he’ll do next 😊

Fine-tuning massive LLMs requires reliability at scale. The Lightning open source stack gives you just that. Check out Democratizing Al: Open-source Scalable LLM Training on GPU-based Supercomputers. ✅ 405B param MoE language model ✅ Fully finetuned on 32,768 GPUs on a

A large number of PhD students in my group have graduated or will be graduating by Spring, so I am recruiting several PhD students for the next admission cycle (Fall 2026). If you want to work with us, apply by Dec 5 and drop me a short email. Please repost/share widely. #HPC #AI

If you are interested in collaborating with us or you are an undergrad planning to apply for a PhD, come and talk to us (don't feel shy!). You'll find me or PSSG students at the events below. #SC25

Congratulations to Dr. Cankur and Dr. Davis! Best wishes for a bright future!!

Congratulations to Dr. Joy Kitson for successfully defending her PhD dissertation last Friday (April 10)! That makes her the fifth PhD student to graduate from our group. Dissertation title: "Scaling Agent-based Epidemic Diffusion on HPC Clusters"