Elvis Dohmatob explaining the math behind scaling laws #MlssSenegal2025

Several research groups have released papers on the convergence of Muon, mostly looking at either as a Frank-Wolfe method with momentum or a trust region procedure. I find this one to be particularly easy to read.

No matter how AI evolves overnight—tech, career, how it may impact me—I remain committed to using "physics of language models" approach to predict next-gen AI. Due to my limited GPU access at Meta, Part 4.1 (+new 4.2) are still in progress, but results on Canon layers are shining

Elvis Dohmatob Gergely Neu Mathieu Blondel Jean-Philippe Vert Samory Kpotufe showing us some vignettes of Learning theory

Elvis Dohmatob Gergely Neu Mathieu Blondel Jean-Philippe Vert Peter Richtarik boots on the ground now, teaching Federated Learning

Elvis Dohmatob Gergely Neu Mathieu Blondel Jean-Philippe Vert Peter Richtarik Sanmi Koyejo Natalie Schluter teaching NLP + such an inspiring mentoring moment

Elvis Dohmatob Gergely Neu Mathieu Blondel Jean-Philippe Vert Peter Richtarik Sanmi Koyejo Natalie Schluter Ashia Wilson giving a large overview of optimisation for machine learning #MlssSenegal2025

Elvis Dohmatob Gergely Neu Mathieu Blondel Jean-Philippe Vert Peter Richtarik Sanmi Koyejo Natalie Schluter Franca Hoffmann & Ricardo Baptista closing the lectures with Foundations of measure transport & Application to generative modelling #MlssSenegal2025

Grateful to attend #MLSS2025 at AIMS Sénégal 🇸🇳 — a transformative experience! Learned from global ML experts & connected with brilliant PhD students from Europe & the US. Huge thanks to Adil Salim , Eugene Ndiaye for making this possible! #MlssSenegal2025

Happy to announce our ICML 2025 paper with Arto Klami, Aapo Hyvärinen, Anna Korba and Omar Chehab! Density Ratio Estimation is hard, especially in high dimensions! This was reformulated as learning and integrating a time score. We improve the learning! 🧵 Thread below

Incredible to see how fast the field moves since we worked on masked diffusion arxiv.org/abs/2406.04329. Huge congratulations to Jaeyeon (Jay) Kim Sitan Chen for the award!

Had an incredible opportunity to give two lectures on diffusion models at MLSS-Sénégal 🇸🇳 in early July! Slides are available here: onedrive.live.com/?redeem=aHR0cH… Big thanks to Eugene Ndiaye for the invitation!

Looking for postdocs to join my Optimization & Machine Learning Lab @ KAUST! Write to me by the end of November 2025 if you want to apply. richtarik.org richtarik.org/i_papers.html richtarik.org/i_team.html richtarik.org/i_join.html

Interested in some foundation aspects? Waiting or unhappy about NeurIPS reviews? Plz consider NeurIPS workshop DynaFront: Dynamics at the Frontiers of Optimization, Sampling, and Games sites.google.com/view/dynafront… Yuejie Chi Andrea Montanari Taiji Suzuki Tatjana Chavdarova ++ Sponsor appreciated!

I am organizing "Workshop on Distributed Training in the Era of Large Models" at KAUST during November 24-26, 2025. If you have done some cool work in the area, you might want to attend. The talks are invite-only. I'll soon start sending invites. More info later!

Terence Tao, perhaps the most famous living mathematician, explains the damage the recent grant cuts to UCLA has caused especially due to its impact on IPAM (the Institute for Pure and Applied Mathematics, one of 6 NSF-funded math institutes in America): mathstodon.xyz/@tao/114956840…

At 20 years old I came to the US for my first research experience and it was at IPAM. That's when I feel in love with the research energy in the US. I think it would be a tragedy to lose this institute.

seb talking about synthetic data as a new way to make better models! excited for much more to come.

Given the recent loss of its $25 million NSF grant (amongst all UCLA grants), the Institute for Pure & Applied Mathematics is now fundraising. Donation link here: giving.ucla.edu/Campaign/Donat…

check out this PhD opportunity for female students from Africa at UPF Barcelona : upf.edu/web/phd-engine… i have hired my amazing student Nneka Okolo via this program, which was a great success. hope i can find someone this time as well! let me know if you have any questions