Join us for our #ICLR25 workshop on Modularity for Collaborative, Decentralized, and Continual Learning! We have a great set of speakers and accepted papers

Sadly, I won't be able to travel and attend our Modularity workshop :( I'm sure I'll miss many amazing discussions and talks. Luckily Arthur Douillard and Lucio Dery Jnr Mwinm will be there to hold down the fort! Proud to be part of the organizing team - can't wait to meet you all next time!

starting soon, in hall 4 #3 see you all there and follow that thread :)

Despite the impressive quality of video generation, what I don't understand about #Veo3 is how it is possible to create such models without infringing on copyright. Did they make a deal with the movie industry?

The videos of the workshop are now online! youtube.com/playlist?list=…

I'll discuss distributed learning on Saturday, July 12. First, I'll cover current methods needing high bandwidth, then next-generation methods for decentralized learning

Faster local optimization by recycling past outer gradients! Incredibly proud of this work and collaboration. We have a bunch of ideas in the pipeline, looking forward to the next one with Riccardo Zaccone!

This is probably the most compelling result of the paper. Clear improvements at scale — 1K, 10K, and 40K clients, beyond synthetic benchmarks like CIFAR. You know what that means.

The Department of Statistical Sciences in the Faculty of Arts and Science at the University of Toronto invites applications for a full-time teaching stream position in the area of Statistical Sciences. The appointment will be at the rank of Assistant Professor, Teaching Stream

Fantastic work from Ai2 - asynchronous training of MoEs on private datasets and a domain-aware router. Akin to cross-silo FL, but no synchronization and no fear of heterogeneity anymore on LLMs. Nice, clean, and of course modular!

Even crazier is that the rmsprop algorithm was introduced by Geoffrey Hinton in his neural networks course, and we cite his slides - so it's fine!

6/ Josh Southern and I be at #ICML2025, poster session Tuesday — stop by and chat if you're around! ... I would also be happy to meet up and chat about graphs, (graphs and) LLMs, and how to detect their hallucinations 😳 Feel free to reach out!

Dan’s talk was a masterclass — Go watch the recording. Super clear, packed with results, and genuinely one of the most well-delivered talks I’ve seen in a while.