Is your RLHF training too slow? 🦥 Does inefficient LLM generation get you down? We propose a new paradigm: Asynchronous RLHF! It's faster, more efficient, and achieves the same perf as SOTA methods only improving with scale! arxiv.org/abs/2410.18252 and we release code too

Resharing as CtRL-Sim was accepted at #CoRL2024, which we will present this week in Munich! Also, all the code is now available, so you can start training your own controllable and reactive driving agents: github.com/montrealroboti…

🎉 Excited to introduce BigDocs! An open, transparent multimodal dataset designed for: 📄 Documents 🌐 Web content 🖥️ GUI understanding 👨‍💻 Code generation from images We’re also launching BigDocs-Bench, featuring 10 tasks to test models on: ➡️ Document, Web, GUI Visual

Come by tomorrow 11am-2pm at NeurIPS Conference Poster #1606 to chat more about AURORA 🌌, text-guided editing, and why it is arguably more interesting than image generation Or anything related to world models, evals/analysis/interp, vision+language reasoning, cogsci, academic life!

Presented the AURORA paper together with some of the awesome co-authors Chris Pal Siva Reddy Luis Lara from Mila - Institut québécois d'IA Tons of fun, 3h of non-stop chatting and exchange of ideas, now pretty exhausted 😅

🚀 Exciting news! Our work LitLLM has been accepted in TMLR! LitLLM helps researchers write literature reviews by combining keyword+embedding-based search, and LLM-powered reasoning to find relevant papers and generate high-quality reviews. LitLLM.github.io 🧵 (1/5)

Scenario Dreamer has been accepted at #CVPR2025! Website: …ceton-computational-imaging.github.io/scenario-dream… We train a vectorized latent diffusion model to synthesize high-fidelity driving simulation environments (agents+map). Scenario Dreamer enables fully data-driven closed-loop generative simulation!

Thanks AK for sharing our work! Excited to present our next generation of SVG models, now using Reinforcement Learning from Rendering Feedback (RLRF). 🧠 We think we cracked SVG generalization with this one. Go read the paper! arxiv.org/abs/2505.20793 More details on

Exciting news! Our NaijaVoices paper has been accepted to Interspeech 2025! 📄 Read the paper: arxiv.org/abs/2505.20564 🌐 Explore the dataset: naijavoices.com NaijaVoices is the largest open African speech dataset comprising a record b wreaking 5,000 unique speakers

Today marks a big milestone for me. I'm launching LawZero - LoiZéro, a nonprofit focusing on a new safe-by-design approach to AI that could both accelerate scientific discovery and provide a safeguard against the dangers of agentic AI.

🚗💥Introducing Ctrl-Crash: controllable video generation for autonomous driving! SOTA models struggle to generate physically realistic car crashes. We propose an image2video diffusion model with bounding box and crash type control. Website: anthonygosselin.github.io/Ctrl-Crash-Pro… 🧵->

Our new model for controllable car crash generation is out!!! 🚗💥🚙 Sora, Cosmos and other "SOTA" video generation models look good, but have horrible physics. Ctrl-crash generates all types of crashes for a given scene in a realistic way.

Ctrl-Crash Controllable Diffusion for Realistic Car Crashes

🚨 Excited to share our #ICML2025 paper: The Impact of On-Policy Parallelized Data Collection on Deep RL Networks. Big congrats to Walter Mayor-Toro for the amazing work! 🎉 Read the paper here: arxiv.org/abs/2506.03404, and more details in the thread below ⬇️

Max Azoury AK Veo 3 seems to behaves similarly: the visual quality looks great, but hardly "realistic" if that's your goal. Here is an example with veo3 with the caption "At an intersection two cars collide with each other at full speed resulting in a crash"

Finally finished a blog post I've been working on (on and off) for months. It builds on a TMLR paper I published last year in model-based optimisation, but I wanted to explain things more clearly this time. More honest, more readable, more reflective. beckham.nz/2025/07/01/mod…

Exciting news! We're thrilled to announce the appointment of Professor Hugo Larochelle as Mila's new Scientific Director! A deep learning pioneer and former head of Google's AI lab in Montreal, Hugo's leadership will be pivotal in advancing AI for the benefit of all. Read the

Excited to announce this awesome workshop we are organizing at Mila World models touch so many fields from robotics/videos to LLMs and AI4Science: there will be something for everyone! We already have several amazing speakers confirmed, with more to be announced soon 🤩

New paper 📜: Tiny Recursion Model (TRM) is a recursive reasoning approach with a tiny 7M parameters neural network that obtains 45% on ARC-AGI-1 and 8% on ARC-AGI-2, beating most LLMs. Blog: alexiajm.github.io/2025/09/29/tin… Code: github.com/SamsungSAILMon… Paper: arxiv.org/abs/2510.04871

Generative Point Tracking with Flow Matching My latest project with Adam W. Harley Kosta Derpanis (sabbatical @ CMU) Derek Nowrouzezahrai Chris Pal Project page: mtesfaldet.net/genpt_projpage/ Paper: arxiv.org/abs/2510.20951 Code: github.com/tesfaldet/genpt