Last week, Alex Tseng presented his work on branched diffusion models. Very interesting method, I personally found very cool the idea of generation by analogy, called "Transmutation". Thanks Alex for the fantastic presentation 👏! You can watch it here youtube.com/watch?v=56111r…

My twitter was hacked for the last week, hope nothing too weird happened. I saw a bunch on weird tweets from my profile, that wasn't me!

Kicking off the new series of presentations with a super interesting talk by Aaron Lou on Reflected Diffusion Models! You can watch the recording here: youtube.com/watch?v=smKLUP… Thank you so much Aaron Lou 🙏🙏

Fantastic presentation from Yen Ting Lin on diffusion models with discrete diffusion process 👏👏 very clear explanation and promising results for their 'Blackout Diffusion'. Take a look at the presentation here youtu.be/LnCI7I7FmAA?si…

Modern Hopfield networks are related to transformers, but did you know that they are mathematically equivalent to generative diffusion models? Happy to share: "In search of dispersed memories: Generative diffusion models are associative memory networks" arxiv.org/abs/2309.17290

Another fantastic presentation, this time from Kirill Neklyudov!! You can watch it here: youtube.com/watch?v=LpqrgV… Thanks Kirill Neklyudov for the great talk and for answering all our questions 👏🙏!

A very insightful presentation about probabilistic Hopfield nets and their link with diffusion models! youtu.be/hK_L9Typ8PM?si…

You should follow our Generative Memory Lab channel! Plenty of content on generative models, diffusion models, associative memory! youtube.com/@gemlab3695?si…

An amazing talk by Aaron Lou on diffusion language transformers. Bracing for the era of large language diffusion! youtu.be/_1qv_LNjH9U?si…

Job alert! I am looking for a talented PhD student to do research on generative diffusion and its connections to statistical physics and memory. Feel free to send me a PM if you need more info! You can apply here: ru.nl/en/working-at/… Otherwise, please retweet!

Amazing presentation by Marvin Li on critical windows in diffusion models. A work very closely related to our research on spontaneous symmetry breaking. youtu.be/NbnBmi5k1UQ?si…

I am very happy to share: " Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusion" We study the evolving latent geometry of diffusion by analyzing gaps in the Jacobian spectrum with statistical physics methods Paper: arxiv.org/pdf/2410.05898

I am very happy to share our recent work on consistency model led my my brilliant PhD student Gianluigi Silvestri during his internship at Sony AI in collaboration with Chieh-Hsin (Jesse) Lai, Yuhta Takida and Yuki Mitsufuji. "Training Consistency Models with Variational Noise Coupling"

New preprint out! Reach out if you are interested, or let's grab a coffee at ICML this week!

I spent the past month reimplementing DeepMind’s Genie 3 world model from scratch Ended up making TinyWorlds, a 3M parameter world model capable of generating playable game environments demo below + everything I learned in thread (full repo at the end)👇🏼

1/2) Have you have noticed that the forward process in a diffusion model looks a lot like the reparameterization trick in VAEs? It turns out that there is a deep connection! Curious? Watch our new vedio in the Generative Memory Lab channels (link below)