Yilun Du (@du_yilun) 's Twitter Profile
Yilun Du

@du_yilun

Incoming Assistant Professor at Harvard @KempnerInst + CS. PhD @MIT_CSAIL, BS MIT. Generative Models, Compositionality, Embodied Agents, Robot Learning.

ID: 851865313

linkhttp://yilundu.github.io calendar_today28-09-2012 22:51:02

346 Tweet

6,6K Followers

255 Following

Yilun Du (@du_yilun) 's Twitter Profile Photo

Super excited to be joining Harvard as an assistant professor in Fall 2025 in Kempner Institute at Harvard University and Computer Science!! I will be hiring students this upcoming cycle -- come join our quest to build the next generation of AI systems!

Yilun Du (@du_yilun) 's Twitter Profile Photo

Cool work showing how we can accelerate video generation to real time speeds! Could open up lots of real world use cases of video policies and simulations.

Yilun Du (@du_yilun) 's Twitter Profile Photo

Great work led by Boyuan Chen! My favorite part is that we break sequence-level diffusion models into a composition of per-transition models. This allows for much more data-efficient learning, trajectory stitching, and the simulation of infinitely long sequences!

Yilun Du (@du_yilun) 's Twitter Profile Photo

For video models to be effective world simulators, they need to be finely controlled given detailed action descriptions. Cool work on compositional video generation showing one way to add more control!

Yilun Du (@du_yilun) 's Twitter Profile Photo

I'll be at #RSS2024 this week and at #ICML2024 next week! Looking forward to catching up with new and old friends! I'm especially excited to chat about EBMs, planning/reasoning, compositional models, robot foundation models, and video models!

Yilun Du (@du_yilun) 's Twitter Profile Photo

I'll be presenting 3 papers at ICML Conference! - Position Paper on Compositional Generative Modeling arxiv.org/abs/2402.01103 - Composing Language Models through Multiagent Debate composablemodels.github.io/llm_debate/ - Combing Diffusion Models / EBMs for Reasoning energy-based-model.github.io/ired/

Yilun Du (@du_yilun) 's Twitter Profile Photo

We're organizing a workshop on compositional learning at NeurIPS Conference! Compositional generalization remains a huge problem in current models which often fail to generalize to unseen environments. Submit your work in this area to our workshop!

Yilun Du (@du_yilun) 's Twitter Profile Photo

🚨 Exciting News! 🚨 We're thrilled to announce that the Safe Generative AI Workshop at NeurIPS 2024 is now accepting paper submissions! 🎉 Topics include but are not limited to: Large Multimodal Model/LLM/RLHF/Reinforcement Learning/Generative Models related AI safety 📅

Yilun Du (@du_yilun) 's Twitter Profile Photo

A survey on generative models in robotics led by the awesome @thepythagorian! We overview the recent trends in this area, how to effectively get these models to generalize to settings without demonstrations, and directions of future work!