Big shoutout to my awesome collaborators Joey Hejna Dorsa Sadigh Yonatan Bisk - not atttending any conferences on this project😎 Thanks to Hao Zhu Quanting Xie So Yeon (Tiffany) Min lalit mathur Vidhi Jain Yingshan Chang Rosa Vitiello + all others in Carnegie Mellon University CLAW lab for thoughtful feedback and help with data collection!👩‍💻

This paper inspires me to not only selectively choose partial goals (demonstration, language, environment states like objects, etc.) for robot learning, but also to use a combination of them (e.g., demonstration + language)! Using CVAE and a learned prior seems to be the key🤔

Excited to introduce 𝐋𝐀𝐏𝐀: the first unsupervised pretraining method for Vision-Language-Action models. Outperforms SOTA models trained with ground-truth actions 30x more efficient than conventional VLA pretraining 📝: arxiv.org/abs/2410.11758 🧵 1/9

Gemini 2.0 can reason about the physical world! Try it out today at aistudio.google.com/starter-apps/s… Your robots will thank you for it :)

Happening now! Drop by poster #168 at CVPR to see our work! Also giving a spotlight talk at CVPR EAI workshop at 3:50-4pm. Happy to chat w/ anyone interested during the conference😊

What if an LLM could update its own weights? Meet SEAL🦭: a framework where LLMs generate their own training data (self-edits) to update their weights in response to new inputs. Self-editing is learned via RL, using the updated model’s downstream performance as reward.

Most assistive robots live in labs. We want to change that. FEAST enables care recipients to personalize mealtime assistance in-the-wild, with minimal researcher intervention across diverse in-home scenarios. 🏆 Outstanding Paper & Systems Paper Finalist Robotics: Science and Systems 🧵1/8

I’ll be giving a spotlight talk at the RSS SemRob workshop (OHE #122, 9:50-10am) about this work today! The talk is followed by the poster session, so feel free to stop by if you’re interested :) Happy to catch up or chat about research and potential collaboration during the

I’ll talk about the PARTNR framework and how LLMs perform in planning in dynamic environments. I’ll also talk about a unified memory architecture for robotics, an alternative to recent scene representations that rely on ad-hoc combination of multiple large models.

If you are at #RSS2025, check out our workshop on Generative AI for Human-Robot Interaction. We have a stacked lineup of speakers and panelists!

How to generate billion-scale manipulation demonstrations easily? Let us leverage generative models! 🤖✨ We introduce Dex1B, a framework that generates 1 BILLION diverse dexterous hand demonstrations for both grasping 🖐️and articulation 💻 tasks using a simple C-VAE model.

“As a PHD student, your job is not publishing a paper every quarter. Focus on a problem in deep understanding and solve it in years under the protect of your adviser” from Russ Tedrake #RSS2025

Amazing to see tactile sensors that are 3d printable in any form factor!

Happening now at RTH 109!

It's almost time for #CoRL 2025! A reminder that we're hosting the Data in Robotics workshop this Saturday Sept 27th. We have a packed schedule and are also attempting to livestream the event for those who can't attend in person.

Physical caregiving is one of robotics' hardest frontiers: it is contact-rich, physically intensive, long-horizon, safety-critical, and full of deformable objects. Physical caregiving tasks such as bathing, dressing, transferring, toileting, and grooming require professional

PhD application season is here! The CLEAR Lab @ MIT CSAIL is recruiting students excited about human-centered robot learning and algorithmic HRI. If you're interested in working on: 🤝 IRL & preference learning 🎛️ steering & finetuning large behavior models (diffusion