Sonic The Hedgehog robot! A solution to the classic “legs vs wheels” debate? Six legs *and* a single omnidirectional wheel. Also a different take on legs+wheels than “wheels at the bottom of legs”, for example Boston Dynamics’ ~2017 Handle bot, Ascento , etc. Also relevant

Now that I have a kiddo of my own, when it’s my own birthday, my main thought is, *wow* thank you mom and dad!

Congrats Figure team, nice to see the hands and manipulation learning! 👏Corey Lynch oscar Brett Adcock and co!

Recent talk at MIT by Toyota Research Institute on their work scaling diffusion models and dexterous data collection youtube.com/live/fwBbj6UmK… Ben Burchfiel, Siyuan, Eric Cousineau, Naveen Kuppuswamy, Russ, and co.

Congrats to 1X, Eric Jang Bernt Bornich and co, for the $100M raise!

Great task to show off the new Tesla hardware, very nice, looking forward to more! 👏Julian Ibarz Ashok Elluswamy

Introduction by way of a massively oversimplified Haiku -- VLM problem: Suck at 3D reasoning Generate data :) Actually getting this done, at scale, comes with a very creative pipeline, and lots of analysis. Awesome work lead by Boyuan Chen and amazing hosting by Fei Xia !

In your head, when you *plan* into the future - how much planning do you do in "language" in your head? - if not using language, do you visualize? If you visualize, is it photoreal from an ego view, or something else? - is there a 3rd, not language or visualizing, way you plan?

One of the bigger bimanual teleop demos I’ve seen 🤣

Always such a joy seeing new Atlas videos :) Looks like a hard task, especially with the contact mode switching into/from sliding, and the constraints involved, on both grabbing and stowing. Also looks like a heavy widget. Interesting new fingers too!

🤙 Hardware improvements make life much better in unexpected ways. Example: I used to think there was a software bug causing gripper latency… nope, just static friction in the original grippers!! + new sim 💯 👏 team for Tony Z. Zhao’s Google DeepMind internship!

We've been working on ALOHA 2 for several months to scale up the ALOHA platform and create a robot fleet to collect dexterous manipulation data. The new hardware is more robust, user-friendly, and enables a much wider range of tasks. Check out Tony's thread for details!

V curious to see this hand in action! Eric Jang great show btw youtu.be/X7HmltUWXgs?si…

Congrats Jim Fan!! And Yuke Zhu !!

I'll be at ICLR 2025 next week! Happy to chat about generative models, compositional models, robot learning and embodied agents. I'll be presenting VLP (video-language-planning.github.io) showing how we can generate long-horizon video plans by combining VLMs + videos + search.

I'm leaving OpenAI after 3½ yrs. I'll be joining my good friend Andy Barry (Boston Dynamics) + Pete Florence & Andy Zeng (DeepMind 🤖) on a brand new initiative! I think this will be necessary to fully realize AGI in the world and am excited to share more about it soon