#ICLR2024 Spotlight🌟🌟🌟
PULSE: Physics-based Universal humanoid motion Latent SpacE/Representation

Code: github.com/ZhengyiLuo/PUL…
Site: zhengyiluo.com/PULSE
Paper: arxiv.org/abs/2310.04582

As a motion representation, PULSE is low dimensional (32), high coverage (99.8% of…

Inspiring how far legged robotics has come. Congratulations to the team!

Back in the lab this week updating Kinetic Diffusion, our AI powered dance performance, with new Stable Foundation models. Speed and pixels have increased tremendously unlocking new opportunities. Here’s an experiment in “popping” new prompts in with connection to the movement ⬇️

While I am at it, also releasing the trained models for VR controllers tracking using PHC.

This task is a essentially a generalized version of motion imitation, where there are only 3 6DOF points to track (red dots) instead of 24.

Models are released at…

2023 was a wild year for technological progress. At Meta, our two biggest long-term bets on the technologies of the future both make great leaps forward but more excitingly, they began to converge. I wrote about it here: meta.com/blog/quest/boz…

Impressive pace of progress📈. Congrats to the team!💪

Love to see our retargeting work featured in the latest 2MinutePaper video!
For more details check the website: cs.ubc.ca/~dreda/retarge…

The Gemini era is here. Thrilled to launch Gemini 1.0, our most capable & general AI model. Built to be natively multimodal, it can understand many types of info. Efficient & flexible, it comes in 3 sizes each best-in-class & optimized for different uses blog.google/technology/ai/…

This is impressive!

Now that PHC's code is out...

Introducing PULSE: Physics-based Universal motion Latent SpacE:
📜: arxiv.org/abs/2310.04582…
🌐: zhengyiluo.github.io/PULSE/

All downstream tasks here use the same pretrained latent space. (1/6)

Code for PHC has been released!!!

github.com/ZhengyiLuo/Per…

The codebase include:
- the SMPL humanoid environment for Isaac Gym
- Motion imitation models trained on AMASS
- More to come demos based on language & video input

PHC will be presented at #ICCV2023

📍Location: Room 'Foyer Sud' - 101
⏰ Thursday 5th 10:30 AM-12:30 PM
🆔: 1900

Humanoid control for avatars, motion imitation on AMASS, and fall-state recovery during imitation.

Jinkun Cao will be there to present🎉🎉🎉 (no visa for me🥲)

Here's my conversation with Mark Zuckerberg, his 3rd time on the podcast, but this time we talked in the Metaverse as photorealistic avatars. This was one of the most incredible experiences of my life. It really felt like we were talking in-person, but we were miles apart 🤯 It's…

Sleep is beautiful because it makes your training jobs advance

See you at #SIGGRAPH2023 !

It was a pleasure working with Zen on this project. Don’t miss it at ICCV 2023.

This is huge: Llama-v2 is open source, with a license that authorizes commercial use!

This is going to change the landscape of the LLM market.
Llama-v2 is available on Microsoft Azure and will be available on AWS, Hugging Face and other providers

Pretrained and fine-tuned…

These locomotion skills are legit.