Excited to share our #TrajectoryCrafter, a diffusion model for Redirecting Camera Trajectory in Monocular Videos! Try to explore the world underlying your videos~ Page: trajectorycrafter.github.io Demo: huggingface.co/spaces/Doubiiu… Code: github.com/TrajectoryCraf…

Fantastic work!!

Introducing St4RTrack!🖖 Simultaneous 4D Reconstruction and Tracking in the world coordinate feed-forwardly, just by changing the meaning of two pointmaps! st4rtrack.github.io

our new system trains humanoid robots using data from cell phone videos, enabling skills such as climbing stairs and sitting on chairs in a single policy (w/ Hongsuk Benjamin Choi Junyi Zhang David McAllister)

Excited to introduce PyRoki ("Python Robot Kinematics"): easier IK, trajectory optimization, motion retargeting... with an open-source toolkit on both CPU and GPU

🌟gsplat🌟just integrated 3DGUT, which allows training and rendering 3DGS on *distorted* pinhole/fisheye cameras, as well as rolling shutter effects! > Checkout this NVIDIA tech blog developer.nvidia.com/blog/revolutio… > Sweepstakes to win a 4090 nvidia.com/en-us/research…

Introducing POD ! Predict-Optimize-Distill : A Self-Improving Cycle for 4D Object Understanding ! Inputs: a multi-view scan of an object + casually captured, long-form human interaction monocular videos (from your phone) ! Outputs: 3D part poses over time .

For everyone interested in precise 📷camera control 📷 in transformers [e.g., video / world model etc] Stop settling for Plücker raymaps -- use camera-aware relative PE in your attention layers, like RoPE (for LLMs) but for cameras! Paper & code: liruilong.cn/prope/

Excited to share Flow Matching Policy Gradients: expressive RL policies trained from rewards using flow matching. It’s an easy, drop-in replacement for Gaussian PPO on control tasks.

"Cameras as Relative Positional Encoding" TLDR: comparison for conditioning transformers on cameras: token-level raymap, attention-level relative pose encodings, a (new) relative encoding Projective Positional Encoding -> camera frustums, (int|ext)insics for relative pos encoding

Genie3 is like magic! Curious the best way to add viewpoint conditioning signal into transformer? Check this out 👉 liruilong.cn/prope/

Viser is a very practical open-source tool for visualizing your 3D data in realtime, interactively and easily shareable!

A real-time interactive model with almost perfect 3D consistency and long-term memory!!

3D annotation has never been easier!