🚀 Introducing DiffusionRenderer, a neural rendering engine powered by video diffusion models. 🎥 Estimates high-quality geometry and materials from videos, synthesizes photorealistic light transport, enables relighting and material editing with realistic shadows and reflections

Thrilled to see this plot in a recent survey on 'personalized image generation' (arxiv.org/abs/2502.13081) — highlighting the impact of our work! Huge congratulations to my fantastic students, whose creativity and dedication continue to drive exciting advances in the field!

🚀Excited to introduce GEN3C #CVPR2025, a generative video model with an explicit 3D cache for precise camera control. 🎥It applies to multiple use cases, including single-view and sparse-view NVS🖼️ and challenging settings like monocular dynamic NVS and driving simulation🚗.

It's fun!! Give it a spin ;)

I created a 3D Gaussian Splat of my kitchen using 1/3rd the images it used to take me by using NVIDIA AI Developer's 3DGRUT! I can now use 180 degree fisheye images and ray tracing to make detailed splats. The only reason the scene isn't sharper is because my input images weren't super

We added several goodies in the last days such that 3DGRUT now supports: - MCMC densification strategy - SparseAdam - Headless mode which enables an interactive viewer in a Jupyter notebook and more. Go ahead and try it out! More exciting things to follow in the next days!

Check out Jonathan Stephens's tutorial on how to use the 3DGRUT codebase to generate some cool results. The code is released under Apache 2.0 so go and try it out yourself! github.com/nv-tlabs/3dgru…

The time for new architectures is over? Not quite! SeNaTra, a native segmentation backbone, is waiting, let's see how it works 🧵arxiv.org/abs/2505.16993

🎙️ Super excited to invite you all to our #CVPR2025 tutorial!! Join us for a hands on session to learn how to combine rendering and simulation through #kaolin #simplicits #3dgrt from the #NVIDIA Spatial Intelligence Lab. June 11 morning. Invitation page: tinyurl.com/nv-kaolin-cvpr…

📢 GEN3C is now open-sourced, with code released under Apache 2.0 and model weights under the NVIDIA Open Model License! 🚀 Along with it, we're releasing a GUI tool that lets you specify your desired video trajectory in 3D — come play with it and generate your own! The

We are excited to share Cosmos-Drive-Dreams 🚀 A bold new synthetic data generation (SDG) pipeline powered by world foundation models—designed to synthesize rich, challenging driving scenarios at scale. Models, Code, Dataset, Tookit are released. Website:

🚀 We just open-sourced Cosmos DiffusionRenderer! This major upgrade brings significantly improved video de-lighting and re-lighting—powered by NVIDIA Cosmos and enhanced data curation. Released under Apache 2.0 and Open Model License. Try it out! 🔗 github.com/nv-tlabs/cosmo…

Together with Aaron Lefohn and Sanja Fidler, we will give a special address at SIGGRAPH. Specifically, I will give an update on our vision and our current work in enabling Physical AI. Please join us. nvidia.com/en-us/events/s…

Join us Tuesday night at #SIGGRAPH2025 Real-Time Live show to see interactive painting with Gaussian splat brushes, awesome work (and technical paper) by Karran Pandey presented by him and our inspiring collaborators at the National Film Board of Canada!

Great to see 3DGUT now integrated into LichtFeld Studio — the fastest 3DGS/GUT codebase out there. Open source keeps pushing boundaries. Huge congrats to everyone involved! 🎉

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a

📢want to produce realistic dynamic 3d worlds (with >100 splats) my new NVIDIA internship project, VoMP, is the first feed forward approach to convert input surface geometry to volumetric sim-ready assets by assigning real world physics materials 🌐Project:

Video motion and view control just became easy! Check out our new plug-and-play approach led by my brilliant students and collaborators Assaf Singer Noam Rotstein Amir Mann Ron Kimmel Technion Israel 🌐project page: time-to-move.github.io