Jensen (Jinghao) Zhou (@jensenzhoujh) 's Twitter Profile
Jensen (Jinghao) Zhou

@jensenzhoujh

cooking foundation spatial AI model @AIatMeta @Oxford_VGG @OxfordTVG; prev @StabilityAI @GoogleAI

ID: 953475486511869952

linkhttp://jensenzhoujh.github.io calendar_today17-01-2018 03:54:05

78 Tweet

354 Followers

184 Following

el.cine (@ehuanglu) 's Twitter Profile Photo

this new AI is mind blowing.. Stability AI just dropped Stable Virtual Camera - turn 2D image into 3D video(32 depth) - control camera movements with 360° spins, spirals, dolly zooms - keeps everything 3D-consistent for up to 1000 frames

Rowan Cheung (@rowancheung) 's Twitter Profile Photo

Stability AI unveiled Stable Virtual Camera, a new diffusion model It transforms single images into 3D videos with 14 dynamic camera paths Currently in research preview under a non-commercial license!

Chubby♨️ (@kimmonismus) 's Twitter Profile Photo

Stable Virtual Camera: This multi-view diffusion model transforms 2D images into immersive 3D videos with realistic depth and perspective

Jensen (Jinghao) Zhou (@jensenzhoujh) 's Twitter Profile Photo

Thanks Boyuan Chen for your kind words! Great work on History-Guided Video Generation! I quickly tested our model to see if it would support long-trajectory navigation out-of-the-box when that paper came out-It did not work very well. Diffusion-Forcing on Stable Virtual Camera?

Jensen (Jinghao) Zhou (@jensenzhoujh) 's Twitter Profile Photo

Glad to see that Stable Virtual Camera is now trending #1 among Huggingface Image-to-Video models and #10 among all demos! Keep it up, folks! 💪

Glad to see that Stable Virtual Camera is now trending #1 among Huggingface Image-to-Video models and #10 among all demos! Keep it up, folks! 💪
Kwang Moo Yi (@kwangmoo_yi) 's Twitter Profile Photo

Preprint of today: Zhou and Gao et al., "Stable Virtual Camera: Generative View Synthesis with Diffusion Models" -- stable-virtual-camera.github.io A fully open-sourced video model that can generate novel views. Another video prior to use!

stylezmorales.base.eth (@koba_1975) 's Twitter Profile Photo

Playing around with Stable Virtual Camera, turning this 2D image into a 3D promo for my latest kicks... #stablevirtualcamera #2Dto3D #sneakers

Jensen (Jinghao) Zhou (@jensenzhoujh) 's Twitter Profile Photo

Not just virtual. Visceral. Stable Virtual Camera simulates exposure through the eye of experience. 📸: Photo by Mark Boss - unsplash.com/photos/a-view-…

Jensen (Jinghao) Zhou (@jensenzhoujh) 's Twitter Profile Photo

In Transformers, as input length increases, the variance of each attention output feature diminishes, leading to a collapsed and overly concentrated representation in the infinite-length limit. Modern normalization techniques, such as LN, mitigate this by independently shifting

Jensen (Jinghao) Zhou (@jensenzhoujh) 's Twitter Profile Photo

I enjoyed reading the paper. Some sampling and architectural design (e.g., RoPE) was/is being explored in the virtual camera project. Essentially, it is about how to tame a video model taking in non-casual (i.e., shuffled) input & anchors and generating casual short clips in

Jensen (Jinghao) Zhou (@jensenzhoujh) 's Twitter Profile Photo

We are releasing Stable Virtual Camera V1.1 as a minor update, fixing a known issue where foreground objects sometimes detach from the background. See github.com/Stability-AI/s… for details.