AI can transfer material of an object in an image to match a material from an example image! The method is called ZeST and it can also perform multiple material edits in a single image and perform implicit lighting-aware edits on the rendering of a textured mesh. Links ⬇️

New Gradio demo for ZeST thanks to Sylvain Filoni !

ZeST 🍋 Material Transfer demo is featured this week ! 🤟 Explore Hugging Face Spaces of the Week —> hf.co/spaces

Looking forward to sharing the work soon at #CHI2024!

I will be presenting today at #CVPR2024 ! Drop by our poster session to learn more about Continuous 3D Words for text-to-image generation: Time & Place: 19 Jun 5pm / Arch 4A-E P190 Project page: ttchengab.github.io/continuous_3d_…

Thrilled to share that ZeST has been accepted to #ECCV2024 !! A huge thanks to my collaborators/mentors Prafull Sharma , Varun Jampani, and my supervisors Niki Trigoni and Andrew Markham for the amazing support!

Amazing work combining a variety of 3D models with LLMs for better spatial reasoning! Danny

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in

BREAKING NEWS The Royal Swedish Academy of Sciences has decided to award the 2024 #NobelPrize in Physics to John J. Hopfield and Geoffrey E. Hinton “for foundational discoveries and inventions that enable machine learning with artificial neural networks.”

❗️❗️ Can MLLMs understand scenes from multiple camera viewpoints — like humans? 🧭 We introduce All-Angles Bench — 2,100+ QA pairs on multi-view scenes. 📊 We evaluate 27 top MLLMs, including Gemini-2.0-Flash, Claude-3.7-Sonnet, and GPT-4o. 🌐 Project: danielchyeh.github.io/All-Angles-Ben…

It seems there is still a long way to go for multi-modal large models to truly understand space and scene.

🚀 Glad to see our All-Angles Bench (github.com/Chenyu-Wang567…) being adopted to evaluate 3D spatial understanding in Seed-1.5-VL-thinking along with OpenAI (o1) and Gemini 2.5 Pro..!

Thanks AK ‼️ Be sure to checkout our Hugging Face Demo 🤗: huggingface.co/spaces/stabili…

Slides from my talk on "Language as a Visual Format" at the Visual Generative Modeling workshop at CVPR (mostly derived from slides made by Hyojin Bahng and Caroline 🐳): dropbox.com/scl/fi/5ok46te…