Deemos Tech presents Media2Face

Expressive and complex facial animation generation with guidance from audio, text, and image inputs

Avatars that can expressively talk, yell, and sing

Code and dataset coming soon

Links below:

This one is 👉👌 nuts!

Media2Face can generate 3D facial animations from speech, audio, text, and image prompt and even allows for per-frame expression controls with a reference image or text prompt.

Just look at that quality 🤯 Bring it on, I'm ready!

sites.google.com/view/media2fac…

Media2Face

Co-speech Facial Animation Generation With Multi-Modality Guidance

project page: sites.google.com/view/media2face

The synthesis of 3D facial animations from speech has garnered considerable attention. Due to the scarcity of high-quality 4D facial data and well-annotated

🚨Paper Alert 🚨

➡️Paper Title: Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance

🌟Few pointers from the paper

🎯In this paper authors have presented Media2Face, a diffusion-based generator that integrates diverse media inputs (audio, image, and

Media2Face: A new method for 3D facial animation from speech.

Uses a variational auto-encoder to map faces to a latent space. Which allows to make complex animations of talking, singing or yelling.

Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance 🤯 💃 3D facial animations by combining AI, video frames and audio.

These facial expressions look amazing and very natural. It not only animates the lips and syncs it with the audio but does whole

Meet Media2Face

Co-speech Facial Animation Generation With Multi-Modality Guidance

“The synthesis of 3D facial animations from speech has garnered considerable attention. Due to the scarcity of high-quality 4D facial data”

【Media2Face】顔の表情豊かなバーチャルヒューマンが誕生！？

Media2Faceとは「音声による 3D 顔画像の合成」を可能とし、音声に基づいて音声と同期した表現力豊かな 3D フェイシャル アニメーションを生成できます。

🤯 One of the most advanced facial animation models just dropped.

📹 Media2Face uses speech to synthesize accurate 3d facial movements with some of the best quality we have seen so far with their new diffusion based model. Setting a new benchmark in animation.

🧵1 of 4

👋 Say hello to Media2Face, the tool for creating realistic and expressive Facial Animations from any Audio/Image/Text input.

Watch how digital humans can sing in various languages!

🎉 Coming soon to #ChatAvatar , powered by #GenerativeAI . 🚀

twitter.com/i/status/17462…

Media2Face Revolutionizes Co-Speech Animation:🎭

Digital Faces Mimic Human Speech Naturally! 🗣️

➡️Read more: sites.google.com/view/media2face

➡️Watch more: youtu.be/ugTYqTZSlfg

#TechNews #Innovation

Media2Face it’s getting serious .. march to aivaholograms begins… awaiting code release sites.google.com/view/media2face

Media2Face est une percée de l'IA dans la synthèse des animations faciales. À partir de données audio, de texte et d'images, il crée de manière transparente des animations faciales réalistes en 3D.

sites.google.com/view/media2face

改めてMedia2Face

オーディオ2フェイス? Media2Face を試してみましょう!

🌟 #ChatAvatar は、複雑なフェイシャル アニメーションを作成するための音声/画像/テキスト入力を間もなくサポートする予定です。 🌠

twitter.com/DeemosTech/sta…

it's so over. youtu.be/ugTYqTZSlfg?si…

【ついに、Media2Face】
Text2Faceでもなく、Audio2Faceでもない。
別の人間の「顔の動き」をトラッキングし、自然な顔の表情をモデルが再現。

より、自然なクローンアバターが、ソースがあればトレーニング可能に。

Thanks AK for sharing our work❤️
🎉 Finally we can announce that #Media2Face has been accepted by ACM SIGGRAPH as Technical Paper - Journal Track.

Media2Face will also available at #ChatAvatar later this year.
#SIGGRAPH2024

Media2Face

Co-speech Facial Animation Generation With Multi-Modality Guidance

project page: sites.google.com/view/media2face

The synthesis of 3D facial animations from speech has garnered considerable attention. Due to the scarcity of high-quality 4D facial data

Many doomers speak down on AI Avatars. They say things like...

'Ha I can tell that was AI, look at the lips and facial expressions. So dumb'

What they don't know is that on any given Tuesday, a new piece of research goes peekaboo.

Tada. Media2Face.