Dec 4, 2021 · In this work, we present a joint audio-text model to capture the contextual information for expressive speech-driven 3D facial animation.

May 3, 2022 · Given a speech signal (audio and text) and a 3D face mesh, our method produces the expressive lip-synchronized 3D facial animation with ...

May 4, 2022 · We show that the combined acoustic and textual modalities can synthesize realistic facial expressions while maintaining audio-lip ...

It is shown that the combined acoustic and textual modalities can synthesize realistic facial expressions while maintaining audio-lip synchronization, ...

Speech-driven 3D facial animation aims at generating facial movements that are synchronized with the driving speech, which has been widely explored recently.

Aug 2, 2024 · In this work, we present a joint audio-text model to capture the contextual information for expressive speech-driven 3D facial animation. The ...

In this work, we present a joint audio-text model to capture the contextual information for expressive speech-driven 3D facial animation. The existing datasets ...

This work presents a machine learning technique for driving 3D facial animation by audio input in real time and with low latency, and simultaneously ...

We propose a novel and effective architecture, namely PMMTalk, which extracts pseudo visual and textual information from speech and aligns the audio-image-text ...

We present FaceDiffuser, a non-deterministic deep learning model to generate speech-driven facial animations that is trained with both 3D vertex and blendshape ...