TY  - JOUR
TI  - Wav2Lip: A Lip Sync Expert Is All You Need
AU  - Prajwal, K. R.
AU  - Mukhopadhyay, R.
AU  - Namboodiri, V. P.
AU  - Jawahar, C. V.
PY  - 2020
DA  - 2020/08//
JO  - ACM Multimedia 2020
AB  - Prajwal, Mukhopadhyay, Namboodiri and Jawahar (2020) introduced Wav2Lip, an audio-driven lip-synchronisation method that uses a pretrained lip-sync expert discriminator as a teacher to train a generator producing accurate mouth movements for any speaker given an audio track. The key insight is using a discriminator specifically trained to judge lip-sync quality rather than general visual realism, producing accurate synchronisation on in-the-wild video without per-subject fine-tuning. Wav2Lip is speaker-agnostic and directly applicable to dubbing and dialogue-replacement workflows in animation and localisation. It became the open-source baseline cited by all subsequent talking-face and audio-driven animation research.
KW  - voice-and-performance
KW  - character-animation
UR  - https://arxiv.org/abs/2008.10010
LA  - en
ER  -