AI can edit video in real time to sync new audio to people’s lips

By Donna Lu

Dubbed films could look more realistic by matching actors’ mouths to the sounds

Everett Collection Inc / Alamy

An artificial intelligence can adjust video footage in real time to make people appear to lip sync to any sound.

Prajwal Renukanand at the International Institute of Information Technology in India, and his colleagues have developed an algorithm that can rapidly alter video footage of a person talking or singing.

The researchers believe the AI could be used to alter videos so that the footage appears to match the sound of different languages, such as in dubbed movies.

The team trained the …