Millions of YouTube videos will be dubbed in foreign languages

Improvements to the large language models that underlie Gemini’s AI assistant have already allowed Google to offer a limited number of video content creators the ability to automatically dub their videos in various languages. Now access to this opportunity has been expanded for authors of videos with cognitive and educational content.

Image source: Unsplash, Bhautik Patel

As TechCrunch notes, YouTube announced the expansion of support for the automatic dubbing of video content to hundreds of thousands of channels that are dedicated to educational purposes. Those content authors who, for example, write culinary blogs or share the secrets of mastery in various fields, can receive automatic video dubbing. In the future, the function will also cover those channels that specialize in other types of content.

To take advantage of the innovation, the video author just needs to upload the original video in normal mode. YouTube itself will detect the language of the source video and create duplicate versions in different languages, if the user has checked the required box in the upload page interface. Currently supported languages ​​are English, French, German, Indian, Indonesian, Italian, Japanese, Portuguese and Spanish.

Google warns that Gemini’s ability to recreate human speech in different languages ​​is still limited. The assistant can not only make grammatical, stylistic and phonetic errors, but also differ from the timbre of the owner of the original voice in the video. In the future, YouTube promises to add expressiveness to the speech of its automatic translator, which will better reflect the emotionality of the original and even repeat the surrounding sounds of the original audio track.