YouTube is testing a new feature that uses artificial intelligence to dub videos into different languages, breaking down language barriers and expanding the reach of content creators.
This revolutionary feature is a product of Aloud, an experimental project from Google’s technology incubator, Area 120. The AI algorithm transcribes the video’s audio, creating a script that the content creator can review and edit as needed. Once approved, Aloud translates the script and generates a dubbed audio track in a different language.
Currently, the feature supports dubbing from English to Spanish and Portuguese. However, YouTube plans to expand the list of supported languages in the future. This AI-powered dubbing feature is being tested with hundreds of content creators, and a full-scale launch is expected in 2024.
Earlier, YouTube allowed content creators to add multilingual voice tracks to their videos but the introduction of AI dubbing is a game-changer for YouTube channels, allowing them to significantly broaden their audience base. Even in its current, early stage, the tool proves to be beneficial. Future enhancements include making the synthesized audio tracks more similar to the original voices, adding more emotional color, and synchronizing speech with on-screen lip movements.
This innovation is not just a leap forward for content creators but also a significant step towards accessibility. It offers a more immersive experience for viewers who prefer dubbed content over subtitles. As Aloud becomes more integrated with YouTube, we can expect to see more translated content, making the platform more inclusive and accessible to a global audience.
