YouTube is testing an AI voice-dubbing feature for creators

The video platform YouTube is experimenting with an AI tool to allow content creators to dub their videos into various languages, broadening their international reach. This tool, developed in partnership with the AI dubbing service Aloud, is part of Google's Area 120 incubator.

New Dubbing Tool Announcement: YouTube has shared news about its collaboration with Aloud, an AI-based dubbing service from Google's Area 120 incubator.

This tool is currently under testing with hundreds of creators.

It aims to ease the process of dubbing videos into multiple languages.

Multi-Language Support Expansion: Earlier this year, YouTube provided support for multi-language audio tracks, a feature that has been used widely.

By June 2023, creators had already dubbed more than 10,000 videos in over 70 languages.

Before, creators needed to work with third-party dubbing providers, a costly and time-consuming task.

Functionality of Aloud: Aloud, the AI-powered tool, was launched in 2022 and aids creators in video translation.

It transcribes the video, translates it, and then creates a dubbed version.

Creators can review and tweak the transcription before the dubbed version is generated.

Availability and Future Developments: The Aloud tool will soon be available to all creators, currently supporting English, Spanish, and Portuguese.

Future expansions are planned to include languages like Hindi and Bahasa Indonesian.

YouTube is striving to enhance the translated audio to sound more like the original creator's voice and better synchronize with lip movements.

Technological advancements in generative AI could enable features like voice preservation, improved emotion transfer, and lip reanimation.