Algemeen
3 min
17 December 2024

Auteur

Lisanne Groot

Lisanne Groot

marketing consultant

YouTube breaks language barriers with AI dubbing

YouTube breaks language barriers with AI dubbing

It is now easier than ever to follow content from creators around the world, even if you don't speak the language. With YouTube's new AI dubbing, videos are automatically translated and provided with a voice in another language. This means that with one click, you can follow a French chef to learn how to make authentic gratin or gain inspiration from an Indian seamstress for traditional clothing. The feature is available for hundreds of thousands of channels in the YouTube Partner Program that focus on knowledge and information, with expansions to other types of content in the near future.

How does auto-dubbing work on YouTube?

The process is simple and fully integrated into YouTube Studio:

Upload video:

Upload your video as you normally would. The AI detects the original language and automatically generates dubbed versions.

Watch dubs:

Creators can view these in the "Languages" section of YouTube Studio and decide whether to publish, edit, or delete them.

Managing accessibility:

Under "Advanced Settings," creators can check if the feature is available and manage it as desired. AI dubbing currently supports English, French, German, Hindi, Indonesian, Italian, Japanese, Portuguese, and Spanish. English is translated into these languages and vice versa.

What does this mean for companies and organizations?

For organizations and companies, this tool offers an opportunity to reach international audiences without significant investments in translations or voice actors. This makes it easier to make educational and informative content more accessible in multiple languages. Moreover, the "auto-dubbed" label helps viewers identify videos with this feature. Thanks to a track selector, users can choose the original language, and this preference is remembered for future videos.

Improvements and Future Plans

Although the technology is new, YouTube is collaborating with Google DeepMind and Google Translate to enhance the accuracy and expressiveness of dubs. With future updates, including "Expressive Speech," the AI will improve in mimicking the tone, emotion, and ambient sounds of the original video. Patience and feedback from users are essential to further refine the tool.
With AI dubbing, YouTube is breaking down language barriers and making international knowledge exchange more accessible than ever. Whether you are a creator or a viewer, this tool opens the door to a world of possibilities.

[@portabletext/react] Unknown block type "span", specify a component for it in the `components.types` prop

Lisanne Groot  - Author

Over Lisanne Groot

marketing consultant