Spotify and OpenAI join forces to dub podcasts in different languages; understand how

O Spotify announced a collaboration with OpenAI which promises innovations in its podcasts. This partnership will open the doors to Artificial Intelligence (AI).

This is because it will clone the voices of the presenters and guests, making it possible to dub programs in different languages, with the aim of reaching a wider audience who do not speak the language original.

Initially, this technology was only applied to translation from English to Spanish, limited to some of the most popular podcasts.

However, Spotify plans to expand these translations into French and German in the coming weeks. Translated episodes can now be found on the platform.

They are in a dedicated section, so that interested parties can try this innovation. The engine behind this initiative is Whisper technology, developed by OpenAI. Find out more below!

How Whisper works?

This technology has the ability to transcribe speech and translate languages ​​into English. Furthermore, it is used in applications such as ChatGPT to understand voice commands and also in messaging bots.

However, the Spotify tool goes further, creating synthesized versions of the voices of podcast presenters and participants.

This allows them to appear to be speaking fluently in other languages, eliminating the need to learn the language or redo the program.

It is worth noting that this is not the first time that Spotify has incorporated AI into its application, the company had already launched DJ X.

It is an AI that acts like a radio announcer, interacting with users between recommended songs. However, this tool is currently in beta phase and is not yet available in Brazil.

Although Spotify has not released additional technical details, it is likely that these new features in voice processing will also be based on OpenAI technologies.

Additionally, OpenAI announced a major update to the ChatGPT mobile app, including voice responses that, for now, are only available to users of the Plus and Enterprise.

These innovations show how artificial intelligence is playing an increasingly significant role in expanding possibilities in the entertainment and communications industry.

At Trezeme Digital, we understand the importance of effective communication. We know that every word matters, which is why we strive to deliver content that is relevant, engaging and personalized to meet your needs.