Google Translate Improves AI Live Speech Translation Feature

Just one month after Apple announced the launch of its live AI translation feature, Google has announced that it has upgraded its Google Translate tool to enable AI live speech translation. For background, see Is Apple’s New On-Device Live Translation Important?

While Google Translate has enabled back-and-forth speech translation for some time, users had to manually start and stop recordings for each interaction, and manually click on the translated sentence to hear a playback of the translation.

With Google’s latest update, some of these processes are automated. According to Google, “Translate smoothly switches between the two languages you and your language partner are speaking, intelligently identifying conversational pauses, accents and intonations. This allows you to have a natural conversation with just a single tap.”

The update uses the company’s Gemini models to isolate sounds and filter out background noise.

The upgrade appears to target ad-hoc consumer-focused use rather than professional or high stakes interactions. According to Claudio Fantinuoli, former Chief Technology Officer at KUDO, the update “is a clear sign that machine interpreting is entering our daily lives — just as written machine translation from Google had become ubiquitous over the past decade.”

“This app will make over time communication easier for countless people, becoming the go-to tool for casual interpreting. Its Google-level quality is supposed to make it reliable for everyday use. Even in emergencies or high-stakes situations, it can be a welcome solution — though these contexts also introduce potential risks or misuse. Its ubiquity will also push the adoption of other machine interpreting systems designed for special purposes,” he stated.

Simultaneous Interpreting Feature

In addition to the Google Translate upgrade, Google has announced that its new Pixel 10 phones can now translate telephone conversations in real time using each speaker’s voice and intonation. 

Sophia Williams, Product Marketing Manager at Google, said, “Now, you can have a conversation in Spanish, Japanese, Hindi and more. And Pixel handles the translation entirely on device, so your phone conversations are going to stay private.”

Users with early access to the Pixel 10 have already tested the simultaneous translation feature.

According to Sundar Pichai, CEO at Google, “people use Google to translate around 1 trillion words.” With Google’s latest releases, the company aims to break down language barriers using its Gemini models.

Google’s Pixel 10 is available worldwide from August 28. The company’s upgraded Google Translate feature is available this week for users in the U.S., India, and Mexico.

Check out our latest updates on Language AI and Speech & Voice.