Universal Speech Translator is basically Meta’s engineers trying to crack true speech-to-speech translation. How they explain it: “[…] we are designing novel approaches to translating from speech in one language to another in real time so we can support languages without a standard writing system as well as those that are both written and spoken.”
Meta AI said the two projects form part of “a long-term effort to build language and MT tools that will include most of the world’s languages.” Wow.
Slator Machine Translation Expert-in-the-Loop Report
60-page report on the interaction between human experts and AI in translation production, including AI-enabled workflows, adoption rates, postediting, pricing models.
Good news for machine translation (MT) since a long-term effort usually means long-term funds. And since Meta is pouring billions into its Metaverse, MT could very likely get a few hundred million.
More data points (e.g., more than 20% of the world isn’t covered by commercial translation technology) are to be found in the Meta AI blog. The names of the people working on the two projects are there too. You may recognize some of them (such as Kenneth Heafield, who talked on SlatorPod about speech-to-speech translation, among other things).