The new Translate app on iPadOS 15 includes a new Auto Translate feature, where conversations in two languages can be translated in real-time.
Apple is set to deliver a slew of translation features across its next-generation macOS, iPadOS, and iOS operating systems this year, including system-wide text translation, on-device languages, and a new Translate app for iPad. The new app will allow users to type or speak text and translate into multiple languages, but also adds a new Conversation mode.
Conversation mode is meant to be used by two people sitting side-by-side or across from each other, and displays what each person spoke with translation underneath. Paired with the new Auto translate feature, each person should be able to speak freely as the iPad recognizes the language and who is speaking. The translated conversation is voiced in the appropriate language automatically.
We tested the new Translate app in a live conversation from Spanish to English. At first the feature was inconsistent, but downloading the languages locally to the device greatly improved its accuracy.
Attempting the Auto Translate feature, we found the app would take a few moments to start listening to a speaker, and would cut the microphone too early. Moving to manually tapping the microphone icon for each speaker created a smoother experience.
When a person speaks, the Translate app displays a transcription in that language, and a text translation underneath. After a few seconds, the app then audibly speaks the translation. Using only one or two sentences at a time, and making sure to speak clearly provides for good overall experience.
Being the first developer beta of this software, it will most likely improve over the next few months. It's a promising feature, and as it improves could allow two people, speaking two different languages, to have a lengthy conversation in real-time.
Keep up with everything Apple in the weekly AppleInsider Podcast — and get a fast news update from AppleInsider Daily. Just say, "Hey, Siri," to your HomePod mini and ask for these podcasts, and our latest HomeKit Insider episode too. If you want an ad-free main AppleInsider Podcast experience, you can support the AppleInsider podcast by subscribing for $5 per month through Apple's Podcasts app, or via Patreon if you prefer any other podcast player. AppleInsider is also bringing you the best Apple-related deals for Amazon Prime Day 2021. There are bargains before, during, and even after Prime Day on June 21 and 22 — with every deal at your fingertips throughout the event.
5 Comments
Very cool! I look forward to the finished product. I hope the translation is just as strong for Asian languages as well, in particular, Japanese and Chinese.
You seemed very relaxed when your mom said she knows just one word in Korean - I'm glad she didn't let you down! You've got one of the good moms.
You have to press the button every time? I thought this implementation was more natural than that. Doesn't Apple Translate already allow you to do it this way?
Quick AI: you've got to recruit Stephen's mum onto the team, she's a natural!