Google Assistant iOS app update coming this year, teases Duplex AI phone calls

Google has previewed some of the changes it will be making to the Google Assistant app for iOS at the Google I/O keynote address, including food delivery and smart home-related requests, and an experimental feature where the digital assistant makes calls to businesses on the user's behalf.

The Google Assistant will become a more visual tool than in its current state, with responses to queries providing bigger pictures and more imagery to the user. An on-stage demonstration querying about a singer provided the usual basic information, along with a large photograph of Camila Cabello, the subject of the query.

More control will also be provided when using the assistant with smart home appliances. When asked to cool down the living room, Google Assistant displayed a dial, allowing the user to more directly control the home's thermostat, with similar controls presumably offered for other types of device.

Google is also making it possible for users to order food and drinks for pickup and delivery through the assistant. An in-app menu of items served at specific restaurants can be requested, with items able to be ordered without needing to go into a specific app for that store.

The Food pickup and delivery function will initially work with DoorDash, Domino's, 7-Eleven, Panera Bread, Starbucks, Applebees, Just Eat, and Dunkin' Donuts.

Google is rolling out the changes to Google Assistant to Android users first, later this summer, followed by iOS later this year.

Another Assistant feature teased on stage is Google Duplex, which allows Assistant to make calls on behalf of the user to businesses. A request to Assistant to make an appointment at a store, such as a restaurant or a hair salon, will prompt a call to the business over the phone, with no further interaction required from the user.

Google CEO Sundar Pichai told attendees approximately sixty percent of small businesses do not offer an online booking system, but do take appointments over the phone.

In the demonstration calls, Google Duplex used different voices, asking to place an appointment and offering the business relevant details when required. To make the virtual assistant seem more realistic, it included a number of filler sounds, such as "umm" and "ah," while speaking or before responding, with the cadence of voice also varying when appropriate.

The technology will also help update Google's business listings for holiday hours and to update Google maps automatically, potentially helping others searching to see if the same business is open.

While not a full feature, Google bills Duplex as an experiment, and will be rolled out in the coming weeks, though it is unclear if this means to all Google Assistant users or just those on Android.

Latest Exclusives

Latest comparisons

30 Comments

KITA 6 Years · 402 comments

About 6 years ago

AppleInsider said:

In the demonstration calls, Google Duplex used different voices, asking to place an appointment and offering the business relevant details when required. To make the virtual assistant seem more realistic, it included a number of filler sounds, such as "umm" and "ah," while speaking or before responding, with the cadence of voice also varying when appropriate.

That's really impressive.

randominternetperson 8 Years · 3101 comments

KITA said:

AppleInsider said:

In the demonstration calls, Google Duplex used different voices, asking to place an appointment and offering the business relevant details when required. To make the virtual assistant seem more realistic, it included a number of filler sounds, such as "umm" and "ah," while speaking or before responding, with the cadence of voice also varying when appropriate.

That's really impressive.

If that actually works that would be a "killer app" for me, making these devices start to be real "assistants." If I could say "Hey Siri make a dentist appointment for some time in the next two or three weeks" and the phone has a conversation with a real person and together they find a reasonable time on my calendar, that would be great. It's hard to believe that we're getting close to that, but perhaps we are.

(Actually, try saying that to your iPhone now. The results aren't terrible.)

franklinjackcon 10 Years · 612 comments

Oh this is what I've been dreaming of but didn't expect it would happen so soon. I get massive anxiety making phone calls because half the time they work out fine and half the time I hang up not knowing if I've made the right appointment or not (I live in a country where my grasp of the local language isn't perfect and have turned up to appoints on wrong days before or struggled with technical requests). A pity this'll probably take years before it rolls out into multiple languages. Or maybe not, better I keep trying. I recall Depp Mind was experimenting with creating voices from scratch and making them more realistic by adding in umms and ahhs. I guess this is one of the reasons for it. Nobody wants to talk to the standard Google Assistant but if there are dozens of voices, it'll go more smoothly.

eightzero 14 Years · 3148 comments

randominternetperson said:

KITA said:

AppleInsider said:

In the demonstration calls, Google Duplex used different voices, asking to place an appointment and offering the business relevant details when required. To make the virtual assistant seem more realistic, it included a number of filler sounds, such as "umm" and "ah," while speaking or before responding, with the cadence of voice also varying when appropriate.

That's really impressive.

If that actually works that would be a "killer app" for me, making these devices start to be real "assistants." If I could say "Hey Siri make a dentist appointment for some time in the next two or three weeks" and the phone has a conversation with a real person and together they find a reasonable time on my calendar, that would be great. It's hard to believe that we're getting close to that, but perhaps we are.

(Actually, try saying that to your iPhone now. The results aren't terrible.)

You said it. That's an assistant. It is about time someone fought back against these phone-hell systems. "Press 1 for this" etc. I always just lean on zero and # to see if it kicks me out to a live person. An app that robo-calls on your behalf would be killer.

I've called dentists that then wanted to send me emails and texts with documents they want me to fill out. I refuse. That's their job. I'll provide information, but I am not their typist. Have an app that says, "I've called you with information you will need. Press 1 to hear my contact information. Press 2 to be connected directly to me." When they press 2, I get a call back.

Nifty.

avon b7 20 Years · 8046 comments

franklinjackcon said:

Oh this is what I've been dreaming of but didn't expect it would happen so soon. I get massive anxiety making phone calls because half the time they work out fine and half the time I hang up not knowing if I've made the right appointment or not (I live in a country where my grasp of the local language isn't perfect and have turned up to appoints on wrong days before or struggled with technical requests). A pity this'll probably take years before it rolls out into multiple languages. Or maybe not, better I keep trying. I recall Depp Mind was experimenting with creating voices from scratch and making them more realistic by adding in umms and ahhs. I guess this is one of the reasons for it. Nobody wants to talk to the standard Google Assistant but if there are dozens of voices, it'll go more smoothly.

Just a quick note of support and understanding. There are few things that seem as unimportant but are actually totally nerve-racking as making a telephone call in a language you are not fluent in.

I can laugh at some of my failed attempts now (many of them worthy of a place in the script of Fawlty Towers) but they were definitely scary moments. I know how it feels.

Keep at it and try not to let mistakes get the better of you. Things in language never get worse and if you are living in the country of your non-native language, you will eventually be able to look back and laugh at your mistakes.

I spent more than three months trying to find my contact lens liquids in Barcelona but without 'condoms' in them!

Hopefully, if this Google idea works out you'll use it as a convenience and not a necessity.