You will be redirected back to your article in seconds

Google’s Plan to Make Voice Control Work When All Devices Have Microphones

Are you talking to me?

Phones, cars, speakers and appliances: Google outlined ambitious plans to take voice assistance everywhere at its Google I/O developer conference in Mountain View, Calif. this week. But as the company is bringing voice input to potentially dozens of devices around your home and beyond, it also faces some interesting challenges unique to this new interaction model.

For instance: If all of your devices listen, how do they know which one you are talking to?

That problem isn’t a mere hypothetical anymore. Google announced this week that its assistant is already installed on over 100 million Android phones and Google Home speakers. The company also announced partnerships with 19 hardware manufacturers and chipset vendors to take its digital assistant beyond its Google Home speaker and mobile phones and launch it on stereo systems, cars and other consumer electronics devices, some of which will be available before the end of the year.

Google also launched an app for the assistant on iPhones, where it now directly competes with Apple’s Siri, and gave developers tools to bring the Google Assistant to their own devices and hardware hacks. “Speakers, toys, drink-mixing robots, whatever crazy devices all of you think up,” joked Assistant VP of Engineering Scott Huffmann with his audience of developers at the conference Wednesday.

All of these devices will by design answer to the same so-called hot word — “Okay Google” — to jump into action and answer your questions and demands. So how will they know which one should respond?

The solution to this problem is to treat voice assistance like a conversation, explained Google Assistant Product Lead Gummi Hafsteinsson during an interview with Variety. As technology prompts users to be more conversational, it also has to get better at participating in these conversations like humans would.

When people talk to each other in a group setting, they don’t address each other by name all the time. Instead, we use more subtle cues like eye contact, body language and even personal history to figure out who is talking to whom.

Google’s vision for its digital assistant also comes without first names. Instead, you just say “Okay Google,” and the assistant comes to life on phones, Google Homes and other devices. And increasingly, those devices also use cues to figure out whose turn it is to respond to your commands.

Google already uses the sensors of your phone for that very purpose, said Hafsteinsson. If the phone is in your hand, chances are you want it to respond. If it has been resting on your desk, you may be talking to your Google Home instead.

On the other hand, if you ask Google’s Assistant to send a text message, you are likely addressing your phone, and not the smart speaker in your kitchen. And a request for a Bloody Mary is probably best answered by that (still hypothetical) drink-mixing robot. “It uses context,” Hafsteinsson said about the Assistant’s attempts to answer your requests with the right device.

The ultimate goal was to let users seamlessly switch between different input devices simply by analyzing their intent, and the context of their requests, he said. “As you move through different contexts throughout the day, you will be able to continue the same conversation.”

More Digital

  • YouTube logo

    YouTube Denies Report That It's Exiting Scripted Dramas, Comedies

    YouTube claims it is not pulling up stakes from original entertainment — denying a report by Bloomberg over the weekend that the Google-owned video service was cancelling plans for “high-end dramas and comedies” and had stopped taking pitches for “expensive” scripted shows. In a statement, a rep said, “YouTube denies the report” and cited its [...]

  • Apple to Launch New Apple TV

    This Is What Apple's New TV Service Will Actually Look Like

    Apple unveiled its much-anticipated video service at a press event in Cupertino Monday, promising a range of originals via its forthcoming Apple TV+ service as well as easy access to third-party video subscription services. But while many of the big names attached to Apple’s video efforts were known beforehand, one significant detail wasn’t: How are [...]

  • Apple Announces Gaming Subscription Service

    Apple Announces Gaming Subscription Service Apple Arcade

    Apple detailed its long-rumored gaming subscription service during a special event it held in Cupertino, California Monday. Apple Arcade is the world’s first game subscription service for mobile, desktop and living room, the company said. With a single subscription, you get access to more than 100 new and exclusive games. The games won’t be on [...]

  • Apple News Announcement

    Apple Unveils $9.99 News Subscription Service Dubbed Apple News+

    Apple unveiled a news subscription service called Apple News+ at its services event in Cupertino, Calif. Monday. The $9.99 service gives paying subscribers access to over 300 magazines as well as select newspapers and premium digital news services. “We believe in the power of journalism and the impact it will have on your lives,” said [...]

  • Katie Drummond - Vice Digital

    Vice Names Katie Drummond Senior VP of Digital

    Katie Drummond, who has worked as an editor in digital media and publishing for a decade, joined Vice Media as senior vice president of Vice Digital. Drummond comes on board to take over many of the duties of Ciel Hunter, who left Vice in January as global head of content for Vice Digital after more [...]

  • Apple Event: How to Watch Live-Stream

    How to Live-Stream Today's Apple Event

    Monday is the coming-out party for Apple’s Hollywood ambitions: After years of trademark secrecy about its plans to stream into video entertainment, the tech giant is set to pull back the curtain at a media event. The live program kicks off at 10 a.m. PT / 1 p.m. ET, on Monday, March 25, from the [...]

  • Google Stadia Is a Net Neutrality

    Google Stadia Is a Net Neutrality Nightmare

    At the Game Developers Conference (GDC) this year, Google announced that it has taken up the long and ever-lengthening dream of the video game streaming service. Meant to replace the hefty, pricey, altogether confounding experience of buying and using various gaming hardware, Google Stadia will run video games on Google’s own hardware in a server [...]

More From Our Brands

Access exclusive content