×
You will be redirected back to your article in seconds

The Biggest News at Google I/O: Google Wants to Augment Everything

Google shared a lot of news at its Google I/O developer conference this week, ranging from a new version of Android that emphasizes digital wellbeing and new Android TV devices to a relaunch of Google News and artificial intelligence passing as humans in phone conversations.

But the biggest story of the event was Google’s advances in the field of computer vision and augmented reality.

Those advances flew a bit more below the radar, perhaps because they were scattered across a number of announcements and initiatives. But taken together, they showed that Google is getting ready to augment everything, and bring layers of information, games, and more to the space around us — all with the help of our phone cameras.

One of those examples: Google has been looking to bring computer-vision-based navigation to Google Maps. In the near future, consumers could be able to open the camera view of their phone from within Maps, point it at a street corner, and get instant directions on where to go. “Our teams have been working really hard to combine the power of the camera, the computer vision, with Street View and Maps to reimagine walking navigation,” said Google Lens vice president Aparna Chennapragada Tuesday.

Google is also expanding Lens, a feature it first introduced at Google I/O 2017, which adds computer vision smarts to the camera to identify dogs, buildings, plants, and other objects. After previously integrating Lens into Google Photos, the company is now bringing this feature directly to the camera app on a number of Android phones.

Popular on Variety

Thanks to new features being added to Lens, users of these phones will be able to just point their camera at documents and instantly select text any printed text. “You can do things like copy and paste from the real world directly into your phone,” said Chennapragada. Lens will also get better at identifying distinct objects, like books and posters.

CREDIT: Courtesy of Google

And over time, Google even wants to overlay pieces of information directly over those identified objects – including music videos over concert posters. “This is an example of how the camera is not just answering questions, but it is putting the answers right where the questions are,” she said.

CREDIT: Courtesy of Google

Google is also making its Google Photos service smarter, giving it the ability to automatically recognize when you take the picture of a document, and then convert it into a PDF file — something that got cheers from the audience Tuesday.

And finally, Google is expanding its efforts in the mobile augmented reality space. Google unveiled ARCore as its answer to ARKit last summer. The AR developer framework was at first limited to select Google devices and apps, but the company started to make it available to many millions of Android phones, as well as the wider developer community, in February.

On Wednesday, Google engineering manager Eitan Marder-Eppstein outlined a number of new additions to ARCore, including the ability for developers to build multiplayer AR experiences that can be shared across devices. This makes it possible to, for instance, play an AR Tic-Tac-Toe game, with one player using an iPhone and another using an Android phone.

Google’s AR technology also now allows developers to utilize augmented images. This could enable consumers to hold their camera up to a book cover or another physical product, and then have characters step out of that product and march around on your coffee table. “Imagine a textbook coming to life in front of you,” said Marder-Eppstein.

Another obvious application for these AR images is advertising, which could be a big draw for magazine publishers and other media companies. Said Marder-Eppstein: “Advertising is all about engagements.” And what’s more engaging than ads coming to life in the middle of your living room?

All of these announcements may have been disjointed examples of what Google is doing in the computer vision space, but they were tied together by combining cellphone cameras with artificial intelligence, and they laid a blueprint for a world in which visual objects offer cues to whole new layers of information.

It’s a change that is very profound, even if AR games and ads may seem playful and silly at first. Said Chennapragada: “Vision is a fundamental shift in computing for us.” It’s a shift that is not lost on other tech companies, which is why Facebook, Apple, and Snap are all busy exploring augmented reality and similar technologies as well.

But this week, Google outlined that it has a very far-reaching goal for this space: The company wants to augment everything, and turn your phone camera into a tool to browse the world.

More Digital

  • Baby Yoda The Mandalorian

    Disney Plus Set for Earlier Launch in U.K. & Western Europe

    The Walt Disney Co. has set March 24 as the new launch date for Disney Plus in the U.K. and other key markets across Western Europe. With the roll-out previously set for March 31, the streaming service will now be available a week earlier in the U.K., Ireland, France, Germany, Italy, Spain, Austria and Switzerland. Pricing [...]

  • Medici TV Show

    Vuulr Online Rights Market Makes Global Expansion at NATPE

    Singapore-based Vuulr, an online content marketplace for film and TV rights, is expanding from regional to global operations. The move was announced ahead of NATPE, one of the oldest face-to-face TV rights markets, this week launching its tenth edition in Miami, Florida (Jan 21-23). The Vuulr platform is free to use for buyers and for [...]

  • Loic Barche on Short 'The Atomic

    Loic Barche on Short 'The Atomic Adventure,' Upcoming Feature Debut 'Feu de Paille'

    “The Atomic Adventure,” a contender in UniFrance’s online MyFrenchFilmFestival, is the third short from Loïc Barché (“Goliath,” “Le Commencement”). Variety talked to the director about the short, and his feature debut “Feu de Paille.” “The Atomic Adventure,” produced by young French outfits Punchline Cinéma and Leonis Productions, is set in 1961 in Algeria, where France [...]

  • The Isle of the Dead

    UniFrance Puts Spotlight on Emerging French VR Sector at Rendez-Vous

    France has a burgeoning eco-system of virtual reality and augmented reality producers, and is one of Europe’s leading VR/AR hubs. The UniFrance Rendez-Vous with French Cinema in Paris, a showcase of French projects that wraps Monday, included a VR/AR showcase, with recent projects demonstrated by Wide Management VR, VRrOOm and Atlas V. UniFrance’s online MyFrenchFilm [...]

  • Blood Oath

    MBC Studios to Launch Arabic TV Series 'Blood Oath,' Written by Britain's Tony Jordan

    MBC Studios, the Saudi-owned production unit of top Middle Eastern free-to-air satellite network MBC Group is set to launch “Blood Oath,” an Arabic crime series written by Britain’s Tony Jordan (“EastEnders,” “Life on Mars”). The announcement comes as Dubai-based MBC Studios, set up in 2018 and headed by former president of NBCUniversal International Peter Smith, is [...]

  • Spirited Away

    Netflix Secures International Rights to Studio Ghibli Animated Films

    The iconic animated features of Japan’s Studio Ghibli will be available in territories outside the U.S., Canada and Japan on Netflix starting in February. The move is a further change of position for the studio which has repeatedly resisted the idea that its beloved cartoons would be released on digital platforms. Netflix, sales agent Wild [...]

  • ‘Drag Race’ Producers Greenlight Two Docu-Series

    ‘RuPaul’s Drag Race’ Producers Greenlight Two Docu-Series for SVOD (EXCLUSIVE)

    “RuPaul’s Drag Race” producer World of Wonder has greenlit two docu-series: “God Shave the Queens!” and an “Untitled Trinity Taylor Pageant Project.” The announcement will be made Sunday at the first-ever DragCon U.K. convention, which is taking place at Olympia, London. “God Shave the Queens!” features the first-ever cast of “RuPaul’s Drag Race UK” and [...]

More From Our Brands

Access exclusive content