Microsoft’s Next HoloLens Headset Will Come With Built-in Artificial Intelligence

Count Microsoft among the companies preparing to build specialized chips for artificial intelligence (AI): The next version of the company’s HoloLens augmented reality headset will come with a chip capable of complex AI computation, revealed Microsoft Research VP Harryn Shum at a computer vision conference Sunday. This will make it possible to improve hand tracking on the device, as well as run object recognition and other computer vision tasks.

Cloud-based server farms are getting very good at using artificial intelligence for advanced image recognition, something that Google and Facebook use to recognize persons and even objects in images uploaded to their services. But for HoloLens to work without delays, tasks like these have to be solved locally — which is why the company is putting AI straight into the headset itself.

“We’re in the business of making untethered mixed reality devices,” explained HoloLens director of science Marc Pollefeys in a blog post. “We put the battery on your head, in addition to the compute, the sensors, and the display.”

The current version of HoloLens already features a custom processor, dubbed the Holographic Processing Unit, that makes use of all of the device’s sensor data of features like head tracking. The next version of this chip will incorporate an artificial intelligence co-processor, Shum said.

Microsoft isn’t the only company building custom chips for AI and similar tasks. Apple has long been building its own chips for the iPhone and the iPad, and is increasingly optimizing them for on-device image recognition tasks. And Google recently hired one of Apple’s key chip architects to build custom chips for its own phones, which will likely incorporate machine learning as well.

More Digital

  • Lyor Cohen

    South By Southwest: YouTube's Lyor Cohen Set to Keynote

    Count Microsoft among the companies preparing to build specialized chips for artificial intelligence (AI): The next version of the company’s HoloLens augmented reality headset will come with a chip capable of complex AI computation, revealed Microsoft Research VP Harryn Shum at a computer vision conference Sunday. This will make it possible to improve hand tracking […]

  • I Love You, Daddy

    Louis C.K.'s 'I Love You, Daddy' Leaks Online After Being Pulled From Theatrical Release

    Count Microsoft among the companies preparing to build specialized chips for artificial intelligence (AI): The next version of the company’s HoloLens augmented reality headset will come with a chip capable of complex AI computation, revealed Microsoft Research VP Harryn Shum at a computer vision conference Sunday. This will make it possible to improve hand tracking […]

  • Ajit Pai net neutrality

    Hundreds of Musicians -- From R.E.M. to Turnip King -- Sign Statement Defending Net Neutrality

    Count Microsoft among the companies preparing to build specialized chips for artificial intelligence (AI): The next version of the company’s HoloLens augmented reality headset will come with a chip capable of complex AI computation, revealed Microsoft Research VP Harryn Shum at a computer vision conference Sunday. This will make it possible to improve hand tracking […]

  • Apple - Philip Matthys and Jennifer

    Apple Raids Hulu, Legendary to Fill Business Affairs Posts on Content Team (EXCLUSIVE)

    Count Microsoft among the companies preparing to build specialized chips for artificial intelligence (AI): The next version of the company’s HoloLens augmented reality headset will come with a chip capable of complex AI computation, revealed Microsoft Research VP Harryn Shum at a computer vision conference Sunday. This will make it possible to improve hand tracking […]

  • AR Studio Open Beta_Partner Effects

    'Star Wars' Stickers and World Filters: Facebook and Google Are Trying to Catch Up on AR

    Count Microsoft among the companies preparing to build specialized chips for artificial intelligence (AI): The next version of the company’s HoloLens augmented reality headset will come with a chip capable of complex AI computation, revealed Microsoft Research VP Harryn Shum at a computer vision conference Sunday. This will make it possible to improve hand tracking […]

  • JUMANJI- WELCOME TO THE JUNGLE

    ‘Jumanji: Welcome to the Jungle’ Tops Studios’ TV Ad Spending

    Count Microsoft among the companies preparing to build specialized chips for artificial intelligence (AI): The next version of the company’s HoloLens augmented reality headset will come with a chip capable of complex AI computation, revealed Microsoft Research VP Harryn Shum at a computer vision conference Sunday. This will make it possible to improve hand tracking […]

  • CW - EA MADDEN NFL 18

    CW, EA Team on 'Madden NFL 18' eSports 'Survivor'-Style Special for TV

    Count Microsoft among the companies preparing to build specialized chips for artificial intelligence (AI): The next version of the company’s HoloLens augmented reality headset will come with a chip capable of complex AI computation, revealed Microsoft Research VP Harryn Shum at a computer vision conference Sunday. This will make it possible to improve hand tracking […]

More From Our Brands

Access exclusive content