This Startup Wants to Help Build the Next Generation of Virtual Reality Headsets

“What you just witnessed is the future of virtual reality headsets,” Youssri Helmy said after demonstrating his company’s technology in San Francisco this week.

Helmy’s words may sound like hubris, but he could actually be right: Eonite Perception, the startup that Helmy co-founded together with Stanford computer vision experts Anna Petrovskaya and Peter Varvak in late 2015, and now leads as its CEO, is working on inside-out-tracking — a technology that will give VR headsets the ability to detect the position and movements of its users without the need for any external cameras and sensors.

“It’s actually a very human way of doing things,” Helmy said, likening inside-out tracking to the way a person’s perception works.

It’s also very different from the way existing VR headsets currently tackle this problem. Low-end headsets like Samsung’s Gear VR and Google’s Cardboard and Daydream don’t offer any positional tracking at all. The result: Users can look around in a VR space, but not change their point of view. Even something as simple as leaning forward can lead to a cognitive dissonance, because the VR game or app can’t translate the movement into an accurate change of position.

Higher-end and much more expensive headsets like the Oculus Rift and the HTC Vive make up for this shortcoming with positional tracking devices, which use technology like infrared and lasers to track the location and movements of a user in a room. In simple terms, both Rift and Vive use a kind of external camera setup for tracking. Installing those cameras can be tricky, and the amount of space one can use to play is defined by the location and number of tracking devices.

Eonite Perception wants to do away with such external trackers by integrating a depth sensor directly into the headset, and allow users to play or experience VR anywhere. It’s not a new idea — companies like Facebook and others have been working for years this, and Helmy said that there are a number of difficult challenges to overcome to get inside-out tracking to work. These include the cost of the solution, latency and the ability to detect even the smallest movements. “The accuracy has to be sub-millimeter,” he said.

Helmy’s company thinks it has cracked all of these challenges, and a demo given by the company in San Francisco this week was indeed impressive. Combining an off-the-shelf depth-sensing camera and a HTC Vive headset, Eonite was able to show off a simple game that made it possible to walk through a virtual room about the size of a regular hotel room, accurately tracking movements and positional changes.

There were a few caveats — the blinds of the room were closed shut, and some viewing angles made the sensor fail outright — but Helmy said that commercial solutions will be able to overcome any shortcomings of the prototype.

Eonite Perception officially announced the commercial availability of its Eonite Vantage head tracking solution Thursday, and Helmy said that we will see a new stationary VR headset from an unnamed manufacturer integrating the technology in the coming months. That solution will make it possible for consumers to scan their living room in less than 60 seconds, but also continuously update its internal mapping so users won’t accidentally step on their cat when it walks in the room while they use the headset.

For safety reasons like these alone, it’s clear that inside-out tracking will be a big deal — and Helmy believes that his company can help make it a reality. “I would be very surprised if two years from now, there is any outside-in tracking left,” he said.

Popular on Variety

More Digital

  • Gabrielle Carteris

    SAG-AFTRA Urges Gavin Newsom to Sign Law Punishing 'Deep Fake' Videos

    SAG-AFTRA National Executive Director David White is urging Gov. Gavin Newsom to sign legislation that institutes penalties for nonconsensual digital sexually explicit videos, also known as “deep fakes.” The legislation, Assembly Bill 602, targets companies and individuals who create and distribute the videos in California without the consent of the individual being depicted. “We urge Gov. [...]

  • Facebook Portal logo

    Facebook Is Launching a Portal TV Device: Here’s What We Know

    Facebook is getting ready to launch a TV streaming device in time for the holiday season, Variety has been able to confirm with multiple sources familiar with the company’s plans. The new streaming hardware will be part of the company’s Portal family of devices, featuring a camera, and combining video chatting with TV viewing and [...]

  • MoviePass card

    MoviePass Shuts Down, With Parent Company Citing Failure to Raise Funds

    MoviePass, the long-struggling theater subscription service, finally appears to be down for the count. On Friday, MoviePass notified remaining subscribers that it would be shutting down the service effective Sept. 14, 2019, because “its efforts to recapitalize MoviePass have not been successful to date,” parent company Helios and Matheson Analytics announced. “The company is continuing [...]

  • Disney Plus - Full Lineup

    How to Browse the Disney Plus Catalog the Company Is Testing in the Netherlands

    Disney began testing its Disney Plus streaming service in the Netherlands this week. Consumers in the U.S. will have to wait until November 12 to get access to the service, but European streaming aggregator JustWatch already makes it possible to browse the catalog available during this beta test. JustWatch is one of a number of [...]

  • JoJo Siwa'The Angry Birds Movie 2'

    Nickelodeon Star JoJo Siwa Gets Her Own Dance-Tour Mobile Game (EXCLUSIVE)

    Fans of JoJo Siwa will be able to join the teen influencer’s dance squad on stage — virtually — in a new mobile game. In “JoJo Siwa — Live to Dance,” players will become part of the Nickelodon and YouTube star’s worldwide tour on her professional dance team and experience what it’s like to be [...]

More From Our Brands

Access exclusive content