×

A Sense of Wonder: How Within Is Evolving Storytelling in Augmented Reality

The future of storytelling is happening all around us — we just have to look through the right lens to see it. That’s the idea behind “Wonderscope,” an augmented reality app for children that Los Angeles-based immersive media start-up Within is set to release in November.

“Wonderscope” uses mobile AR to superimpose characters, scenes and stories onto an iPad’s camera view of a user’s living room carpet or a kid’s bedspread. “A device that everyone carries around in their pocket every day suddenly has this new magical ability,” explains Within CEO Chris Milk. “It’s like a lens for invisible magical things that you couldn’t see with your naked eye.”

A version of this story first appeared in the November 6 issue of Variety.

One of the first stories to be released as part of “Wonderscope” is titled “Little Red the Inventor,” a modern twist on the classic fairy tale “Little Red Riding Hood.” Not only is Red in Within’s version devoted to science and engineering, but she’s also facing off against a wolf that Milk describes as a #MeToo-like villain. In the end, Red persists with the help of her friend, the viewer, who communicates with her via speech-recognition technology.

CREDIT: Courtesy of Wonderscope from WITHIN

From “A Brief History of Stunts by Astounding People,” an AR story that will debut on Within’s “Wonderscope” app later this month.

AR-based stories can be a significant change from other screen-based media, argues Within CTO Aaron Koblin. “Parents love the idea that their kids aren’t sitting there vegged out,” he says. “They’re actually engaged and moving around, they’re reading out loud. It’s a way more active experience, which we’re really excited about.”

For Milk, this also made the project deeply personal. “In some ways, I’m making the product that I wish I had when I was 7,” he recalls. “7-year-old me was a dyslexic kid that had a lot of trouble reading. I would really have loved to have something like this in my life, where I was active in a conversation with a character.”

CREDIT: Courtesy of Wonderscope from WITHIN

Stills taken from “A Brief History of Stunts by Astounding People,” an AR story that will debut on Within’s “Wonderscope” app later this month.

Within is just the latest start-up to embrace mobile-based AR, which Apple first introduced with the release of its iOS 11 mobile operating system about a year ago. Google followed suit with its own take on the technology for Android-based phones a few months later. Together, the two companies now have hundreds of millions of mobile devices that are AR-enabled.

The future of AR is already lurking around the corner: Two months ago, Florida-based hardware startup Magic Leap began to ship a developer version of its AR headset, which combines a view of the real world with digital objects. Apple and other tech companies are said to have their own AR glasses in the works as well.

But while mobile AR has been available for a little over a year, it’s taken some time for creatives to explore the full potential of the medium. An initial slate of apps largely offered up short-lived gimmicks that didn’t satisfy consumers.

CREDIT: Courtesy of App Annie

The popularity of AR apps, according to App Annie.

Downloads of AR iOS apps spiked in December 2017, and have since leveled off, according to mobile analytics specialist App Annie. In July 2018, users downloaded some 1.25 million copies of the top 500 AR iPhone apps. “To put that in context, there were over 500 million iPhone downloads in the U.S. alone during that month,” says App Annie senior market insights analyst Lexi Sydow.

Milk, who previously directed music videos for artists like U2 and Kanye West, isn’t worried about those trends. “It always takes a while to figure it out,” he says. “In the beginning of cinema, you’d put a penny into a machine to watch a dancing bear for 15 seconds. The first stabs at a medium feel more like novelties than complete stories.”

Part of the challenge for creatives is to figure out how to tell compelling tales in this new medium without leaving the viewer overwhelmed, says Magic Leap chief content officer Rio Caraeff. “Sparse digital content is better than lots of digital content,” he advises. “If the entire physical world is overwhelmed with digital stuff, that can overwhelm my cognitive load.”

Magic Leap interaction director Aleissia Laidacker echoes this notion: “We are always saying: less is more.” At the same time, she readily admits that creating content for AR is still very much an unknown territory. “We actually don’t know all the best practices yet.”

CREDIT: Courtesy of Wonderscope from WITHIN

AR needs to work in a wide variety of contexts: Stills taken from “A Brief History of Stunts by Astounding People,” an AR story that will debut on Within’s “Wonderscope” app later this month.

One of the problems of AR content creation: Developers don’t know in which contexts and environments viewers will use their apps. “You have to build a story that can work in someone’s kitchen, in someone’s backyard, next to someone’s pool,” says Milk. Caraeff agrees: “As a developer, you don’t control what anybody’s home looks like. So you have to embrace ambiguity and uncertainty.”

The same could be said for developing immersive media apps in general. A little over two years ago, start-ups and studios alike jumped headfirst into virtual reality as the future of storytelling. With headset sales lagging, some have since reversed course.

Disney-backed Jaunt, which at one time aimed to be the leader in cinematic VR, announced two weeks ago that it was laying off its entire VR staff to focus solely on AR. Imax closed some of its VR Centers and is reevaluating its commitment to the space, and Google is also said to be prioritizing AR over VR.

Does this make AR the next VR? “We don’t think that this is a one-versus-the-other type situation,” says Within chief operating officer Colin Decker, who previously worked as GM for Discovery Digital and COO of Crunchyroll. “VR disappointed anyone who had an irrational view of what it was going to be in an irrationally short time,” he says. “We think that both AR and VR hold great promise and great potential.”

Popular on Variety

More Digital

  • Mark Zuckerberg

    Zuckerberg Defends Facebook's Approach to Free Speech, Says Politicians Will Be Allowed to Lie

    Facebook CEO Mark Zuckerberg went to Georgetown University Thursday to explain his views on freedom of expression, and how it influenced Facebook’s policies around dealing with controversial subjects, including political ads that include outright lies. “I’ve focused on building services to do two things: give people voice, and bring people together,” Zuckerberg said. In his [...]

  • Kids' Programming Will Be a Battleground

    Why Kids' Programming Will Be a Major Battleground in the Streaming Wars

    When “Moana” left Netflix on Dec. 20, parents of little kids let out a collective wail of despair on Twitter and Facebook parenting groups everywhere. The phrase “ruined Christmas” was pointedly used in the streamer’s direction — sometimes facetiously, sometimes with the reflected ire of a preschooler who had awakened one morning to find her [...]

  • Nvidia Shield leak

    Nvidia Shield 2019 Model Leaks on Amazon

    The latest version of Nvidia’s Android TV streamer has found its way onto Amazon.com ahead of an official announcement. The new device features a more powerful processor as well as a new remote control. Nvidia didn’t immediately respond to a request for comment. The latest Nvidia Shield is being powered by a Tegra X1+ processor, [...]

  • Star Wars Jedi Fallen Order

    'Star Wars Jedi: Fallen Order': Respawn CEO on Telling the Story Behind 'Becoming a Jedi'

    When it comes to media properties, it doesn’t get much bigger than “Star Wars.” That sentiment certainly isn’t lost on Vince Zampella, CEO of Respawn Entertainment, the studio behind “Star Wars Jedi: Fallen Order.” The title, which follows Jedi Padawan Cal Kestis (voiced by Cameron Monaghan) after the events of “Episode III — Revenge of [...]

  • Star Wars Jedi Fallen Order

    'Star Wars Jedi: Fallen Order': What to Expect From EA and Respawn's Latest

    There’s a lot riding on “Star Wars Jedi: Fallen Order.” The upcoming title from EA and Respawn is the first major single-player “Star Wars” video game since 2008’s “The Force Unleashed,” and is one of the most anticipated games of 2019. After years of multiplayer adventures, could “Fallen Order” be the title that brings the [...]

  • Katie Couric Olympics

    Katie Couric Plots 'SeeHer Stories' for People Magazine

    Katie Couric’s next assignment: Creating digital videos for People. Couric’s media company, Katie Couric Media is teaming with the Meredith-owned magazine to produce the weekly digital video series “#SeeHer Story,” that will feature short vignettes of female trailblazers and rulebreakers. The series is meant to celebrate the 100th anniversary of the 19th Amendment, which prohibits [...]

  • Wonderscope Willowcrest Manor

    Within Adds 'Willowcrest Manor' Ghost Story to Its Wonderscope AR App (EXCLUSIVE)

    Los Angeles-based immersive media startup Within added another augmented reality (AR) story to its children’s storytelling app Wonderscope Thursday: “Willowcrest Manor” gives kids a chance to become a ghost, haunt a house, and scare intruders away from hidden treasure. Wonderscope, which is available for most recent-generation iPads and iPhones, lets children explore animated stories in [...]

More From Our Brands

Access exclusive content