×

Disney’s Latest Research Project Can Turn Scripts Into Virtual Reality

Disney Research has been working on a way to turn natural language scripts into virtual reality (VR) pre-visualizations. While currently focusing on VR story creation, the tool could ultimately be used for traditional filmmaking as well, said Disney Research digital platforms group lead Sasha Schriber during a talk at the Virtual Reality Developers Conference (VRDC) in San Francisco Monday.

Pre-visualizations, rough draft animations that give directors an idea of how their characters behave in a space, and how changes to the script might affect the scene, are a key step in movie-making. But previs, as it’s also called in the industry, can take time. “This is a very lengthy process,” said Schriber about both previs and storyboarding. “Some animation films take sometimes up to two years to finalize the story.”

Disney Research’s Project Cardinal wants to speed up that process by automatically turning scripts into storyboards and then previs films. “It goes from script to storyboard to animation in real-time,” said Schriber.

Disney Research VR Previz

Popular on Variety

Project Cardinal’s software can ingest scripts and turn them into simple animations, which can then be manually manipulated by filmmakers. Creatives can also integrate voice recordings on the spot, and then preview scenes directly in VR while wearing a headset, giving a vantage point that’s similar to being on scene with the actors of a movie.

Characters can even be moved around from within a headset, and Disney’s researchers ultimately want to add the ability to do more advanced editing directly in VR as well.

Cardinal is currently being tested with a handful of VR filmmakers, but Schriber readily admitted that there is still a lot of work to be done. For one thing, natural language processing has proven to be challenging. “Each script writer writes in his or her own way,” she said.

That’s why Disney Research has developed a simplified markup language for scripts, and is currently advising writers to streamline their work to make it easier for computers to understand, for example by sticking to the present tense.

However, Schriber said that ultimately, Disney Research was looking to turn Cardinal into a more potent tool, which also includes potentially making it available outside of the world of VR filmmakers. Her group had already shown Cardinal to traditional filmmakers, she said: “They asked us: what about us?”

More Digital

  • Aaron Pedersen (as Jay) & Jada

    Screen Australia Leads Call for Evolution of Industry Funding

    Screen Australia, the country’s federal support body, says the screen entertainment industry needs to come up with new business models in response to changes in audience behavior and the disruptive impact on content financing that has come from streaming. Public support bodies must change their relationships with the industry too, Screen Australia CEO Graeme Mason [...]

  • A-ha!

    'A-ha: The Movie' on 'Take on Me' Band to Receive Worldwide Release (EXCLUSIVE)

    A feature documentary on Norwegian “Take On Me” singers A-ha will receive a worldwide release this November. “A-ha: The Movie,” distributed internationally by Esther van Messel’s First Hand Films, will be broadcast in theaters around the world on Nov. 26, with Germany’s Salzgeber releasing the film locally and First Hand Films handling the release in [...]

  • Vudu

    NBCUniversal in Talks to Buy Walmart's Vudu

    Comcast’s NBCUniversal is looking to add some Vudu into its streaming-video mix. The media conglomerate is in talks to buy Vudu, the Walmart-owned entertainment rental, download and free-streaming service, sources confirm to Variety. It’s unclear what the terms of the pact would be or the timing. News of NBCU’s interest in Vudu was first reported [...]

  • Tubi

    Fox in Talks to Acquire Free-Streaming Service Tubi for Over $500 Million (Report)

    Fox Corp. is in discussions about acquiring Tubi, the ad-supported free streaming service, in a deal worth more than $500 million, according to a Wall Street Journal report citing anonymous sources. With Tubi, Rupert Murdoch’s TV broadcasting and cable company would be adding a dedicated streaming component — offering over 20,000 older TV shows and [...]

  • Zombies 2 Disney Channel

    How Disney Channel's 'Zombies 2' Production Team Made Monsters Kid-Friendly

    Traditionally spooky creatures like zombies and werewolves get the Disney treatment in “Zombies 2,” the follow-up to the 2018 hit TV-movie musical of the same name. While the undead have now assimilated into the community of Seabrook, they’re confronted by a new set of outsiders: werewolves. Milo Manheim and Meg Donnelly return as Zed and [...]

  • Baby Yoda - The Child Animatronic

    Hasbro's Adorable Baby Yoda Animatronic Toy Is Already Sold Out on Disney's Online Store

    The Force remains strong for toys based on Baby Yoda, the breakout star of Disney Plus original series “The Mandalorian.” Less than a day after becoming available for pre-order, Hasbro’s new $59.99 Baby Yoda animatronic toy is no longer available on Disney’s official online store: As of Friday morning, Shop Disney listed it as “sold [...]

More From Our Brands

Access exclusive content