×

Disney’s Latest Research Project Can Turn Scripts Into Virtual Reality

Disney Research has been working on a way to turn natural language scripts into virtual reality (VR) pre-visualizations. While currently focusing on VR story creation, the tool could ultimately be used for traditional filmmaking as well, said Disney Research digital platforms group lead Sasha Schriber during a talk at the Virtual Reality Developers Conference (VRDC) in San Francisco Monday.

Pre-visualizations, rough draft animations that give directors an idea of how their characters behave in a space, and how changes to the script might affect the scene, are a key step in movie-making. But previs, as it’s also called in the industry, can take time. “This is a very lengthy process,” said Schriber about both previs and storyboarding. “Some animation films take sometimes up to two years to finalize the story.”

Disney Research’s Project Cardinal wants to speed up that process by automatically turning scripts into storyboards and then previs films. “It goes from script to storyboard to animation in real-time,” said Schriber.

Disney Research VR Previz

Project Cardinal’s software can ingest scripts and turn them into simple animations, which can then be manually manipulated by filmmakers. Creatives can also integrate voice recordings on the spot, and then preview scenes directly in VR while wearing a headset, giving a vantage point that’s similar to being on scene with the actors of a movie.

Characters can even be moved around from within a headset, and Disney’s researchers ultimately want to add the ability to do more advanced editing directly in VR as well.

Cardinal is currently being tested with a handful of VR filmmakers, but Schriber readily admitted that there is still a lot of work to be done. For one thing, natural language processing has proven to be challenging. “Each script writer writes in his or her own way,” she said.

That’s why Disney Research has developed a simplified markup language for scripts, and is currently advising writers to streamline their work to make it easier for computers to understand, for example by sticking to the present tense.

However, Schriber said that ultimately, Disney Research was looking to turn Cardinal into a more potent tool, which also includes potentially making it available outside of the world of VR filmmakers. Her group had already shown Cardinal to traditional filmmakers, she said: “They asked us: what about us?”

More Digital

  • Nigeria’s Kunle Afolayan: African Audiences Shouldn’t

    Nigeria’s Kunle Afolayan: African Audiences Shouldn’t Be ‘Second-Class’

    DURBAN–A young boy from a middle-class home gets an unconventional schooling in the ways of the world when he’s forced to apprentice at a mechanic’s workshop in a rough-and-tumble section of Lagos. “Mokalik” is the latest feature from Kunle Afolayan, a leading figure in the wave of filmmakers revitalizing the Nigerian film industry. The film [...]

  • SAG-AFTRA HQ

    SAG-AFTRA Ends Long Strike Against Ad Agency Bartle Bogle Hegarty

    SAG-AFTRA has ended its 10-month strike against Bartle Bogle Hegarty after the advertising agency agreed to sign the union’s new commercials contract. The union instructed its 160,000 members in September not to accept any work for BBH, which had been signed to SAG-AFTRA’s commercials contracts since 1999. The strike came two weeks after BBH publicly [...]

  • FaceApp is displayed on an iPhone,

    SAG-AFTRA Warns Members About FaceApp Terms of Use

    SAG-AFTRA is warning its 160,000 members about the “overreaching and invasive” terms of use for the FaceApp mobile application. FaceApp, developed by Russian company Wireless Lab, uses neural network technology to automatically generate transformations of faces in photographs. The app can be used to make users appear older, younger, or change gender. The terms include [...]

  • J. Cole

    Apple Music Launches 'Rap Life' Playlist

    Apple Music announced the launch of “Rap Life,” a new global playlist focusing on contemporary rap artists and culture. It replaces the former “The A-List: Hip-Hop” playlist. Said Ebro Darden, Apple Music’s Global Editorial Head of Hip-Hop and R&B: “We flipped it to dig deeper into into the lifestyle [and to] keep pushing the culture [...]

  • Billie Eilish

    ARRI, Mobile TV Group Back New Venture Revitalizing Streamed Concerts

    A new venture looking to bring a fresh approach to live-streaming concerts has gotten the backing of hardware heavyweights ARRI and Mobile TV Group. Wide+Close is launching with the mandate of shooting music performances with film cameras and cinematographers in order to give the content a more cinematic feel. “We want to take concert filming [...]

  • Fortnite Battle Royale

    How 'Fortnite' Fans Can Earn Loot by Watching YouTube Videos

    Epic Games and YouTube have teamed up with a special offer for “Fortnite” players — giving players of the popular battle-royale game rewards when they watch “Fortnite”-premiered content on the video platform. The catch: You have to watch at least 20 minutes of “Fortnite” special content or live esports broadcasts to receive the loot. Under [...]

  • Roku headquarters

    Roku Plans to Expand to Brazil, Other Countries (EXCLUSIVE)

    Roku plans to expand to multiple new territories in the coming months, Variety has learned. One of the first new markets for the company will likely be Brazil. An international expansion could help Roku grow its customer base, which in turn should lead to growing advertising revenues. Roku executives have been hinting at plans to [...]

More From Our Brands

Access exclusive content