You will be redirected back to your article in seconds

Computer as Auteur? IBM, Tribeca Contest Winner Imagines AI Auto-Generating Movie Previews Based on Scripts

Filmmakers, writers, musicians and other creative professionals have long used technology in their work. But can machines produce a kind of intelligence that helps storytellers at a deeper creative level?

That’s the premise of the IBM-sponsored “Storytellers With Watson” competition, launched in partnership with the Tribeca Film Festival. Over the last two months, the contest solicited and reviewed submissions about how media and entertainment pros can use artificial intelligence in new ways.

On Tuesday, after an all-day session at IBM’s Think Lab in New York culminating in “Shark Tank”-style pitches, the IBM and Tribeca jury selected a winner from five finalists: filmmaker and producer Seth Grossman and his “Rip-o-matic With Watson” (pictured above), which recognizes meaning in images and language for video editing to — in theory — automatically generate a sizzle-reel preview of a movie or TV pilot based on the script.

Grossman’s idea: to use AI to analyze, index and splice together “rips” from videos that represent a filmmaker’s vision. By recognizing information in images as well as finding and classifying their meaning in sets of written information, Watson would find and splice together the content that best matches the script, including specific lines, time periods, and locations.

“Ultimately, the people who will benefit the most will be the audience, because better Rip-o-matics will lead to better movies and TV shows,” Grossman wrote in submitting his idea for the contest.

The jurors selected Grossman and his “Rip-o-matic With Watson” concept “for his vision to tell a story, taking away barriers with a strong vision to push the envelope of visual recognition utilizing Watson.”

Of course, for now, the “Rip-o-matic” is just hypothetical. And even if it works as envisioned, it’s not clear how useful such an application ultimately would prove to be to filmmakers.

As the winner, Grossman will receive IBM mentorship to develop the idea and potentially launch it as a product. In addition, he’s getting a free trip for two to the 2018 Tribeca Film Festival. The other finalists had proposed using IBM Watson to assist in choreography, to simplify the script-review process, to improving film marketing, and to enable real-time language translation in a VR environment.

“Technology helps all of us to find opportunities where we didn’t know it existed,” according to Rob High, IBM fellow, VP and CTO of IBM Watson. “We can use cognitive computing to help us to make better decisions.”

The “Storytellers With Watson” jury members were IBM’s High; Paula Weinstein, Tribeca EVP, creative and programming; Sharon Badal, Tribeca VP, filmmaker relations and shorts programming; and Rashmy Chatterjee, CMO, IBM North America.

The jury bestowed an honorary mention to Sadaf Amouzegar, data scientist at End Cue, for “ScriptAloud,” which would use Watson Text to Speech and Tone Analyzer to transform written scripts into audio files available for casting directors and producers (instead of having to actually read a script).

The three other contenders were: Mary John Frank’s “Watson Dance Assistance” for product dance choreography visualizations; Kevin Cornish’s “Human Conversation Project” real-time translation using Watson Language Translator; and Billee Howard’s “Watson Brand Studio Model: Powering the Content Brands of Tomorrow,” which aims to use AI to find the key elements of successful marketing campaigns based on “emotional levers.”

Popular on Variety

More Film

  • Gina Rodriguez'Someone Great' film premiere, Arrivals,

    Gina Rodriguez Apologizes After Rapping N-Word in Deleted Instagram Video

    “Jane The Virgin” star Gina Rodriguez has released an apology video shortly after she used the N-word while rapping along to a Fugees song in a video posted to her Instagram story. In the original video, which has since been deleted, Rodriguez raps along to “Ready or Not” while having her hair and makeup done. [...]

  • After a Revolution

    Gucci Tribeca Documentary Fund Winners Announced

    The Tribeca Film Institute and Gucci announced on Tuesday this year’s recipients for the Gucci Tribeca Documentary Fund. Now in its 12th year, TFI and Gucci have awarded $140,000 in grant funding, covered by Gucci, to support nine documentaries highlighting domestic and international matters, with a focus on female-led stories and filmmakers. The funding will [...]

  • countdown

    Apple Takes Down Viral 'Countdown' Horror App, STX Brings It to Android Instead

    An app that can predict the date and time of your death may have been too much for Apple to stomach: The iPhone maker removed a viral app inspired by the upcoming horror movie “Countdown” a few days ago, putting an end to its meteoric rise. Before its removal, “Countdown” had surpassed TikTok, YouTube and [...]

  • Babyteeth Eliza Scanlen

    Eliza Scanlen Drama 'Babyteeth' Lands at IFC for North America (EXCLUSIVE)

    IFC Films has acquired North American rights to the drama “Babyteeth,” starring Eliza Scanlen, Essie Davis, Ben Mendelsohn, and Toby Wallace, Variety has learned exclusively. The film had its world premiere in competition at the 2019 Venice International Film Festival, where Wallace won the Marcello Mastroianni award for best new young performer. It will be [...]

  • Neil Patrick Harris arrives at night

    'Matrix 4': Neil Patrick Harris Lands Role in Latest Installment (EXCLUSIVE)

    Neil Patrick Harris is the latest addition to the ensemble cast for the upcoming fourth installment of the “Matrix” franchise. He joins Keanu Reeves and Carrie-Anne Moss, who will be reprising their roles in the film, as well as Yahya Abdul-Mateen II, who was tapped as one of the leads last week. Plot details are [...]

  • Amanda Seyfried attends a special screening

    Amanda Seyfried Joins Gary Oldman in David Fincher's 'Mank'

    Amanda Seyfried is set to join Netflix’s “Mank,” David Fincher’s latest biopic revolving around “Citizen Kane” screenwriter Herman Mankiewicz, with Gary Oldman tapped to play the titular role. Lily Collins, Charles Dance, Tuppence Middleton, Arliss Howard, Ferdinand Kingsley, Jamie McShane, Joseph Cross, Sam Troughton, Toby Leonard Moore, Tom Burke, and Tom Pelphrey will also appear [...]

  • Cuba Gooding Jr

    Cuba Gooding Jr. Accused of Groping 14 Women at Bars and Clubs

    Prosecutors on Tuesday accused Cuba Gooding, Jr., of a long-standing pattern of approaching unfamiliar women in bars and kissing, pinching, biting or groping them. Gooding appeared in court in Manhattan for an arraignment on four misdemeanor counts of forcible touching and third degree sexual abuse. He pleaded not guilty, and is due back in court [...]

More From Our Brands

Access exclusive content