×
You will be redirected back to your article in seconds

Technology That Turns Obama’s Words Into Lip-Synced Videos to Be Featured at SIGGRAPH

A paper set to be delivered at next week’s SIGGRAPH 2017 conference has garnered a lot of pre-confab attention because the technology could possibly be used to produce fake news videos. But the technology described in the paper, “Synthesizing Obama: Learning Lip Sync From Audio,” could have many more beneficial uses, especially in the entertainment and gaming industries.

Researchers from the University of Washington have developed the technology to photorealistically put different words into former President Barack Obama’s mouth, based on several hours of video footage from his weekly addresses. They used a recurrent neural network to study how Obama’s mouth moves, then they manipulated his mouth and head motions as to sync them to rearranged words and sentences, creating new sentences.

It’s easy to see how this could potentially be used for nefarious purposes, but the technology is a long way away from becoming widely available and it would be fairly easy to detect in fake videos, according to Supasorn Suwajanakorn, the lead author of the study. “It would be relatively easy to develop a software to detect fake video,” he says. “Producing a truly realistic, hard-to-verify video may take much longer than that due to technical limitations.”

SIGGRAPH’s conference chair Jerome Solomon, dean of Cogswell Polytechnical College, notes that any new technology can be used for good or bad. “This is new technology in computer graphics,” he explains. “We’re making things that might not be believable believable and worlds that don’t exist exist. And I think people potentially using any technology out of our industry could use it for bad purposes or good.”

Plus, Solomon says echoing Suwajanakorn, “I think it’s a ways away from being available to everybody. Our conference is really a place where new technology comes in through our technical papers program, but it takes awhile for the technology to appear in the tools. Developers have to go and create the software to actually take this research and get it into the tools.”

And there are a wide variety of uses for this particular technology.

“Automatically editing video to allow accurate lip-sync to a new audio track is a novel advance on a very hot topic with many practical applications,” says Marie-Paule Cani,SIGGRAPH’s technical paper chair. “It could be used, for instance, to seamlessly dub a movie in a foreign language, or to correct what people said in video footage and no cost.”

A number of papers and exhibits of new technology will be on display at SIGGRAPH 2017, to be held July 30 through Aug. 3 at the Los Angeles Convention Center.

Among the many new technologies will be a presentation by brain-computer interface company Neurable. “They make a cap that you put on your head and it reads your brainwaves so you can use it instead of a mouse or a keyboard to do different things,” says Solomon. “They’re coming to SIGGRAPH with that technology to show how you can use it to play a game. Imagine playing a game without have a controller in your hand.”

A new addition to SIGGRAPH this year is a VR theater with ongoing programming. “We’re going to show VR films,” Solomon explains. “We’ll have high-end VR headsets and can actually demonstrate VR storytelling. With the sound and the high-end digital, it’s a really different experience.”

More Digital

  • Nancy Pelosi

    Facebook on Defensive Over Fake Pelosi Video

    Facebook faced growing criticism this week over its decision not to remove a video that was doctored to suggest that House Speaker Nancy Pelosi was intoxicated during a recent public event. The video, which has been viewed more than 2.5 million times, had been slowed down notably, giving the impression that Pelosi was slurring her [...]

  • Little-Black-Mirror-Maia-Mitchell

    Netflix Launching 'Little Black Mirror' Video Series Starring Maia Mitchell, Lele Pons, Rudy Mancuso, Juanpa Zurita and More

    To promote next month’s premiere of “Black Mirror” season 5, Netflix is launching a short video series — “Little Black Mirror,” with a cast that includes an ensemble of Latinx social-media stars. The three “mini-stories,” aimed at Spanish-speaking audiences, are inspired by the tech-dystopian universe of Charlie Brooker and Annabel Jones’ anthology series. “Little Black [...]

  • Twitter

    Twitter Permanently Bans Anti-Trump Krassenstein Brothers, Who Deny They Broke Platform's Rules

    Twitter permanently suspended the accounts of Ed and Brian Krassenstein — progressive political activists famous for trolling Donald Trump and his supporters — with the company alleging the brothers used bogus accounts to amplify their reach on the platform. “The Twitter Rules apply to everyone,” a Twitter rep said in a statement. “Operating multiple fake [...]

  • Snapchat

    Snap in Talks to License Music to Let Snapchat Users Embed Songs in Posts

    Snap wants to up Snapchat’s music game. The company has been in negotiations with music companies including the big three — Sony Music Entertainment, Universal Music Group and Warner Music Group — to license song catalogs for the Snapchat app, according to two industry sources familiar with the talks, confirming a Wall Street Journal report. [...]

  • T-mobile - Netflix - John Legere

    T-Mobile Passes Netflix Price Hike Through to Subscribers

    T-Mobile is getting ready to raise prices for subscribers who have taken advantage of its “Netflix On Us” promotion: The mobile carrier will begin charging existing customers who have participated in the promotion an additional $2 per month to account for Netflix’s recent price increase. Consumers will see their bill go up starting on 6/2. [...]

  • Oona King

    Snap Hires Google Exec Oona King as First VP of Diversity and Inclusion

    Snap continues to fill out the ranks of its revamped leadership team: The Snapchat parent tapped Oona King, most recently Google’s director of diversity strategy and a former member of British Parliament with the Labour Party, as its first VP of diversity and inclusion. King, who starts at Snap on June 11, is also the [...]

  • Chrissy Teigen

    Chrissy Teigen to Rule Over Small-Claims 'Chrissy's Court' in Show for Jeffrey Katzenberg's Quibi

    Chrissy Teigen is going full-on “Judge Judy” in a reality show ordered by Quibi, the mobile-video subscription start-up venture founded by Jeffrey Katzenberg. In each episode of “Chrissy’s Court,” the model-influencer will reign as the “judge” over one small-claims case. Like the reality TV shows it’s patterned after, the plaintiffs, defendants, and disputes are real [...]

More From Our Brands

Access exclusive content