You will be redirected back to your article in seconds

Machine Learning Saves ‘Avengers’ VFX Artists Time

For visual-effects artists, time is always a struggle. When the call comes in to create something spectacular, artists and supervisors have to calculate how much run-
way they have to get from the point of the idea for the vfx to the deadline. On “Avengers: Infinity War,” the vfx crew found that a new innovation — machine learning — made it possible to create the character Thanos in a way that would have simply been impossible without it.

The filmmakers envisioned a version of Thanos — played by Josh Brolin — that would be CG, but also incorporate all the subtle facial expressions and delicate hallmarks of a physical performance that could only been done by an actor. They knew that the facial tracking tech was there but asking vfx artists to manually adjust every inch of the CG version of the face of Thanos once they had all the tracking and scanning information would have been a disaster. There would not be enough time to do it and the artists would likely burn out.

If they wanted to get to the promised land, machine learning — a type of artificial intelligence that allows a computer to learn how to move the facial features of a CG character — would be their vehicle.

“There’s just no time for a vfx artist to move every inch of a character’s face when you’re on a project this size and you need to move forward because it’s not just creating something,” says Dan Deleeuw, vfx supervisor for Marvel Studios. “With machine learning, we can teach the computer to know Josh Brolin’s face by correcting it each time we do something. We can tell it that a smile or a frown doesn’t quite look right and the corner of the actor’s mouth needs to move a little or the lines in his face need to move with his smile and then the computer learns what looks right for this actor’s face and then we can get into more of the overall look of what we’re doing.”

Though most of the big VFX houses are using their own version of machine learning, human judgment, as with human performance isn’t likely to be replaced anytime soon. The algorithm relies on the feedback from the vfx artists to tell it what’s right and even after that all the refinements are judgment calls for the VFX team to make in the same way the crew looks to an actor’s performance to give them the information to create a character that doesn’t look artificial or wrong.

“The performance clearly belongs to Josh Brolin,” says Kelly Port, VFX supervisor at Digital Domain. “We’re relying on him to create something that only he could create and then we’re working with what he gives us to help bring Thanos to life. Machine learning makes it possible for a vfx crew to have the time to create something amazing when a director asks us for that next step up in visual effects.”

More Film

  • MGM logo

    MGM Hires Robert Marick to Expand Consumer Products

    Metro Goldwyn Mayer has hired industry veteran Robert Marick as executive VP of global consumer products and experiences. In his new role, Marick is responsible for overseeing the expansion of MGM’s traditional merchandise, interactive and consumer products business. He’s also developing a global strategy with a focus on core consumer products licensing, digital and gaming, [...]

  • Robert Iger and Rupert Murdochcredit: Disney

    Wall Street Applauds as Disney Nears Finish Line on Fox Acquisition

    Wall Street is rooting for Disney as the media giant reaches the finish line this week in its 15-month quest to acquire most of Rupert Murdoch’s film and TV empire. Fox shareholders, on the other hand, are being a little more cautious. Disney is poised to close the $71.3 billion deal that took many twists [...]

  • Personal Tales From Hong Kong, China

    Personal Tales From Hong Kong and China Among the Asia Film Financing Forum Projects

    A brace of personal tales from China and Hong Kong are among the 23 projects vying for attention at the 17th Hong Kong Asia Film Financing Forum. Liu Miaomiao is a rare female ethnic Hui Muslim filmmaker. She came to international prominence with 1993’s “Chatterbox” that won the President of the Italian Senate’s Gold Medal [...]

  • Josie Ho Makes 2019 the Year

    Josie Ho Makes 2019 the Year She Takes Risks in Her Film Choices

    Josie Ho vows to master the art of calculated risk in the year 2019. As an actress and film producer, she is conscious of the choices of projects she makes: appearing in the new film by Japanese hotshot director Shinichiro Ueda, producing a new documentary feature while developing some 10 titles in the pipeline of [...]

  • FilMart: Big Data, Content Key to

    FilMart: Big Data, Content Key to iQIYI's Online Ambitions

    Tech and data play a huge role for iQIYI, China’s second-largest streaming platform, as a way to innovate and step out ahead of its competitors, iQIYI founder and CEO Yu Gong explained in a keynote speech Monday at FilMart. “We don’t see a lot of innovation-driven entertainment companies yet. We want to be the one,” [...]

  • Ted Sarandos and Thierry Fremaux'Okja' photocall,

    Despite Ongoing Peace Talks, Netflix Won't Have Any Movies at Cannes 2019 (EXCLUSIVE)

    Although Netflix and the Cannes Film Festival continue quietly to negotiate a potential settlement to their differences, the streaming giant will be absent from the Croisette again this year with no film in or out of competition, Variety has learned. The ongoing talks between the two sides have been friendly, including a dinner in Los [...]

More From Our Brands

Access exclusive content