You will be redirected back to your article in seconds

Machine Learning Saves ‘Avengers’ VFX Artists Time

For visual-effects artists, time is always a struggle. When the call comes in to create something spectacular, artists and supervisors have to calculate how much run-
way they have to get from the point of the idea for the vfx to the deadline. On “Avengers: Infinity War,” the vfx crew found that a new innovation — machine learning — made it possible to create the character Thanos in a way that would have simply been impossible without it.

The filmmakers envisioned a version of Thanos — played by Josh Brolin — that would be CG, but also incorporate all the subtle facial expressions and delicate hallmarks of a physical performance that could only been done by an actor. They knew that the facial tracking tech was there but asking vfx artists to manually adjust every inch of the CG version of the face of Thanos once they had all the tracking and scanning information would have been a disaster. There would not be enough time to do it and the artists would likely burn out.

If they wanted to get to the promised land, machine learning — a type of artificial intelligence that allows a computer to learn how to move the facial features of a CG character — would be their vehicle.

“There’s just no time for a vfx artist to move every inch of a character’s face when you’re on a project this size and you need to move forward because it’s not just creating something,” says Dan Deleeuw, vfx supervisor for Marvel Studios. “With machine learning, we can teach the computer to know Josh Brolin’s face by correcting it each time we do something. We can tell it that a smile or a frown doesn’t quite look right and the corner of the actor’s mouth needs to move a little or the lines in his face need to move with his smile and then the computer learns what looks right for this actor’s face and then we can get into more of the overall look of what we’re doing.”

Though most of the big VFX houses are using their own version of machine learning, human judgment, as with human performance isn’t likely to be replaced anytime soon. The algorithm relies on the feedback from the vfx artists to tell it what’s right and even after that all the refinements are judgment calls for the VFX team to make in the same way the crew looks to an actor’s performance to give them the information to create a character that doesn’t look artificial or wrong.

“The performance clearly belongs to Josh Brolin,” says Kelly Port, VFX supervisor at Digital Domain. “We’re relying on him to create something that only he could create and then we’re working with what he gives us to help bring Thanos to life. Machine learning makes it possible for a vfx crew to have the time to create something amazing when a director asks us for that next step up in visual effects.”

More Film

  • Q&A With Juan Villegas on ‘Las

    Argentina’s Juan Villegas on ‘Las Vegas,’ Featuring at Cannes’ ACID

    CANNES – Buenos Aires’ director-producer Juan Villegas presented his debut “Saturday” at the Venice Festival and won awards at the Rotterdam and Sarajevo film festivals. “Suicidals” screened at San Sebastián. “Idleness,” his third feature, co-directed with Alejando Lingenti, screened at the Berinale. Produced by Salvador del Solar at Argentina’s Cepa Audiovisual and by Villegas’ production [...]

  • Aaron Taylor-Johnson and Kenneth Branagh

    Christopher Nolan's New Film Casts Aaron Taylor-Johnson and Kenneth Branagh

    Aaron Taylor-Johnson and Kenneth Branagh will appear in Christopher Nolan’s upcoming film, “Tenet.” Clémence Poésy, Dimple Kapadia, Michael Caine are also joining the cast that includes John David Washington, Elizabeth Debicki, and Robert Pattinson. “Tenet,” which is being filmed on location across seven countries, is an action epic evolving from the world of international espionage. [...]

  • Cannes Placeholder Red Carpet

    Eddie Peng, Ma Sichun Join Ann Hui's 'Love After Love'

    Eddie Peng (“Operation Mekong” “The Hidden Man”) will head the cast of “Love After Love” the new film by Hong Kong’s Ann Hui. He plays opposite Ma Sichun (“The Shadow Play,” “Soul Mate”). The picture, which started shooting on Wednesday in China, is the story of a young woman from Shanghai who travels to Hong [...]

  • 'Matthias & Maxime' Review: Xavier Dolan's

    Cannes Film Review: 'Matthias & Maxime'

    If there’s one term that Xavier Dolan probably never wants or needs to hear again, it’s “enfant terrible.” Irresistible to use when the Québécois auteur was 19, rattling out of the gate with his antsy, angry lash-out of a debut, “I Killed My Mother,” it’s followed him doggedly through a series of variously spiky, variably [...]

  • Cannes: Agoraphobia Drama '522' Sells to

    Cannes: Agoraphobia Comedy-Drama '522' Sells to South Korea (EXCLUSIVE)

    Media Luna New Films has sold South Korean rights for comedy-drama “522. A Cat, a Chinese Guy and My Father” to Laon-I at Cannes. The film tells the story of George, an agoraphobic young woman who can’t walk more than 522 steps from her home. One day, her cat forces her to embark on a [...]

  • Aladdin

    'Aladdin' to Soar Above Box Office Competition Over Memorial Day Weekend

    When Disney first released “Aladdin” in 1992, Bill Clinton was just settling in to the Oval Office, “Game of Thrones” wasn’t much more than a book idea percolating in the mind of author George R.R. Martin, and Johnny Carson was wrapping up his stint as “Tonight Show” host. In some ways, 2019 feels like a [...]

More From Our Brands

Access exclusive content