Technology Turns Back Time on ‘The Irishman’

Motion capture in one form or another has been around for decades, and certainly the most recognizable modern use comes from “The Lord of the Rings” films in which Andy Serkis portrayed the beady-eyed creature Gollum. The actor wore a special bodysuit, helmet and strategically placed markers so that each detail of the part computer-generated, part live-action performance appeared on screen.

Howver, the Pablo Helman-led ILM visual-effects team behind “The Irishman” from Martin Scorsese didn’t have the luxury to use such technology.

The story chronicles the criminal and union ties between Frank Sheeran (Robert De Niro), notorious crime boss Russell Bufalino (Joe Pesci) and Teamsters leader Jimmy Hoffa (Al Pacino) over four decades. The iconic actors, now in their 70s, needed to appear younger in many scenes. To rejuvenate them, Scorsese didn’t want to use technology that could intrude or restrict the performances. The ILM team took on the task to develop a camera rig and newly designed software dubbed Flux to free the actors from wearing facial markers or helmets.

“Marty felt strongly about us not touching any of the performances,” says Helman. “Another important thing to him was de-aging the actors so they looked like younger versions of the characters and not younger versions of themselves. It’s a subtle difference but it meant we couldn’t simply rewind the clock.”

Popular on Variety

The technical development started in 2015 when Helman and ILM had De Niro reenact the pink Cadillac scene from “Goodfellas” to prove it would work. The test got the film greenlit by Netflix and then the team spent another two years fine-tuning the complex pipeline.

To pull it off, visual effects recorded a range of facial movements of each actor in prep under different lighting conditions. Models of those performances in 3D were created to later help extract the on-set performances. In production, scenes were shot using a unique rig comprising three cameras — one primary (RED Helium) for the director and a pair of witness cameras (Alexa Minis) on each side to record the visual effects data. The offset cameras focused on the actors’ faces and were fitted with an infrared light ring and filters.

The Flux software then analyzed the infrared lighting and texture to make renderable models and compared it to the models created in prep. The system then re-targeted the on-set performance to the younger version of the character.

“We did all of this without adding animation or keyframes to the performance,” notes the visual effects supervisor.

In creating the younger versions of each character, ILM collected thousands of images and videos of the actors’ targeted ages and built an AI-based engine as a way to check the facial performance of the younger model. They then would reattach the digital head to the live-action body. Visual effects also performed work on the hands and the bodies, or at times, aged-up De Niro if he didn’t look old enough.

Visual effects accounted for 1,750 shots for the three-plus-hour movie. Now, Helman and the team are focusing on giving the system a facelift by reducing the size and weight of the rig. They’re also integrating AI into the coding for improved accuracy and faster performance.

“We did this for the actors and how performance can be so powerful,” notes Helman. “The whole thing about this is if we take away the technology from the actors and from the director and get better performances then we have a better movie. That’s the thing that drives what we are doing.”

More Film

  • Nardjes A.

    ‘Invisible Life’s’ Karim Ainouz Drops Trailer for 'Nardjes A.’ (EXCLUSIVE)

    On Feb. 14 last year, Karim Aïnouz arrived in Algeria to trace via the story of his parents the Algerian Revolution which happened 60 years ago – its 1954-62 War of Independence from France. The uprising he very quickly started to shoot, however, was one happening right then, the Revolution of Smiles, whose first street [...]

  • Call of the Wild

    Harrison Ford in 'The Call of the Wild': Film Review

    Dogs, in their rambunctious domesticated way, can lead us overly civilized humans a step or two closer to the natural world. So it’s only fitting that the best dog movies have saluted that unruly canine spirit without a lot of artificial flavoring. Hollywood’s classic dog tales, like “Old Yeller” (1957) or “Lassie Come Home” (1943), [...]

  • Adventures of a Mathematician

    Indie Sales Unveils Trailer For 'Adventures of a Mathematician' (EXCLUSIVE)

    In the run up to Berlin’s European Film Market, Indie Sales has unveiled the trailer for Thor Klein’s “Adventures of a Mathematician” which had its world premiere in Palm Springs. The film tells the inspiring true story of a Polish-Jewish mathematician who got a fellowship at Harvard and went on to join the prestigious Manhattan [...]

  • Sonic (Ben Schwartz) in SONIC THE

    How Internet Backlash Helped 'Sonic the Hedgehog' Avoid Box Office Disaster

    It’s not a stretch to say Universal’s “Cats” and Paramount’s “Sonic the Hedgehog” had two of the most polarizing movie trailers in recent memory. Both caught fire online for all the wrong reasons after fans on social media torched the questionable CGI. “Cats,” an adaptation of Andrew Lloyd Webber’s musical, used a new science called [...]

  • Neumond Berlin Germany Restaurant

    Berlin Offers Diversity in Restaurant Scene

    Berlin Film Festival attendees have a chance to sample the diverse cuisine of a foodie city. Some of the top pics for a pre-film repast: Adana Grillhaus  A hugely popular Turkish restaurant in Berlin’s Kreuzberg district, Adana Grillhaus now has a second location right around the corner. Manteuffelstr. 86 +49 30 6127790 Skalitzer Str. 105 [...]

  • my salinger year

    Berlin Festival's New Selection Committee Takes Off

    Berlin’s new seven-member selection committee — four women and three men — comprises the core of new director Carlo Chatrian’s programming staff, which is led Canadian critic Mark Peranson. Peranson was the Locarno Film Festival’s chief of programming when Chatrian headed that Swiss festival. This year, Berlin is opening with “My Salinger Year,” starring Sigourney [...]

  • Mariette Rissenbeek Berlin Film Festival Executive

    Mariette Rissenbeek Faces Challenges as Berlin Festival Executive Director

    Making her debut as the new executive director of the Berlin Film Festival this year, Mariette Rissenbeek is facing some big challenges after taking over management duties at one of the world’s biggest public film fests. Rissenbeek and new artistic director Carlo Chatrian succeed Dieter Kosslick, who left an indelible mark on the fest after [...]

More From Our Brands

Access exclusive content