Opera of the future

Robotic and music combo gives audience something new

For years, Tod Machover has run the “Opera of the Future” group at the MIT Media Lab in Cambridge, Mass. But he’s lived a double life. Not content to be a well-regarded composer, he’s also an inventor, creating instruments and robots that are transforming the way music is performed.

His latest futuristic opus, “Death and the Powers,” is a 90-minute one-act opera, with libretto by Robert Pinsky, directed by Diane Paulus. It incorporates cutting-edge robotics, and uses a technology Machover dubs “disembodied performance” that requires its star, baritone James Maddalena, to act out almost the entire program out of sight or earshot of the audience — even while a high-tech translation of his performance appears on the stage.

Production designer Alex McDowell, who worked with MIT to create the gestural computer interfaces for the film “Minority Report,” says of “Death and the Powers”: “I was taken places that were outside my experience or even my understanding, in some cases.”

“Death and the Powers” tells the story of Simon Powers, a businessman and inventor nearing the end of his life who decides to upload his consciousness into the computerized/robotic home he’s created, so the very walls come alive with his thoughts and feelings.

That means the singer playing Powers, Maddalena, has one scene onstage, then exits and never returns. Offstage, he dons a set of sensors that measure how he moves his arms and how fast and deeply he breathes, as he enters a miked isolation booth beneath the stage. Computer software analyzes his singing as his voice is delivered to the audience through an innovative speaker system that produces powerful sound without massive speaker enclosures.

“You really become part of the orchestra,” he says. “When you’re in front of an audience, there’s an energy that goes back and forth, and when you’re in a booth, there’s none of that. You really are isolated.”

Isolated, but not absent. Maddalena’s voice is also altered electronically, turning him into what Machover calls a “hyperinstrument” that produces its own natural sound and controls an electronic sound at the same time.

McDowell explains that since the star’s personality and performance needed to be conveyed by the set itself, the challenge was “to bring an inert design physically to life.” That begins with the set’s walls, which represent bookshelves but are actually LED videoscreens. Once Powers “goes into the System” (and Maddalena is hooked up to his sensors) software analyzes the performer’s singing, breathing and gestures to get a sense of his emotions, then translates those emotions to the LED videoscreens.

Says Machover, “A combined measurement of all elements from the singer give us information about how agitated or smooth, jumpy or continuous, geometric or blob-like, focused or diffuse, the visual patterns will be. Arm movement determines which direction the large-scale patterns move on the walls.”

“It’s a very direct, one-to-one, intuitive theatrical approach,” says McDowell.

Machover draws a distinction between disembodied performance and the performance-capture process used in such movies as “King Kong” and “Avatar.”

Performance capture depends on an actor’s movements to essentially drive a puppet, be it a CG character or a robot. But, says Machover, “What I wanted was the feeling of that muscle tension, of the gesture, the sense that we know that it’s this man having this particular emotion, but what we actually see is something very different.

“We might see a calligraphy of light on the screen that doesn’t actually look like his arm moving but has the same feeling to it. The result is you get closer to the feeling of that character.”

It was up to McDowell to turn that abstract idea into something the audience could grasp.

“I started by designing a number of objects that represented physical extremities. Robots for fingers, chandelier for brain, walls for skin,” he says.

The robots, dubbed “operabots,” which look a bit like a new-age drum pad on wheels, engage in a “Sorcerer’s Apprentice”-style dance with one of the characters in one scene.

In another, a stringed chandelier with a shape similar to a venus fly trap descends to interact with Powers’ wife in a strangely sensual duet as the couple recall how they met. She can play music directly on its strings, and the way she touches those strings affects the sound of Maddalena’s voice.

Machover sees applications for this technology in large arena performances, like rock concerts, where the aud watches the performers on large videoscreens.

“Frankly, to me, (videoscreens) usually make the live performers look small rather than making them look more present,” he says. Machover envisions concerts where the movement of the performances onstage determines the way the visuals look and the sound is in the hall.

McDowell agrees that the new art has enormous potential. “What’s really exciting to me is there’s … no limit now to what we can measure. The twitches of fingers or breath or acrobatics or position in space can turn into sound or color or animatronics or robotic performance.

“The implication in live performance is vast.”

“Death and the Powers” makes its American debut March 18 at the Cutler Majestic in Boston as a joint presentation of the American Repertory Theater and Opera Boston. It will run for a week in Boston and then move to the Harris Theater in Chicago for an April 2-10 engagement.

More Digital


    SAG-AFTRA Ends Long Strike Against Ad Agency Bartle Bogle Hegarty

    SAG-AFTRA has ended its 10-month strike against Bartle Bogle Hegarty after the advertising agency agreed to sign the union’s new commercials contract. The union instructed its 160,000 members in September not to accept any work for BBH, which had been signed to SAG-AFTRA’s commercials contracts since 1999. The strike came two weeks after BBH publicly [...]

  • FaceApp is displayed on an iPhone,

    SAG-AFTRA Warns Members About FaceApp Terms of Use

    SAG-AFTRA is warning its 160,000 members about the “overreaching and invasive” terms of use for the FaceApp mobile application. FaceApp, developed by Russian company Wireless Lab, uses neural network technology to automatically generate transformations of faces in photographs. The app can be used to make users appear older, younger, or change gender. The terms include [...]

  • J. Cole

    Apple Music Launches 'Rap Life' Playlist

    Apple Music announced the launch of “Rap Life,” a new global playlist focusing on contemporary rap artists and culture. It replaces the former “The A-List: Hip-Hop” playlist. Said Ebro Darden, Apple Music’s Global Editorial Head of Hip-Hop and R&B: “We flipped it to dig deeper into into the lifestyle [and to] keep pushing the culture [...]

  • Billie Eilish

    ARRI, Mobile TV Group Back New Venture Revitalizing Streamed Concerts

    A new venture looking to bring a fresh approach to live-streaming concerts has gotten the backing of hardware heavyweights ARRI and Mobile TV Group. Wide+Close is launching with the mandate of shooting music performances with film cameras and cinematographers in order to give the content a more cinematic feel. “We want to take concert filming [...]

  • Fortnite Battle Royale

    How 'Fortnite' Fans Can Earn Loot by Watching YouTube Videos

    Epic Games and YouTube have teamed up with a special offer for “Fortnite” players — giving players of the popular battle-royale game rewards when they watch “Fortnite”-premiered content on the video platform. The catch: You have to watch at least 20 minutes of “Fortnite” special content or live esports broadcasts to receive the loot. Under [...]

  • Roku headquarters

    Roku Plans to Expand to Brazil, Other Countries (EXCLUSIVE)

    Roku plans to expand to multiple new territories in the coming months, Variety has learned. One of the first new markets for the company will likely be Brazil. An international expansion could help Roku grow its customer base, which in turn should lead to growing advertising revenues. Roku executives have been hinting at plans to [...]

  • Google Stadia Pro to Include 1

    Google’s Stadia Game Streaming Service to Include Free Monthly Game

    Google has been busy sharing additional details about its upcoming game streaming service Stadia, clearing up some confusion in the process. Stadia’s pro subscription tier, which will cost $10 per month, won’t be a Netflix-type subscription service. However, subscribers will get free games at the rate of about a title per month. That’s according to [...]

More From Our Brands

Access exclusive content