You will be redirected back to your article in seconds

Smart instruments

Musician's tools play along with you

Ever since the invention of electric amplification, there’s been tension in the music world — a perpetual stare-down between acoustic and electric, amplified and unplugged, the immediacy of live performance and the perfectibility of the studio recording.

Tod Machover is working on a truce.

Machover’s website describes him as a musician, inventor and educator. He’s a significant composer — his opera “Death and the Powers” has its American preem next month — and he heads the Hyperinstruments/Opera of the Future group at the MIT Media Lab.

His early musical inventions were interactive music instruments for musicians including Yo-Yo Ma and Prince. His students include the founders of Harmonix, creators of “Rock Band” and Guitar Hero.” Now his team is making “hyperinstruments.”

In a nutshell, hyperinstruments combine the form of a traditional instrument, like a cello or guitar, with smart electronics. The musician plays the instrument as usual, but in addition to making sound, the instrument senses how the musician is playing.

“The instrument wants to be able to attach adjectives to how it’s being played,” said Machover. “Is it calm, is the music building, is a certain thing being emphasized?” Machover said. Then the instrument controls synthesizers to invoke other sounds to go along with the performance.

“Depending on how I’m interpreting the music, it might make up its own harmony and go from being a solo instrument to being an orchestra. So it’s like this model I’ve got of a multi-track recording studio, and I’ve got a whole orchestra, but it’s through one person playing their instrument that I mix and pull these things out.” And these additions aren’t random. The musician can learn how subtle changes in performance deliver different sounds.

“Young musicians get it pretty quickly,” he said. “I think this is the future of instruments.”

The son of a noted piano teacher and a computer graphics pioneer, Machover says he “grew up thinking about the tendency of digital technology to take the performance out of music in some ways.”

He points to the Beatles and Glenn Gould as artists who spent the their late careers working entirely in the studio because they felt they couldn’t make the music they were imagining live onstage. “I’ve been interested for a long time in the best of both worlds, how to get the precision and complexity of digital music with human spontaneity and real performance,” he says.

I sat down with Machover in his office in Boston a while back. He has an unruly shock of curly hair a bit like Gene Wilder’s in “Young Frankenstein” and an infectious enthusiasm for his work. His work area is filled with musicmaking gear (some look more like toys than instruments), as well as robotic set elements for his opera.

Hyperinstruments aren’t strictly an academic project. Machover says major performing groups, including the Kronos Quartet, are interested. So are manufacturers.

Machover recalled a meeting with the head of musical instruments for a Japanese conglom, a man who’d moved in mid-career from overseeing a sporting goods division. The exec lamented that the music space was less healthy than sporting goods. In sporting goods, people both watch tennis or baseball and buy raquets and bats. But few people who listen to music buy instruments.

The exec told Machover he had come in search of a new kind of instrument, one “that measures everything that you’re trying to express through your playing, so it really makes a difference if you touch it this way rather than another way, that wants to measure your feelings. On the other hand, we want the technology to to help fill in, even if you’re Yo-Yo Ma or Prince, help use what you do and get more mileage out of it.””I think instruments of the future will be in this sweet spot that’s not totally manual and not totally automatic,” he says. “Getting that right is a real art.”

Want to comment or suggest a column topic? Email david.cohen@variety.com

More Digital

  • USA Today Mobile Apps Get Oscars

    USA Today Launches Oscars AR Experience to Highlight Work of Costume Designers (EXCLUSIVE)

    USA Today is getting ready for the Academy Awards with an augmented reality (AR) experience dedicated to the work of the costume designers on some of the Oscar-nominated movies. The experience, which went live in USA Today’s Android and iOS app Monday, presents wardrobe from 6 movies in augmented reality, including costumes worn on “Mary [...]

  • Amazon Prime

    Amazon Prime India Greenlights ‘Bandits’ Music Series

    Amazon Prime Video India has greenlit original series “Bandish Bandits.” The show is a musical created by Still and Still Media Collective. The series will follow an Indian classical musician bound by tradition and a pop star whose performance skills are greater than her talent. A bandish is a term used to describe a musical [...]

  • Alibaba Buys 8% Stake in Chinese

    Alibaba Buys 8% Stake in Chinese Video Platform Bilibili

    Alibaba has purchased an 8% stake in the Chinese online video platform Bilibili, the official Xinhua news agency reported. Bilibili is one of China’s top video streaming and entertainment platforms, with about 92 million monthly active users and 450 million page-views per day. Founded in 2009, it was listed on the NASDAQ last March. Alibaba’s [...]

  • Clevver-Logo

    Hearst Magazines Buys Clevver's Pop-Culture YouTube Channels After Defy's Demise

    Hearst Magazines has snapped up Clevver, a network of female-skewing lifestyle and pop-culture news YouTube channels that had been owned by now-defunct Defy Media. Clevver was left homeless after Defy’s sudden shutdown in November; its principals said at the time they were looking for a new home. Hearst Magazines sees a digital fit with Clevver’s [...]

  • "Brother" -- Episode 201-- Pictured (l-r):

    CBS Interactive's Marc DeBevoise on Streaming Boom, Content Strategy, and Apple

    Not everyone wants or needs to be Netflix to succeed in the streaming space. And not everyone sees Apple’s enigmatic new service as a threat. Even as rival streaming services offer gobs of content, CBS Interactive’s president and COO Marc DeBevoise sees the company’s targeted original programming strategy continuing to attract viewers to its All [...]

  • Rhett-Link-Good-Mythical-Morning

    Rhett & Link's Mythical Entertainment in Talks to Acquire Smosh (EXCLUSIVE)

    Smosh, the YouTube comedy brand left stranded after parent company Defy Media went belly-up, may be about to get a new business partner. Mythical Entertainment, the entertainment company founded by top YouTube comedy duo Rhett & Link, has been in talks about acquiring the Smosh brand, sources told Variety. Multiple potential buyers came forward to [...]

  • Pokemon Go

    Proposed 'Pokémon Go' Lawsuit Settlement May Remove Poké Stops, Gyms

    A proposed settlement in the class action lawsuit against “Pokémon Go” developer Niantic could remove or change a number of Poké Stops and Gyms in the popular augmented reality game. The proposed settlement was filed in a California court on Thursday and applies to anyone in the U.S. who owns or leases property within 100 meters [...]

More From Our Brands

Access exclusive content