TV remotes soon to be outmoded

Voice, gesture recognition ahead, says Microsoft

Microsoft is planning for a future in which gesture and voice recognition replace TV remotes, Xbox game consoles replace some set-top boxes and keyword searches supplant onscreen program guides.

So said James Baldwin — Microsoft’s chief technology officer for television, video and music — in a Tuesday presentation at SMPTE’s annual confab in Hollywood.

Baldwin said the company’s next-generation software for sending TV to mobile phones, laptops and other devices is currently under review by AT&T and other providers, and in theory could be deployed in as little as six months.

Baldwin added that he’s held preliminary discussions with Xbox executives about adapting Microsoft’s Kinect technology to replace remotes in the living room. Kinect, which enables gamers to interact with their Xboxes in a “controller-free” environment, could be adapted to help consumers navigate their TVs.

“It won’t be long before you won’t need the remote control to communicate with your TV,” he said. “You’ll be able to wave your hand around to rewind or fast forward. The computer looks at you as a human being, instead of you having to figure out how to use a device.”

Kinect — which uses cameras, sensors and a microphone to track users — will be released as an Xbox add-on Nov. 4.

Gesture-controlled TV is already coming off the drawing board. Toshiba demonstrated one such set at the Consumer Electronics Show in January.

Baldwin predicts that it will be about five years before remotes are completely replaced by gesture and voice sensing devices. Such devices, he said, will also have face recognition technology that will allow them to distinguish between users and their respective preferences.

Microsoft’s Mediaroom platform also gives Xboxes the functionality of set-top boxes, allowing providers to replace STBs with Xbox consoles, if they so choose. Canada’s Telus rolled out that option for some of its customers in August.

Mediaroom 2.0, the latest iteration of the platform now in providers’ hands, allows consumers to order up video-on-demand on virtually any device that connects to the Internet, Baldwin said. He declined to say how far along AT&T and other providers are in their review process but stressed that the technology itself is ready to go.

Even onscreen guides are on their way out, he predicted, to be replaced by “meta tags” or keywords that allow consumers to name a genre, actor, program or channel and instantly get all available programs that match their search. Face recognition technology applied to programming will allow consumers to zoom in on individual scenes.

“The onscreen guide is just about to become a dinosaur,” he said. “It’s a very crude way to present information.”

Baldwin joined Microsoft as part of its 1997 acquisition of WebTV, which sought with limited success to turn TVs into Internet-connection devices. Mediaroom represents a complete rethinking of Microsoft’s original vision for WebTV and interactive television.

Besides Mediaroom, Baldwin oversees technology strategy for Microsoft’s Media Center and Zune music player businesses.

More TV

  • Seth Meyers TV Take Podcast

    TV News Roundup: Netflix Announces Seth Meyers's Standup Special

    In today’s TV news roundup, Netflix announced the premiere date for “Seth Meyers: Lobby Baby” and Epix released a trailer for “Belgravia.” CASTING AMC announced that “Succession” actor Sarah Snook, David Costabile (“Breaking Bad”) and Sonya Cassidy (“Lodge 49”) have been cast in its upcoming anthology series from Will Bridges and Brett Goldstein. The still-to-be-titled series is set 15 years into the [...]

  • Rachel Maddow

    Four Female Journalists Will Moderate Next Democratic Debate

    Four women will moderate the next Democratic debate, slated for broadcast on MSNBC. Rachel Maddow, the primetime host; Andrea Mitchell, the veteran foreign correspondent; Kristen Welker, the NBC News White House correspondent; and Ashley Parker, a Washington Post White House reporter, will moderate the event, MSNBC said Wednesday. The broadcast is slated for November 20. [...]

  • Neilsons Measurment Problems TV Digital

    Megan Clarken, Key Nielsen Executive, Will Depart Company (EXCLUSIVE)

    Megan Clarken, a Nielsen executive who has been instrumental in the company’s quest to keep tabs on consumers in the many new ways they have to watch TV, is leaving the measurement giant. “After 15 years at Nielsen, Megan Clarken will be leaving at the end of the month to take on a new position [...]

  • James Murdoch

    James Murdoch on 'Succession,' Pete Buttigieg and Climate Change

    James Murdoch doesn’t watch Fox News and he doesn’t watch “Succession.” “There are some shows that you just know you’re never going to watch,” the youngest son of media mogul and Fox Corp. founder Rupert Murdoch told Vanity Fair editor-in-chief Radhika Jones on Wednesday, alluding to to the HBO series centered on a family-run media [...]

  • Freddie Prinze Jr First Impressions

    Freddie Prinze Jr. Joins ‘Punky Brewster’ Sequel Pilot at NBCU’s Peacock Streamer

    Freddie Prinze Jr. is joining another pilot, this time at NBCUniversal’s forthcoming Peacock streaming service. He will play a recurring role in the “Punky Brewster” sequel pilot which was ordered when the Peacock unfurled its slate of feathers back in September. Prinze Jr. was a part of the pilot for the CW’s “Nancy Drew” earlier [...]

  • Traci Blackwell

    BET Names Traci Lynn Blackwell Head of Scripted

    Traci Lynn Blackwell has joined BET has head of scripted programming. Blackwell joins BET from the CW, where she was senior VP, current programming. As executive VP, scripted programming, Blackwell will lead all originals efforts for BET Networks’ linear channels and streaming service BET Plus. She will report to BET Networks president Scott Mills. “Traci [...]

  • Ted Sarandos Netflix

    Ted Sarandos: Netflix Is Why 'Friends,' 'The Office' Remain So Popular

    In an onstage conversation with Katie Couric at Vanity Fair’s New Establishment Summit on Wednesday, Netflix chief content officer Ted Sarandos waved away concerns over the streaming service’s upcoming loss of “Friends” and “The Office,” instead focusing on the company’s push in original programming and its international content growth. “One of the reasons ‘Friends’ and [...]

More From Our Brands

Access exclusive content