×

How Machine Learning Turned Major Lazer’s ‘Make It Hot’ Into Vertical Video (EXCLUSIVE)

Major Lazer & Anitta’s new track “Make It Hot” has all the makings of a summer hit — including a version that plays well on the go: Alongside the official video, artist manager services company Mtheory released a version on Wednesday that was cut for vertical viewing on Instagram and TikTok.

“With the way fans are consuming video today, we wanted to have the video live in as many places as possible, so we needed to make it in vertical format,” said Mtheory partner Zack Gershen.

But instead of manually cropping a mobile-optimized version of the clip, Mtheory used state-of-the-art machine learning to transform “Make It Hot” into a potential TikTok hit. To do this, Mtheory partnered with GoVertical, a new startup that is specializing in automating the conversion of regular landscape clips to vertical video.

GoVertical’s co-founders Irfaan Premji and John Gardiner realized the need for such a solution when they worked on their own social music app. “We wanted to incorporate music videos, but we didn’t want to force you to turn your phone,” recalled Premji.

Manually editing each and every video didn’t seem like a good option, and forcing a landscape-oriented video to show vertically didn’t work either. “You can’t just crop a video centered,” Premji said.

That’s why the duo began to develop machine learning technology that would use image recognition to identify the parts of a video worth keeping and the parts that could be safely discarded. “The system has object as well as human detection,” Gardiner explained.

Premji said that GoVertical’s system still needed a bit of hand-holding, which includes a human review to make sure the algorithm didn’t accidentally cut something essential. “Right now, it’s a fairly bespoke service,” he admitted, but added that it would improve over time.

Eventually, GoVertical also wants to develop an API as well as a self-service web interface to give customers a way to turn their own assets into vertical videos. And over time, GoVertical also wants to expand from music videos to other genres, including ads and movie trailers — assets that are often recut by hand these days, with mixed success. “A lot of these social media teams, they are not video editing experts,” said Gardiner.

Ultimately, algorithms can do a better job at converting these videos, especially at scale — which is what makes it interesting to Mtheory, a company that provides marketing and operations infrastructure for a number of artist managers. “Our friends at GoVertical did an amazing job converting it and now we’re using it on Instagram, TikTok, etc,” said Gershen. “Making videos available in vertical format is really transformational for our artist marketing.”

Popular on Variety

More Digital

  • wolves in the walls emmy

    Neil Gaiman VR Experience 'Wolves in the Walls' Wins Primetime Emmy

    “Wolves in the Walls,” the virtual reality (VR) experience based on Neil Gaiman’s children’s book by the same name, has been awarded with a Primetime Emmy for outstanding innovation in interactive media. The experience has been produced by San Francisco-based immersive entertainment startup Fable, which puts a big effort on making the viewer a participating [...]

  • The Void San Francisco

    The Void Teams Up With Sony Pictures for New Location-Based VR Experience

    James Murdoch-backed virtual reality (VR) startup The Void has teamed up with Sony Pictures Virtual reality to produce a new location-based VR experience, according to Curtis Hickman, the startup’s chief creative officer. Hickman revealed the partnership in a conversation with Variety this week, during which he also outlined plans to bring more original IP to [...]

  • US President Donald J. Trump speaks

    Apple Stock Down 4% After Trump ‘Orders’ Companies to Leave China

    Apple’s share price was down around 4% Friday morning after President Trump took to Twitter to “order” U.S. companies to leave China. The slide came amid a market-wide sell-off, with the NASDAQ sliding 2%, and the Dow dropping 450 points. Trump’s edict was a response to a new round of tariffs imposed by China on [...]

  • Former head of CAA China Peter

    Peter Loehr to Spearhead Asia Expansion of Genies Avatar Venture (EXCLUSIVE)

    Peter Loehr, the former head of CAA in China, and seasoned music executive John Possman have been tapped by digital avatar company Genies to lead its expansion into Asia. The company’s proprietary avatar technology allows users to express ideas, thoughts and feelings in a different way from text, audio and video. Within the app and [...]

  • Tim Connolly - Quibi

    Quibi Head of Partnerships and Advertising Tim Connolly Departs

    Tim Connolly, the former Hulu exec who joined Quibi last year as head of partnerships and advertising, is leaving the mobile TV subscription startup founded by Jeffrey Katzenberg. Connolly’s exit comes eight months ahead of Quibi’s planned April 2020 debut. A Quibi rep declined to comment on his departure, which was first reported by Business [...]

  • Warner Music Group Partners With Audiomack

    Warner Music Group Partners With Audiomack

    Warner Music Group announced it has entered a partnership with the music streaming and discovery service Audiomack, marking the platform’s first licensing deal with a major label. According to the announcement, the two companies will work together on content concepts and explore ways to break emerging artists, connecting music fans with rising talent before they [...]

More From Our Brands

Access exclusive content