×
You will be redirected back to your article in seconds

Facebook Brings More AR to Instagram, Messenger, Adds Tools for Brands and Creators

Facebook is doubling down on augmented reality (AR): The company used its F8 developer conference in San Jose Tuesday to announce a number of initiatives designed to expand the use of AR across its family of apps. This includes support for third-party AR filters in Messenger, Instagram and Facebook Lite, as well as tools to help developers with the creation of AR assets and experiences.

One of the first Facebook apps to benefit from the company’s work in AR is Messenger. Facebook announced Tuesday that it is bringing AR to the Messenger Platform, whiich is essentially the developer program that allows brands and others to build their own chat bots, as well as add payments and other features.

As part of a closed beta, Facebook is allowing a handful of brands to bring special AR filters to Messenger. Users who engage with Sephora, KIA, Nike or ASUS on Messenger will have the option to access AR through a special button, which opens up their phone camera, and offers a number of branded AR overlays. Sephora for example will allow users to try on some make-up looks, and then share photos or videos with their Facebook friends.

Instagram is also set to receive an AR update, with Facebook extending its camera effects developer tools to the photo sharing service. This will allow developers to build AR effects, like face filters and world lenses, for their followers on the service. Some of the launch partners for the closed beta test of AR on Instagram include Kylie Jenner, NBA, Jiffpom, Liza Koshy, Baby Ariel, Ariana Grande, Vogue and BuzzFeed.

And finally, AR is also coming to Facebook Lite, the app that Facebook launched close to 3 years ago for low-end Android phones. Facebook committed on Tuesday to bring AR experiences from third-party developers to the app’s entire user base, but didn’t give any firm date for the update.

Developers won’t just be able to bring their AR filters to additional audiences, they’re also getting some help in making them. Facebook announced Tuesday that it is updating its AR creation software AR Studio. Creators can now more easily import existing 3D assets into their AR experiences, and Facebook Pages that publish AR apps will soon get to track their use with analytics.

Facebook also upped the ante on some of the underlying technology powering AR on its apps. The company is adding advanced target tracking, which includes hand tracking as well as high-fidelity body tracking, which should make for a lot more precise filters.

Facebook’s camera will also get better at recognizing objects, which will allow developers for instance to add virtual steam whenever there is a real-life coffee cup in the picture. And facebook AR is getting background segmentation, aka a green screen effect, which will allow for filters that transport people into different environments.

Facebook CEO Mark Zuckerberg first teased the company’s AR ambitions during his keynote speech at F8 2017, where he confessed that he had originally only thought of the technology in the context of AR glasses, which may be several years away from becoming a mass consumer product. However, Zuckerberg and Facebook ultimately changed course to turn smart phones and their cameras into AR platforms — something that Zuckerberg had called “phase one” back in 2017.

Developing.

More Digital

  • Facebook Logo

    Facebook Sets up New Product Group for AR Glasses (Report)

    Facebook has restructured its augmented and virtual reality research division and set up a new group tasked with building augmented reality (AR) glasses, according to a new Business Insider report. Facebook acknowledged the move in a statement given to the publication, saying that the move affected “a few hundred people.” The group has already built [...]

  • nba-the-bounce-logo

    NBA, Turner to Debut 3-Hour Primetime Live Studio Show on Yahoo Sports

    Coming next week: a new NBA primetime show — delivered over the internet — covering all the live action and storylines of the evening. The NBA is teaming with Turner Sports and Yahoo to produce a live nightly show designed for mobile viewers in a three-hour block, slated to run five nights per week on [...]

  • Ikea Sonos

    Ikea Plans to Launch Its Sonos Speakers in August

    Furniture giant Ikea is getting ready to roll out its Sonos-powered smart speakers later this year: The company revealed in a video Friday that it will launch its Symfonisk line of smart speakers in August. Ikea and Sonos first announced their collaboration in late 2017. Under the plan, Ikea will build internet-connected speakers that are [...]

  • Editorial use only. No book cover

    Farewell to Concubines: China Tightens Restrictions on Short-Form Videos

    Bad news for some of China’s 600 million users of short-form video platforms: No more content depicting foot fetishes, spoofs of the national anthem or sympathy for extramarital affairs, according to new regulations. Worse news for the companies that serve such consumers: They’re now expected to step up their censorship efforts and assume responsibility for [...]

  • How Meta Struggled to Make AR

    The Story Behind Meta, the AR Startup That Just Had Its Assets Sold to a Mystery Buyer

    “It’s a pretty dramatic moment in my life.” To say that Meron Gribetz, co-founder of the augmented-reality headset startup Meta, has had a busy couple of months is an understatement. Meta made headlines in September when it furloughed most of its workforce after an investment round from China failed to go through. Since then, Gribetz [...]

  • Mj Rodriguez, Nico Santos to Announce

    Mj Rodriguez, Nico Santos to Announce GLAAD Media Award Nominations

    Mj Rodriguez and Nico Santos are set to announce the nominees for the 30th annual GLAAD Media Awards. The “Pose” star and “Crazy Rich Asians” funny man will make the announcement during a live-stream hosted by AT&T and from the AT&T Hello Lounge at the Sundance Film Festival on Friday, Jan. 25. “The images and stories recognized [...]

  • Netflix Claims 'Fortnite' Is a Bigger

    Netflix Claims 'Fortnite' Is a Bigger Competitor Than HBO

    It may be mostly gamesmanship to downplay looming threats, but Netflix says it’s not really focused on rival streaming-video services from Amazon, Hulu, Disney, WarnerMedia or other big players as much as improving its own service to win share of consumers’ attention. “We compete with (and lose to) ‘Fortnite’ more than HBO,” Netflix told investors [...]

More From Our Brands

Access exclusive content