You will be redirected back to your article in seconds

Instagram Starts Using Artificial Intelligence to Moderate Comments. Is Facebook Up Next?

Instagram started to automatically block offensive comments Thursday, using artificial intelligence to go beyond simple keyword filters. The use of this technology is also a test case for Facebook as it is looking to improve its own moderation and filtering.

The Facebook-owned photo sharing service officially announced the launch of a new comment filter Thursday morning. “Many of you have told us that toxic comments discourage you from enjoying Instagram and expressing yourself freely,” wrote Instagram CEO and co-founder Kevin Systrom in a blog post. “To help, we’ve developed a filter that will block certain offensive comments on posts and in live video.”

Instagram also announced a new spam filter, which it had quietly been testing over the last couple of months. Filtering abusive comments will for now only be available in English, but spam is being detected if it’s written in Spanish, Portuguese, Arabic, French, German, Russian, Japanese, or Chinese as well. Comment filters are enabled by default, but can be turned off by each user.

Both filters are powered by machine learning, which means that the technology used to filter comments has been trained with a test set of data, and is looking at not just keywords but also contexts and relationships. An f-word between friends may have a completely different meaning than a slur hurled at an outsider, and song lyrics can include a lot of offensive language without actually offending anyone.

Instagram’s comment and spam filters are based on DeepText, an artificial intelligence effort developed in-house at Facebook, as Wired reported Thursday.

That’s notable in part because Facebook itself has yet to officially commit to AI as a means to moderate content and comments. Executives previously said that it may take some time before AI can play a role in moderation, and Facebook has responded to recent controversies related to inappropriate content with the hire of thousands of additional human moderators.

However, more recently, the company seems to have changed its tune on AI a bit. “There’s an area of real debate about how much we want AI filtering posts on Facebook,” wrote CEO Mark Zuckerberg in a blog post earlier this month. “It’s a debate we have all the time and won’t be decided for years to come. But in the case of terrorism, I think there’s a strong argument that AI can help keep our community safe and so we have a responsibility to pursue it.”

Does this mean that Facebook may also eventually use AI to moderate comments the way Instagram is now? A Facebook spokesperson stressed that both platforms are unique in a statement emailed to Variety:

“Facebook and Instagram are different platforms with different user experiences — from the follow model to how comments are used. Although we share the same goal of creating safe communities, we are going to have different approaches. Instagram’s new tools are a great first step that both companies will be able to learn from.”

In other words: Facebook may not copy Instagram’s new AI-powered comment filters 1:1, but the company surely is looking to this as a test case as it evaluates if and how it may one day use artificial intelligence for moderation on Facebook proper as well.

More Digital

  • One Day at a Time Canceled

    Why Netflix Will Keep Breaking Hearts and Cancelling Shows

    Netflix vice president of product Todd Yellin borrowed a line from one of the company’s newest stars this week to describe what makes its service special: “How do we measure success? Three letters: joy,” Yellin said to pictures from “Tidying Up With Marie Kondo” during a press event in Los Angeles. “If people enjoy our [...]

  • Oculus Rift S Won't Require External

    New Oculus Rift S Won't Require External Sensors Hits Spring 2019 For $399

    The redesigned Oculus Rift S won’t require external sensors to work, features a higher resolution display, improved optics, and the ability to quickly see the real world around a user through the headset’s built-in cameras. The new Rift hits this spring for $399, Oculus announced Wednesday. The headset is named the S rather than the [...]

  • HTC Vive Headset

    Doctors Look to Virtual Reality to Treat Chronic Pain

    Virtual reality is a technology with seemingly limitless potential, not just in the gaming space, but across a range of industries. The health field, in particular, is interested in the potential applications of VR tech to assist patients suffering from chronic pain. In his talk at GDC, David Putrino, Ph.D., walked through his organization’s efforts [...]

  • Game Industry Has Mixed Reactions to

    Game Industry Has Mixed Reactions to Google Stadia

    Google’s new game streaming platform Stadia made its debut at GDC. Although still missing some intangible details (namely, pricing or a launch date), publishers and developers still have thoughts on this ambitious attempt at bringing streaming to the mainstream. Stadia debuted with Ubisoft’s Assassin’s Creed as a key franchise for the platform. Ubisoft co-founder Yves [...]

  • EU Commissioner for Competition Margrethe Vestager,

    Google Fined $1.7 Billion by E.U. for Blocking Rival Online Advertisers

    The European Commission has fined Google €1.49 billion ($1.7 billion) for breaching E.U. antitrust rules by preventing rivals from placing their search advertisements on third-party websites. The Alphabet unit has now been hit with nearly $9.4 billion in fines by the E.U. antitrust regulator within the past two years. The regulator said Wednesday that Google, [...]

  • FilMart: Viu Uploads 'No Sleep, No

    FilMart: Viu Uploads 'No Sleep, No FOMO' Reality Show for Millennials

    “No Sleep No FOMO” is an eight-episode pan-regional travelog show that Asian streaming firm Viu hopes will help it win over more millennial generation audiences. It harnesses the potential of local social media celebrities and their 12 million followers. The show features “Running Man” star Kim Jong-kook, Korean musician Eric Nam and Singapore actor Paul [...]

  • ‘Wonder Park’ Tops Studios’ TV Ad

    ‘Wonder Park’ Tops Studios’ TV Ad Spending for the Fourth Week in a Row

    In this week’s edition of the Variety Movie Commercial Tracker, powered by the TV advertising attention analytics company iSpot.tv, Paramount Pictures claims the top spot in spending for the fourth week in row with “Wonder Park.” Ads placed for the animated film had an estimated media value of $5.18 million through Sunday for 1,718 national [...]

More From Our Brands

Access exclusive content