Facebook is countering terrorism with AI and human sleuths

The company aims to be more transparent in its operations

Sponsored Links

Andrew Tarantola
June 15, 2017 2:38 PM
In this article: applenews, facebook, gear, internet
Facebook is countering terrorism with AI and human sleuths

With a user base of nearly 2 billion people, Facebook's global influence is nearly unrivaled, making it a potent platform for extremist ideologies. And while the company has long sought to limit the reach of such hateful speech, it hasn't always been forthcoming in how it was going about doing so. That changed Thursday, when Facebook released the first transparency report in its Hard Questions series: "How We Counter Terrorism".

"Our stance is simple: There's no place on Facebook for terrorism," Monika Bickert, Director of Global Policy Management, and Brian Fishman, Counterterrorism Policy Manager, wrote. "We believe technology, and Facebook, can be part of the solution."

To that end, the company has leveraged a mix of artificial intelligence systems and human expertise to combat extremist threats posted on its site. AI is a fairly new addition to Facebook's arsenal but is already being used for automated image recognition, which recognizes known extremist images and prevents them from being uploaded. The company is also reportedly training a neural network to recognize and remove written text that praises or supports terrorist organizations like ISIS.

Facebook's AI is also capable enough to search through related "clusters" of posts and pages to find other offending materials as well as recognize when previously banned users attempt to create new accounts. The company hopes to expand these features to its other apps, like Instagram, in the future.

Turn on browser notifications to receive breaking news alerts from Engadget
You can disable notifications at any time in your settings menu.
Not now

As for the company's human-based moderation, Facebook still greatly depends on the users to self-police and report each other. However they are expanding their Community Operations teams by 3,000 employees over the next year to help address reports faster. What's more, Facebook now employs a 150-member "strike team" of sorts. These specialists -- academics, former prosecutors and law enforcement -- are focused either primarily or exclusively on counterterrorism-related tasks.

Of course, Facebook isn't going it alone. The company has partnered with others in the tech industry such as Microsoft and Twitter to create a common database of "hashes" identifying terrorist material and propaganda. Facebook is also working with governments, turning over whatever information they can to law enforcement of E2E encrypted messages that pass through its network.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission. All prices are correct at the time of publishing.
View All Comments
Facebook is countering terrorism with AI and human sleuths