Sponsored Links

Alphabet fights 'toxic' comments with machine learning

Jigsaw's Perspective is learning how to identify bad comments so publications can foster better conversations.
Nathan Ingraham
Nathan Ingraham|February 23, 2017 10:15 AM

If you've spent any time at all on the internet, you know that finding civil conversation can be a real challenge. Whether on YouTube, Facebook, Twitter or your favorite news site, trolls can often dominate and derail the conversation. Today, Alphabet company Jigsaw has announced that it is using its machine learning chops to combat the problem. Perspective, which launches today, is an "early-stage" technology using machine learning to identify "toxic" comments. Furthermore, publishers will have access to an API to include this technology on their sites in the hopes that it'll lead to better conversations.

To train Perspective, Jigsaw pointed it at hundreds of thousands of comments that were identified as toxic by human reviewers. From there, the machine learning software would look at other comments and score them based on similarities. As with all machine learning systems, Perspective gets smarter and more accurate each time it finds new examples of toxic comments and every time humans guide it and correct things that it may mis-identify.

Jigsaw hasn't just been testing and training Perspective in its own labs -- the company says it has partnered with The New York Times to test it. Currently, the NYT has moderators who review every single comment before it is posted; that team has to review about 11,000 comments every day. But that desire for manual review means that the publication only has comments open on about 10 percent of its stories. Through working with Jigsaw and Perspective, the NYT's moderation team can go through comments more quickly and open up comments on more articles.

Turn on browser notifications to receive breaking news alerts from Engadget
You can disable notifications at any time in your settings menu.
Not now

Perspective isn't the only tool Jigsaw is working on to make the internet a more hospitable place, either. Last year, the company let any news organization sign up to use Project Shield, a tool that defends against DDoS attacks. As useful as that may be, Perspective could be something that impacts the way people view publications and news sites every day -- provided it works, of course. Here's hoping the NYT and Jigsaw have some hard data to share about how Perspective has impacted the site's comments section soon.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission. All prices are correct at the time of publishing.
Alphabet fights 'toxic' comments with machine learning