Latest in Science

Image credit:

Wikipedia's AI can automatically spot bad edits

Say bye-bye to (some) trolls and spammers.
26 Shares
Share
Tweet
Share
Save

Sponsored Links

Wikipedia has a new artificial intelligence service, and it could make the website a lot friendlier to newbie contributors. The AI, called Objective Revision Evaluation Service (ORES), will scour newly submitted revisions to spot any additions that look potentially spammy or trollish. Its creator, the Wikimedia Foundation, says it "functions like a pair of X-ray specs" (hence the image above) since it highlights anything that seems suspicious; it then sets that particular article aside for human editors to look at more closely. If the Wiki staff decides to pull a revision down, the contributor will get notified -- that's a lot better than the website's current practice of deleting submissions without any explanation.

The team trained ORES to differentiate between unintentional human errors and what's called "damaging edits" by using the Wiki teams' article-quality assessments as examples. Now, the team can use the AI to score an edit based on whether it's damaging or not.

This example, for instance, shows what the human editors see on the left and what ORES sees on the right. The AI's "false" or not damaging probability score for it is 0.0837, while its "true" or damaging probability score is 0.9163. As you can see, "llamas grow on trees" isn't exactly helpful or accurate.

As the Wikimedia foundation pointed out in its announcement, this isn't the first AI designed to help human editors monitor the site's content. However, those older tools can't tell the difference between a malicious edit and an honest human error, making ORES the better choice if Wikipedia doesn't want to lose even more contributors.

[Image credit: MGalloway (WMF)/Wikimedia]

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
26 Shares
Share
Tweet
Share
Save

Popular on Engadget

Engadget's Guide to Privacy

Engadget's Guide to Privacy

View
Neo Geo retro stick console includes 'King of Fighters,' 'Samurai Shodown'

Neo Geo retro stick console includes 'King of Fighters,' 'Samurai Shodown'

View
Watch the 'Android' Nokia phone that never had a chance to exist

Watch the 'Android' Nokia phone that never had a chance to exist

View
TiVo tries running pre-roll ads before your recorded shows

TiVo tries running pre-roll ads before your recorded shows

View
YouTube CEO apologizes for channel verification mess (updated)

YouTube CEO apologizes for channel verification mess (updated)

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr