Twitter has 'more analysis to do' after algorithm shows possible racial bias

Sponsored Links

BRAZIL - 2020/07/11: In this photo illustration a Twitter logo seen displayed on a smartphone. (Photo Illustration by Rafael Henrique/SOPA Images/LightRocket via Getty Images)
Rafael Henrique/SOPA Images/LightRocket via Getty Images

Twitter is learning first-hand about the challenges of eliminating racial bias in algorithms. The social network’s Liz Kelley said the company had “more analysis” to do after cryptographic engineer Tony Arcieri conducted an experiment suggesting Twitter’s algorithm was biased in prioritizing photos. When attaching photos of Barack Obama and Mitch McConnell to tweets, Twitter seemed to exclusively highlight McConnell’s face — Obama only popped up when Arcieri inverted the colors, making skin color a non-issue.

Others tried reversing photo and name orders to no avail. A higher-contrast smile did work, Intertheory’s Kim Sherrell found. Scientist Matt Blaze, meanwhile, noticed that the priority seemed to vary depending on the official Twitter app used. Tweetdeck was more neutral, for instance.

Kelley said that Twitter had checked for bias before using the current algorithm, but “didn’t find evidence” at the time. She added that Twitter would open source its algorithm studies to help others “review and replicate.”

Turn on browser notifications to receive breaking news alerts from Engadget
You can disable notifications at any time in your settings menu.
Not now

There’s no guarantee that Twitter can correct this. However, the experiment does show the very real dangers of algorithmic bias regardless of intent. It could shove people out of the limelight, even if they’re central to a social media post or linked news article. You might have to wait a long while before issues like this are exceptionally rare.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission. All prices are correct at the time of publishing.