Latest in Gear

Image credit: AP Photo/Steven Senne

Senate bill would make tech companies test algorithms for bias

It could address discrimination in tech, but questions remain.
224 Shares
Share
Tweet
Share
Save

Sponsored Links

AP Photo/Steven Senne

It's well established that algorithms can exhibit bias, however inadvertently, and a trio of US politicians believe they can do something about it. Senators Cory Booker, Yvette Clarke and Ron Wyden have introduced an Algorithmic Accountability Act that would require larger companies to test their algorithms and fix anything "inaccurate, unfair, biased or discriminatory." The move would also ask them to study how their systems protect personal data,and would let the FTC create regulations mandating impact studies for "highly sensitive" automated systems.

The bill would only apply to companies that either make more than $50 million per year or have data for at least one million people or devices. Small businesses would theoretically be safe.

The senators saw this as a civil rights issue and pointed to recent incidents as examples. Facebook is still facing a charge of housing discrimination after it let advertisers exclude people in ways that could be racist or sexist, while Amazon shut down an automated recruiting tool after it was found discriminating against women. Facial recognition also has bias problems. It's a modern form of practices like "real estate steering" (where black couples were discouraged from getting homes in some neighborhoods), Sen. Booker said, but more insidious as it's "significantly harder to detect." In theory, this would prevent companies from ignoring the potential for bias.

There's no guarantee the bill will become law, and there are questions as to how well it would work. Would a company still be held responsible if a biased algorithm slipped through the cracks? What if an algorithm doesn't cover potentially biased data? As helpful as the legislation might be in ensuring fairness, it could also lead to some uncertainty and added overhead that might not always be necessary.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Share
224 Shares
Share
Tweet
Share
Save

Popular on Engadget

Engadget’s guide to Home Entertainment

Engadget’s guide to Home Entertainment

View
Logitech unveils its first mouse and keyboard built for Chrome OS

Logitech unveils its first mouse and keyboard built for Chrome OS

View
'Control' will let you photograph its beautiful Brutalist setting

'Control' will let you photograph its beautiful Brutalist setting

View
Google's Daydream VR experiment is over

Google's Daydream VR experiment is over

View
Here's everything Google announced at the Pixel 4 event

Here's everything Google announced at the Pixel 4 event

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr