Latest in Gear

Image credit:

Senate bill would make tech companies test algorithms for bias

It could address discrimination in tech, but questions remain.
Share
Tweet
Share

Sponsored Links

AP Photo/Steven Senne

It's well established that algorithms can exhibit bias, however inadvertently, and a trio of US politicians believe they can do something about it. Senators Cory Booker, Yvette Clarke and Ron Wyden have introduced an Algorithmic Accountability Act that would require larger companies to test their algorithms and fix anything "inaccurate, unfair, biased or discriminatory." The move would also ask them to study how their systems protect personal data,and would let the FTC create regulations mandating impact studies for "highly sensitive" automated systems.

The bill would only apply to companies that either make more than $50 million per year or have data for at least one million people or devices. Small businesses would theoretically be safe.

The senators saw this as a civil rights issue and pointed to recent incidents as examples. Facebook is still facing a charge of housing discrimination after it let advertisers exclude people in ways that could be racist or sexist, while Amazon shut down an automated recruiting tool after it was found discriminating against women. Facial recognition also has bias problems. It's a modern form of practices like "real estate steering" (where black couples were discouraged from getting homes in some neighborhoods), Sen. Booker said, but more insidious as it's "significantly harder to detect." In theory, this would prevent companies from ignoring the potential for bias.

There's no guarantee the bill will become law, and there are questions as to how well it would work. Would a company still be held responsible if a biased algorithm slipped through the cracks? What if an algorithm doesn't cover potentially biased data? As helpful as the legislation might be in ensuring fairness, it could also lead to some uncertainty and added overhead that might not always be necessary.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Share
Tweet
Share

Popular on Engadget

Waymo’s fifth-generation Driver can peek around blind spots

Waymo’s fifth-generation Driver can peek around blind spots

View
Volkswagen confirms that its first crossover EV will be the ID.4

Volkswagen confirms that its first crossover EV will be the ID.4

View
'iPhone SE 2020' rumored to launch soon

'iPhone SE 2020' rumored to launch soon

View
NASA successfully deploys the James Webb Telescope's enormous mirror

NASA successfully deploys the James Webb Telescope's enormous mirror

View
Sony indefinitely delays ‘The Last of Us Part II’

Sony indefinitely delays ‘The Last of Us Part II’

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr