Boston has become the second-largest city in the US to bar police and other local agencies from using facial recognition software (via WBUR). The city's 13-member council voted unanimously to ban the technology outside of use in specific criminal cases. The bill also prevents any city official from obtaining the technology through a third-party.
Done--13-0 Vote! Thank you @ACLU_Mass @Join_SIM @UnafraidBTU & everyone who organized to protect Boston residents from racially discriminatory & invasive face surveillance technology cc: @RicardoNArroyo https://t.co/SrLUTYHh2Q
— Michelle Wu 吳弭 (@wutrain) June 24, 2020
The bill was put forward in part to protect the city's minority residents. "Boston should not use racially discriminatory technology that threatens the privacy and basic rights of our residents," said councilor Michelle Wu, who co-sponsored the bill alongside councilor Ricardo Arroyo. Ahead of the vote, the two officials contested the technology is widely inaccurate at identifying people of color.
The ban comes after software called DataWorks Plus and human error led to the wrongful arrest of a Black man in Detroit. Police arrested Robert Williams after the software incorrectly matched his driver's license photo to security footage from the scene of a burglary. The incident is the first known instance of a wrongful arrest in the US based on an incorrect facial recognition match, according to the American Civil Liberties Union (ACLU). However, research suggests most facial recognition software isn't great at correctly identifying people of color. A 2018 MIT study, for instance, found that three commercially available programs incorrectly identified dark-skinned women as much as 34.7 percent of the time.
"This is a crucial victory for our privacy rights and for people like Robert Williams, who have been arrested for crimes they didn't commit because of a technology law enforcement shouldn't be using,” said ACLU of Massachusetts executive director Carol Rose. “Lawmakers nationwide should follow suit and immediately stop law enforcement use of this technology. This surveillance technology is dangerous when right, and dangerous when wrong."
It's worth pointing out that once Boston Mayor Marty Walsh signs the bill into law, it won't prevent federal agencies like the FBI from using the tech while conducting investigations in the city. Still, with cities like San Francisco and Boston limiting the use of the technology, other jurisdictions may do the same.