Banjo AI surveillance is already monitoring traffic cams across Utah

What could possibly go wrong?

A small company called Banjo is bringing pervasive AI surveillance to law enforcement throughout Utah, Motherboard reports. In July, Banjo signed a five-year, $20.7 million contract with Utah. The agreement gives the company real-time access to state traffic cameras, CCTV and public safety cameras, 911 emergency systems, location data for state-owned vehicles and more. In exchange, Banjo promises to alert law enforcement to "anomalies," aka crimes, but the arrangement raises all kinds of red flags.

Banjo relies on info scraped from social media, satellite imaging data and the real-time info from law enforcement. Banjo claims its "Live Time Intelligence" AI can identify crimes -- everything from kidnappings to shootings and "opioid events" -- as they happen.

Banjo presents many of the same concerns that similar companies have encountered. One of the strongest arguments against surveillance practices by Clearview AI has been that the company's data storage and security protocols were untested and unregulated. As Clearview AI proved earlier this month, that can lead to massive data leaks. According to Motherboard, Banjo says it removes all personal data from its system, but how and how well it does this remain unclear.

There are also concerns about the lack of public oversight and rampant potential for abuse. Plus, facial recognition is still biased. It's not as good at interpreting black and brown faces as it is at interpreting white faces, and for that reason, some law enforcement companies have opted not to use it.

The contract between Banjo and Utah says the technology will be deployed in all of Utah's 29 counties, its 13 largest cities and 10 other cities with "significant relevance," as well as the University of Utah. So far, Motherboard hasn't been able to track down a single case that Banjo's technology helped on, but that doesn't meant the tech hasn't been put to use.