Sponsored Links

Google is working on a kill switch to prevent an AI uprising

But it isn't ready to be implemented across the board just yet.
Timothy J. Seppala
Timothy J. Seppala|@timseppala|June 3, 2016 8:09 PM

Humans don't like the idea of not being at the top of the food chain; having something we've created taking power over us isn't exactly ideal. It's why folks like Tesla mastermind Elon Musk and noted astrophysicist Stephen Hawking are so determined to warn us of the terrifying implications that could culminate in a Skynet situation where the robots and algorithms stop listening to us. Google is keen to keep this sort of thing from happening, as well, and has published a paper (PDF) detailing the work its Deep Mind team is doing to ensure there's a kill switch in place to prevent a robocalypse situation.

Essentially, Deep Mind has developed a framework that'll keep AI from learning how to prevent -- or induce -- human interruption of whatever it's doing. The team responsible for toppling a word Go champion hypothesized a situation where a robot was working in a warehouse, sorting boxes or going outside to bring more boxes in.

The latter is considered more important, so the researchers would give the robot a bigger reward for doing so. But human intervention to prevent damage is needed because it rains pretty frequently here. That alters the task for the robot, making it want to stay out of the rain, and then adopting the human interruption as part of the task rather than being a one-off thing.

"Safe interruptibility can be useful to take control of a robot that is misbehaving and may lead to irreversible consequences, or to take it out of a delicate situation, or even to temporarily use it to achieve a task it did not learn to perform or would not necessarily receive rewards for this," the researchers write.

Turn on browser notifications to receive breaking news alerts from Engadget
You can disable notifications at any time in your settings menu.
Not now

Deep Mind isn't sure that its interruption mechanisms could be applicable to all algorithms. Specifically? Those related to policy-search robotics (a part of machine learning), so it sounds like there's still a ways to go before the kill switch can be implemented across the board. Sleep tight.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission. All prices are correct at the time of publishing.
Google is working on a kill switch to prevent an AI uprising