Latest in Science

Image credit:

Google DeepMind AI learns to play 'Montezuma's Revenge'

The team programmed artificial curiosity into the AI.
506 Shares
Share
Tweet
Share
Save

Sponsored Links

Back in 2015, Google-owned company DeepMind gave its AI access to a series of Atari 2600 games, 49 of which it learned to play its own. One particular title was a bit too complicated for the technique it used, though: Montezuma's Revenge. Now, the team has figured out how to make it "curious" enough to want to win the game. They programmed artificial curiosity into the AI by giving it rewards for exploring more of the platformer's world. The version of the AI programmed with artificial curiosity managed to explore 15 rooms out of 24 and to beat the first room in only four tries. An older model that didn't have incentive to play the game more only explored two rooms.

In the study they published, the team wrote that adopting a built-in rewards system "significantly improved exploration in a number of hard games, including the infamously difficult Montezuma's Revenge." Okay, you might not find it "infamously difficult," but it's tough for an AI to plan for the traps (and the platformer has plenty) that lie ahead.

You can read the team's paper if you want to know more about the technique, but the video below can show you how the AI tackled the game. DeepMind, if you'll recall, is also behind AlphaGo, the program that bested Korean Go grandmaster Lee Sedol in four games out of five.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
506 Shares
Share
Tweet
Share
Save

Popular on Engadget

The best consoles, games and accessories for students

The best consoles, games and accessories for students

View
Tesla's solar panels reportedly caught fire at an Amazon warehouse

Tesla's solar panels reportedly caught fire at an Amazon warehouse

View
Recommended Reading: Taylor Swift and Spotify are... best friends?

Recommended Reading: Taylor Swift and Spotify are... best friends?

View
Hitting the Books: We can engineer the Earth to fight climate change

Hitting the Books: We can engineer the Earth to fight climate change

View
The Morning After: Hands on with Disney+ 4K and HDR streaming

The Morning After: Hands on with Disney+ 4K and HDR streaming

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr