Latest in Tomorrow

Image credit:

AI adds background noise to Google Street View scenes

It’s thanks to a pair of neural networks that analyze scenes and provide an appropriate soundtrack.
Share
Tweet
Share

Sponsored Links

Imaginary Soundscapes

Google Street View is a great way to imagine you're somewhere else, walking the streets of a bustling foreign city or making your way through a quiet, tree-lined neighborhood. Now, thanks to a project from Nao Tokui, it's become even more immersive. He's put together a feature called Imaginary Soundscapes that creates background noise based on what you're looking at in Google Street View. It's a soundtrack for your virtual walks that was first identified by the Tumblr user Prosthetic Knowledge.

Imaginary Soundscapes works by using two different neural networks. One is able to identify the content within the different Street View images, while the other can pinpoint audio and separate the sounds and acoustics of the environment. Tokui has put both together for this project; the two neural networks can find open source audio and play it in the background, based on what you're looking at in Google Street View. For example, on an residential street in a busy Washington, DC, urban neighborhood, I heard an imagined soundtrack of buses, cars and people chatting as they walked by.

You can give it a try yourself at Imaginary Soundscapes' website; it only works on PC in Chrome and Firefox, though I was able to access it in Chrome on a Mac. By default the site takes you to a random location. You have a choice to input your own street address or visit another random place. The sound will play automatically.

It's not perfect, of course. Fast Co.Design points out that in the quiet, grass-filled fields of Tokyo Stadium, there are the sounds of cars zooming by. Regardless, it's a pretty cool AI. You can go more in depth into how it works at the creator's Medium post and a short paper for a workshop on Machine Learning and Design.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
Tweet
Share

Popular on Engadget

Roku is giving away 30 days of premium video

Roku is giving away 30 days of premium video

View
NASA warns Moon base plans might slip by a year

NASA warns Moon base plans might slip by a year

View
Lab-in-a-box test can detect COVID-19 in 5 minutes

Lab-in-a-box test can detect COVID-19 in 5 minutes

View
Russia busts card fraud ring that included an infamous hacker

Russia busts card fraud ring that included an infamous hacker

View
SpaceX launches its original Dragon capsule for the last time

SpaceX launches its original Dragon capsule for the last time

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr