Latest in Tomorrow

Image credit:

MIT researchers use shadows to create a video of what happens off camera

The shadows act like mirrors and could help self-driving cars see around corners.
Share
Tweet
Share

Sponsored Links

Corinna Dumat / EyeEm via Getty Images

In order for self-driving cars to park themselves, they'll need to be able to see around corners. A team from MIT's CSAIL may have a new way to do that. Using video footage of shadows, they've developed an algorithm that can recreate video of what's happening off the screen.

In their experiment, the team filmed a pile of clutter. Off screen, someone created shadows by moving blocks and other objects. Their algorithm predicted the light transport, or the way light is expected to move in a scene, and compared that to the shadows. It then used that info to reconstruct the off-screen video.

While the results of the work are still blurry and unrefined -- the reconstructed videos show color and motion but not detail -- the system could one day help self-driving cars detect what's happening around corners or improve search-and-rescue missions in obstructed areas.

This isn't the first time MIT has attempted to see around corners. This method improves upon that work because it doesn't require laser-powered cameras, and it can recreate an off-screen image using any video scene, not just video of changes in lighting on the floor. Next, the CSAIL team plans to improve the resolution of their reconstructed video and to test the video in uncontrolled environments.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
Tweet
Share

Popular on Engadget

Facebook inexplicably logs out iPhone users | Engadget

Facebook inexplicably logs out iPhone users | Engadget

View
Put Bernie Sanders almost anywhere with this Google Street View app

Put Bernie Sanders almost anywhere with this Google Street View app

View
Tesla accuses engineer of stealing crucial company software

Tesla accuses engineer of stealing crucial company software

View
Apple's Magic Keyboard for iPad drops to $199 at Amazon

Apple's Magic Keyboard for iPad drops to $199 at Amazon

View
Microsoft reverses Xbox Live price hike, will add free multiplayer for some games

Microsoft reverses Xbox Live price hike, will add free multiplayer for some games

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr