Latest in Tomorrow

Image credit: Changde Du et. al.

Neural network learns to reproduce what your brain sees

New algorithms can recreate the images in your mind with uncanny accuracy.
1405 Shares
Share
Tweet
Share
Save

Sponsored Links

Changde Du et. al.

Scientists dream of recreating mental images through brain scans, but current techniques produce results that are... fuzzy, to put it mildly. A trio of Chinese researchers might just solve that. They've developed neural network algorithms that do a much better job of reproducing images taken from functional MRI scans. The team trains its network to recreate images by feeding it the visual cortex scans of someone looking at a picture and asking the network to recreate the original image based on that data. After enough practice, it's off to the races -- the system knows how to correlate voxels (3D pixels) in scans so that it can generate accurate, noise-free images without having to see the original.

You can see the results for yourself in the comparison above. The new technique, DGMM (Deep Generative Multiview Model), is very nearly on par with the source material. Virtually all the other approaches are so imprecise and noisy that many of their results are either difficult to read or just plain wrong.

This initial foray revolved around people staring at simple images. There's much more work to be done before it's clear this method works for complex images and videos -- you know, real life. Still, the breakthrough hints at a bright (if slightly creepy) future for brain image recreation. It could help with brain-controlled devices, for example, or help doctors understand mental health issues based on dreams or hallucinations.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
1405 Shares
Share
Tweet
Share
Save

Popular on Engadget

The best consoles, games and accessories for students

The best consoles, games and accessories for students

View
A first look at Disney+

A first look at Disney+

View
Disney+ confirms 'Ms. Marvel,' 'She-Hulk' TV shows in the works

Disney+ confirms 'Ms. Marvel,' 'She-Hulk' TV shows in the works

View
US book publishers sue Audible over AI-powered transcription

US book publishers sue Audible over AI-powered transcription

View
Netflix test brings human-curated 'Collections' to streaming

Netflix test brings human-curated 'Collections' to streaming

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr