Latest in Culture

Image credit:

Facebook's AI image search can 'see' what's in photos

Tags and text descriptions a thing of the past.
Billy Steele
02.02.17 in Internet
457 Shares
Share
Tweet
Share
Save

Sponsored Links

If you forget to tag or add a description when uploading a photo or gallery to Facebook, it can be tough to find an image when you need it. Or at least it used to be. The social network revealed today that it built an AI image search system that can "see" things in your photos even when you forget to add the aforementioned identifiers. Facebook says the system uses its Lumos platform to understand the content of photos and videos and quickly sort through the items you've uploaded.

This means that if even if you can't remember when a photo was taken, if you remember the content, you might still be able to find it with ease. Facebook gives the example of searching for "black shirt photo" and the system being able to "see" all of your photos with a black shirt, even if they aren't tagged as such. This also means that you'll be able to sort through photos your friends have shared to find what you're looking for rather than having to rely on tags and text descriptions.

Of course, for this to work Lumos has to be able to recognize objects when they appear in photos. Facebook developers used deep learning and a neural network to train the system to identify objects using tens of millions of photos with the proper annotations. By doing so, the image search can pick up on scenes, objects, animals, places, attractions and clothing items. The system also factors in some degree of diversity so the search results aren't a bunch of similar images. Not only is this handy with search, but it will also help Facebook describe images and video to users who are visually impaired.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
457 Shares
Share
Tweet
Share
Save

Popular on Engadget

Engadget's Guide to Privacy

Engadget's Guide to Privacy

View
AT&T reportedly considers offloading its DirecTV satellite unit

AT&T reportedly considers offloading its DirecTV satellite unit

View
T-Mobile’s Sprint merger is opposed by 18 state attorneys general

T-Mobile’s Sprint merger is opposed by 18 state attorneys general

View
HBO Max will revive 'The Boondocks' for a two-season run

HBO Max will revive 'The Boondocks' for a two-season run

View
Microsoft plans to bring broadband to 9 million more Americans

Microsoft plans to bring broadband to 9 million more Americans

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr