Latest in Gear

Image credit:

Google can use machine learning to identify objects in videos

All the fun of image recognition applied to massive media databases.
David Lumb, @OutOnALumb
March 8, 2017
Share
Tweet
Share

Sponsored Links

Paul Hanna / Reuters

You've been able to use a reverse Google search to hunt down similar photos on the internet for years thanks to image recognition and processing tools, but only for static pictures. Today, at Google Cloud Next '17, the search giant unveiled a new API that uses machine learning to search within videos for nouns and verbs occurring therein. Finally, you'd be able to hunt down that one movie about the guy who does the thing.

The Cloud Video Intelligence API is now in a private beta, meaning companies will get their hands on it long before you can use it to hunt down esoterica on YouTube. At this point, it is an enterprise solution, a deep-learning tool built on frameworks like TensorFlow that companies can use to parse through their stored videos and extract metadata. If you wanted to hunt through your vast media collection to hunt down "tiger," for example, you'd get a result like this:

The API searches for "entities" like nouns found in videos and indicates when that object appears. It can even detect when scenes change. Companies have must store their media on Google Cloud Storage to run the annotating software, but getting onboard with their cloud suite would be a decent idea, given that Apple, Evernote and Spotify started using the search giant's Cloud platform this year. Don't expect the intricate search functions to find their way into YouTube just yet, but as with most of Google's tinkering with parsing data, it will probably find its way into your life soon.

In this article: api, gear, google, internet, metadata, search
All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
Tweet
Share

Popular on Engadget

The 2020 Engadget Holiday Gift Guide

The 2020 Engadget Holiday Gift Guide

View
The best laptop deals we found for Cyber Monday

The best laptop deals we found for Cyber Monday

View
Apple's MacBook Air M1 drops to $899 for Cyber Monday

Apple's MacBook Air M1 drops to $899 for Cyber Monday

View
The best Cyber Monday tech deals that are worth your money

The best Cyber Monday tech deals that are worth your money

View
Volkswagen may release a small EV for as little as $24,000

Volkswagen may release a small EV for as little as $24,000

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr