Latest in Gear

Image credit: MIT CSAIL

Robots learn to understand the context of what you say

You don't have to explicitly identify what you're talking about.
543 Shares
Share
Tweet
Share
Save

Sponsored Links

MIT CSAIL

It can be frustrating when telling robots what to do, especially if you aren't a programmer. Robots don't really understand context -- when you ask them to "pick it up," they don't usually know what "it" is. MIT's CSAIL team is fixing that. They've developed a system, ComText, that helps robots understand contextual commands. Effectively, researchers are teaching robots the concept of episodic memory, where they remember details about objects that include their position, type and who owns them. If you tell a robot "the box I'm putting down is my snack," it'll know to grab that box if you ask it to fetch your food.

In testing with a Baxter robot, ComText understood commands 90 percent of the time. That's not reliable enough to be used in the field, but it shows that the underlying concept is sound.

Of course, robots are still a long way from understanding all the vagaries of human language. They won't know what you see as a snack unless you teach them first, for instance, and CSAIL wants to address this with future work. However, it's already evident that systems like ComText will be crucial to making autonomous robots useful in the real world, where people generally don't want (or expect) to issue explicit commands every time they need something done. You could speak to robot helpers almost as if they were human, rather than carefully choosing your words.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
543 Shares
Share
Tweet
Share
Save

Popular on Engadget

Engadget's Guide to Privacy

Engadget's Guide to Privacy

View
Pocket Casts will give existing desktop customers Plus for life

Pocket Casts will give existing desktop customers Plus for life

View
Verizon will bring its 5G network to NYC on September 26th

Verizon will bring its 5G network to NYC on September 26th

View
Switch Lite review: The best way to play on the go

Switch Lite review: The best way to play on the go

View
Amazon plans to hit Paris climate change goals 10 years early

Amazon plans to hit Paris climate change goals 10 years early

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr