Latest in Tomorrow

Image credit: Facebook Reality Labs

Facebook researchers are building virtual spaces to improve AI and AR

Replica and AI Habitat are the latest from Facebook AI and Facebook Reality Labs.
691 Shares
Share
Tweet
Share
Save

Sponsored Links

Facebook Reality Labs

Will virtual assistants be able to tell the difference between your living room and your kitchen? Or even help you find a missing book or set of keys? With embodied AI -- which relies on data from physical surroundings -- they soon might. Facebook has unveiled an open-source simulation and dataset it hopes will help researchers create more realistic AR and VR, and eventually virtual assistants that can learn about your physical surroundings.

Facebook created a new open platform for embodied AI research called AI Habitat, while Facebook Reality Labs (which up until last year was Oculus Research) released a dataset of photorealistic sample spaces it's calling Replica. Both Habitat and Replica are now available for researchers to download on Github. With these tools, researchers can train AI bots to act, see, talk, reason and plan simultaneously. The Replica data set is made of 18 different sample spaces, including a living room, conference room and two-story house. By training an AI bot to respond to a command like "bring my keys" in a Replica 3D simulation of a living room, researchers hope someday it can do the same with physical robots in a real-life living room.

A Replica simulation of a living room is meant to capture all the subtle details one might find in a real living room, from the velour throw on the sofa to the reflective decorative mirror on the wall. The 3D simulations are photo-realistic; even surfaces and textures are captured in sharp detail, something Facebook says is essential to training bots in these virtual spaces. "Much as the FRL research work on virtual humans captures and enables transmission of the human presence, our reconstruction work captures what it is like to be in a place; at work, at home, or out and about in shops, museums, or coffee shops," said Richard Newcombe, a research director at Facebook Reality Labs, in a blog post.

Some researchers have already taken Replica and AI Habitat for a test-drive. Facebook AI recently hosted an autonomous navigation challenge on the platform. The winning research team will be announced Sunday at this year's Conference on Computer Vision and Pattern Recognition (CVPR).

Facebook Reality Labs

Source: Facebook, Facebook
In this article: ai, ar, design, embodied ai, robots, tomorrow, vr
All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
691 Shares
Share
Tweet
Share
Save

Popular on Engadget

Engadget's Guide to Privacy

Engadget's Guide to Privacy

View
iFixit's iPhone 11 Pro Max teardown investigates charging rumors

iFixit's iPhone 11 Pro Max teardown investigates charging rumors

View
TiVo wants to make a comeback with $50 Android TV dongle

TiVo wants to make a comeback with $50 Android TV dongle

View
Neo Geo retro stick console includes 'King of Fighters,' 'Samurai Shodown'

Neo Geo retro stick console includes 'King of Fighters,' 'Samurai Shodown'

View
Watch the 'Android' Nokia phone that never had a chance to exist

Watch the 'Android' Nokia phone that never had a chance to exist

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr