Latest in Gear

Image credit: ASSOCIATED PRESS

Facebook open-sources its Horizon AI platform

The system has been used to personalize M suggestions, customize notifications and optimize video.
537 Shares
Share
Tweet
Share
Save

Sponsored Links

ASSOCIATED PRESS

If you could crack open Facebook and see the gears turning under the social network's face, you'd find a surprising amount of artificial intelligence being applied in all sorts of ways. As of today, the company is pulling back the curtain and making Horizon -- the company's end-to-end applied reinforcement learning platform that helps fine-tune that AI -- open source.

Reinforcement learning is a commonly used tool in machine learning to teach a wanted behavior. It works by rewarding desirable behaviors while discouraging undesirable ones. Facebook has used Horizon in a number of its applications in an attempt to better serve its users. According to the company, Horizon has helped personalize suggestions from M, the virtual assistant that appears in Messenger. It also has used Horizon to fine-tune notifications and optimize streaming video quality.

By taking Horizon open source, Facebook is hoping to see reinforcement learning applied in new ways. The method is typically used in robotics and games. Google used reinforcement learning to teach its DeepMind AI how to navigate a virtual parkour course and researchers at UC Berkeley used the method to teach computers to be curious. Facebook believes it could also help improve large-scale systems and applications.

Specifically, the company believes the reinforcement learning platform can prove helpful in dealing with massive data sets. Machine learning systems typically require engineers to create hand-crafted policies to take specific actions -- they need to know what outcome they are trying to achieve before making decisions. Reinforcement learning, on the other hand, can make decisions and adapt its actions based on feedback.

Because Horizon was built on open frameworks including PyTorch 1.0, Caffe2 and Spark, it should be available to just about anyone who wants to get their hands on it. Facebook believes Horizon is the first "open-source end-to-end platform that uses applied reinforcement learning (RL) to optimize systems in large-scale production environments." If you'd like to play around with it, you can clone Faecbook's Horizon GitHub repository and try it out.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
537 Shares
Share
Tweet
Share
Save

Popular on Engadget

The best consoles, games and accessories for students

The best consoles, games and accessories for students

View
OnePlus TV will run ‘optimized’ Android TV software

OnePlus TV will run ‘optimized’ Android TV software

View
China's latest retaliatory tariffs could pose trouble for Tesla

China's latest retaliatory tariffs could pose trouble for Tesla

View
'World's first' solar-powered rail line opens in the UK

'World's first' solar-powered rail line opens in the UK

View
'El Hijo' is a Spaghetti Western stealth game with heart

'El Hijo' is a Spaghetti Western stealth game with heart

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr