Latest in Gear

Image credit:

Google explains the science behind the Pixel 4's Portrait Mode

It uses both dual cameras and dual pixels for better depth estimation.
Georgina Torbet, @georginatorbet
December 17, 2019
Share
Tweet
Share

Sponsored Links

Engadget

Google's latest flagship phone, the Pixel 4, is renowned for its exceptional camera software. If you're curious about how that was achieved, Google has revealed more about how Portrait Mode works, describing how its dual-pixel auto-focus system functions.

Portrait Mode takes images with a shallow depth of field, focusing on the primary subject and blurring out the background for a professional look. It does this by using machine learning to estimate how far away objects are from the camera, so the primary subject can be kept sharp and everything else can be blurred.

In order to estimate depth, the Pixel 4 captures an image using two cameras, the wide and telephoto cameras, which are 13 mm apart. This produces two slightly different views of the same scene, which, like information from human eyes, can be used to estimate depth. In addition, the cameras also use a dual pixel technique in which every pixel is split in half and is captured by a different half of the lens to give even more depth information.

Using both dual cameras and dual pixels allows a more accurate estimation of the distance of objects from the camera, which leads to a crisper image. Machine learning is used to determine how to weight the different outputs for the best photo.

Dual pixels vs dual cameras

In addition, Google has also improved the bokeh or blurred background effect. Previous, bokeh blurring was performed using a technique called tone mapping which makes shadows brighter relative to highlights. This lowers the overall contrast of the image, however. So for Portrait Mode, the software first blurs the raw image and then applies tone mapping, which makes the background nicely blurred but also as saturated and rich as the foreground.

You can read more about the improvements to the camera AI on Google's AI blog.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
Tweet
Share

Popular on Engadget

NBCUniversal’s Peacock launches today: Here’s what you need to know

NBCUniversal’s Peacock launches today: Here’s what you need to know

View
Sony exec touts PS5 exclusive games while Xbox pushes 'choice, value'

Sony exec touts PS5 exclusive games while Xbox pushes 'choice, value'

View
Is there a good reason to buy the Apple Watch Series 5 ?

Is there a good reason to buy the Apple Watch Series 5 ?

View
Samsung Galaxy Tab S6 Lite review: Just a really good Android tablet

Samsung Galaxy Tab S6 Lite review: Just a really good Android tablet

View
Oppo's Evangelion phone is surprisingly faithful to the anime

Oppo's Evangelion phone is surprisingly faithful to the anime

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr