Apple patent application details method for detecting and displaying hand position on screen
![](https://s.yimg.com/ny/api/res/1.2/GzLYfhGdrnXNdY1WMIhoIQ--/YXBwaWQ9aGlnaGxhbmRlcjt3PTcwNTtoPTY3Mg--/https://s.yimg.com/uu/api/res/1.2/cn2DCF_j_f6io9y9UA0PRA--~B/aD0zODE7dz00MDA7YXBwaWQ9eXRhY2h5b24-/https://www.blogcdn.com/www.engadget.com/media/2012/09/applepat.jpg)
We've had a glimpse at Apple's conception of a sensor-based keyless layout, and the latest patent application from Cupertino shows the company looking to further refine the input experience -- this time using a camera and other sensors to detect hand position and overlay that hand position on a device's screen. The filing details three methods to this end. The first shows a user's hands on a traditional hardware keyboard projected in an on-screen representation (as background, Apple mentions the ergonomic strain of looking down to check your hand placement, so perhaps that's the thinking behind this one). A second scenario involves a laptop with unlabeled keys, where the marked keyboard is displayed on the screen, and the final, most intriguing, setup shows backside controls on a tablet a la the PS Vita, with a user's fingers projected as if the device was transparent. Of course, this is just a patent application at this point, so don't expect to see this tech make its debut September 12th.