gaze
Latest
Apple's new iOS 13 feature corrects your gaze during video calls
A video call is a great way to connect with friends and family when you can't physically be together. But even if you're staring directly at your loved one's face, there's still something a little off about the whole process. The way your phone's screen display and camera lens sync up means you're never quite able to look your conversational partner squarely in the eye. Until now, that is. Apple is allegedly working on a new feature that subtly adjusts your gaze during video calls, so it appears as if you're looking into the camera when you're actually looking at the screen.
Google patent would track objects within your gaze
Google already has a patent that would let Glass and other eyewear identify what's in front of you. However, it just received a new patent for a method that could follow your exact gaze. The proposed system would include both forward-facing and eye-tracking cameras, correlating both to determine what's grabbing your attention. It could gauge emotional responses to objects by watching for pupil dilation, and it could be used to charge advertisers based on how long wearers stare at a given ad. Google may also have an eyepiece upgrade to go along with its gaze detection, we'd note -- the company just received a patent for a quantum dot-based eye display. There's no evidence that Google will use either of these new inventions anytime soon, but we wouldn't be surprised if they represent what Glass could look like a few generations from now.
Tobii REX brings Gaze eye-tracking tech to any Windows 8 machine
Tobii may not be a household brand name yet, but that doesn't make the company's eye-tracking technology any less impressive. At last year's CES we got an opportunity to preview Gaze UI, an interface that allowed us to navigate, zoom, select and scroll on a proprietary Windows 8-enabled laptop with just our pupils and a touchpad; this year, Tobii is introducing the REX, a USB-connected peripheral that adds these features to any Windows 8 PC. The device, slightly larger than a pen, adheres to the base of any PC monitor and can be integrated with other existing controls such as the keyboard, mouse or touchpad. Though this may sound quite similar to the PCEye launched in 2011, it's different in that the REX isn't intended for use as an assistive technology, so you'll still need to keep that mouse and trackpad around. Consumer pricing and availability haven't been announced, but Tobii plans to offer 5,000 units to consumers before the end of 2013; for developers, however, a special edition (seen above) should be available starting today for $995.
Tobii, Fujitsu and NTT DoCoMo partner on eye tracking ibeam tablet, promise a peek in October
Tobii's eye tracking Gaze UI hasn't been especially portable so far, but we'll soon see that change through a new collaboration involving Fujitsu and NTT DoCoMo. The trio plan to reveal the ibeam, an Android tablet with Tobii's smaller IS20 (formerly the IS-2) detector taking input just through glances. Together, the partners want to show that an eye-driven interface can be more reactive than plain old multi-touch: think turning a page in an e-book while you're holding on to a subway car strap. We're only getting a brief preview as of today, but we're teased with the prospect of a full look at NTT DoCoMo's CEATEC booth in early October. Whether or not ibeam leads to more than a well-that's-nice prototype, though, is still up in the air.
Microsoft applies to patent gaze-tracking camera, wants to stare into your eyes
See that complication of a line-drawing above? Well that's Microsoft describing how it would like to patent a function for a dual 3D and 2D camera setup that's able to process precisely where your eyes fall on a screen. While Kinect could fulfill that hardware component, the application goes into more detail on how the "gaze tracker" would calculate both the direction you're looking in and track the region of the screen that you're focusing on. It aims to do this by closely following your eye -- more specifically the pupil and iris -- with some attention also paid to monitoring the orientation of your head. The Mountain View crew aren't too specific with the remit for the notion, but it could follow similar lines to an Apple patent application we've seen previously -- heck, it could even lead to some eyeball-based UI navigation. Let your mind wander over the possibilities and stare at the full application at the source below.
Tobii EyeAsteroids 3D lets you destroy virtual space stones with a gaze, we go eyes-on (video)
We've touched and tapped our way through a variety of gadgets at CeBIT, but it's the devices that operate without traditional user interfaces that have really grabbed our focus. Tobii was on-hand to demonstrate its eye-tracking technology earlier this year at CES, but the company is peddling its wares here in Hannover as well, and we decided to drop by for a second look. This time, it's all about gaming, with EyeAsteroids drawing quite a bit of attention on the show floor. The demo pairs Tobii with a SeeFront glasses-free 3D panel for a fairly engaging extraterrestrial shootout. We weren't really sold on the glasses-free 3D, unfortunately, which provides the same unconvincing three-dimensional image from any angle, but Tobii was spot-on, letting us hone in on those infamous space rocks to save our planet from destruction without even raising a finger.Like SeeFront's display, you're able to make visual selections from any angle (within reason) just as easily as you can from directly in front of the panel. There's a seconds-long calibration process each time you start the game, so Tobii can locate your eyes and pair your pupil orientation with a target on the screen. After that, it's open season -- you simply focus on an asteroid to destroy it, and you can add your name to the leader board and navigate menus as well, just as we saw with the Windows 8 demo back at CES. Is this the future of gaming? That remains to be seen, and while the eye-tracking seemed to work just as described, old school gamers will likely prefer tilting a joystick and (violently) tapping on arcade buttons. We still had a lot of fun playing without using our hands, though, as you'll see in our glare-filled demo just past the break.%Gallery-150214%
Tobii Gaze UI eyes-on (video)
We know what you're thinking: another CES post about Tobii's eye-tracking Gaze UI? Why yes, yes it is, because this time we were actually the ones behind the driver's seat. We tracked down the company's booth and got some personal one-on-one time with the laptop. As the first matter of business, we first needed to calibrate our eye movements with the sensor, a process that took a couple minutes to push through before we were ready to have at it. The prototype laptop is running an early build of Windows 8, so we navigated around the Metro interface, played a couple games, switched back and forth between tabs, zoomed in and out of screens and plenty more. Eye-tracking technology hasn't been around for incredibly long, and it still has a ways to go. There were a few occasions -- seen in the video below the break -- in which we tried to hit a smaller button several times before finally finding success. Bugs aside, we got the hang of the interface pretty fast after a few minutes of getting accustomed to the concept of using our eyes as the cursor. That doesn't mean we were completely used to it by the time we left the booth, but we could see how eye-tracking can come in handy at times. But it wasn't all Mission: Impossible as we'd secretly hoped. Contrary to our original expectations, we discovered that using the trackpad was still an integral and necessary part of the full experience; it wasn't a "blink twice to click" type of interface. Tobii tells us that by still using the trackpad to click on the screen (minus dragging your finger around as the cursor), you still have a natural user experience, since you're quickly able to use your fingers to scroll or click and override the movement of your eyes if absolutely necessary. We found it easy to switch back and forth between tabs and zoom in and out of pictures -- heck, we even were able to play games on the laptop by using our eyes, though admittedly we performed rather lousy and lost every time since many games require a certain amount of precision. That's obviously a situation that would call for the ability to override the eye-tracker and switch to manual mode, of course. All in all, we were very impressed to see how far the technology has come so far, and as Tobii is still in the early stages of implementing eye-tracking into the latest laptops -- CES is the company's first time showing it off in public, after all -- we're incredibly excited to see how it looks once it's all polished up. We've got plenty of pictures and a video to show off, so continue below to take a look. See what we did there?
Tobii's Gaze interface lets you use your eyes to move a cursor, perform gestures in Windows 8 (video)
We've seen gesture control, but how about an input device that lets you stare your PC into submission? That's the basic gist of Tobii's Gaze UI, an early version of which is on display here at CES, and which will eventually help doctors and other professionals skim through data just by looking at it. When this becomes available, likely in a year or so, customers will need some requisite hardware (read: that conspicuous eye tracking strip you see up there) and, of course, software that can take advantage of it. Got it? Good. Here's the elevator pitch: using your eyes, you can move the cursor around the screen, select objects, scroll and pinch to zoom. But if you imagined looking at your Firefox shortcut and blinking twice to open it, you'd be sorely disappointed: though you can use your eyes to drag the cursor, you'll still need to keep a finger on your touchpad. For instance, once you direct your eyes to a certain part of a webpage, you'll need to use two fingers to zoom in, as you normally would. Really, then, this is saving you from having to bear down on your clickpad, so for now, at least, your fingers can keep their day job.
Students create affordable eye-tracking tablet for the disabled
Disabled users have long been able to control computers with just the flick of an eye, but those hardware and software packages are prohibitively expensive. Heck, the surprisingly accurate Tobii PCEye is a veritable steal at $6,900. And, while we can't vouch for its usability, engineering students at Brigham Young University have managed an impressive feat, by whipping up an eye-tracking Windows 7 tablet that costs under $1,500. The system was created as part of a partnership with EyeTech Digital Systems, which plans to market the devices in parts of the world where other eye-tracking solutions are unaffordable -- like just about anywhere the roads aren't paved with gold. We could even see a few able-bodied (but incredibly lazy) bloggers getting some use out of this -- mornings around here would be a lot easier if we could double-fist piping hot coffee mugs while typing with our eyeballs.
Gaze Interaction interface tweaked for gaming
Remember that Gaze prototype we showed you, oh, not even a week ago? Turns out, a similar setup has received a healthy amount of funding from the EU, and unlike sluggish systems of the past, this one may enable people with severe motor disabilities to engage in 3D gaming. Communication by Gaze Interaction (COGAIN) is designed to speed up the eye-computer interfacing by recognizing when users look off screen; in doing so, the system can switch between modes or perform any number of tasks not easily accomplished by simply peering in a different direction. Reportedly, Stephen Vickers (the creator of this fantastic stuff) is hoping to begin software trials within the next dozen months, though future implementation still remains somewhat fuzzy at the moment.[Thanks, Iddo]
Video: NeoVisus Gaze prototype enables handsfree computer control
If you're tired of worrying about carpal tunnel syndrome setting in and ruining your ability to surf the intarwebz, Martin Tall is cooking up an alternative to the tried-and-true mouse / keyboard control combo. The NeoVisus Gaze prototype, quite simply, enables computer users to control the action on screen with just their eyes. Granted, this setup works entirely better when viewing photos than, say, typing up a thesis -- but there's always voice recognition software for that, right? Check out the demonstration video below.
