gesturecontrol
Latest
Microsoft Research crafts wrist-worn device that tracks hand gestures in 3D space (video)
A team led by researchers at Microsoft's UK-based R&D lab has crafted a system that tracks the full 3D pose of a user's hand without the need for a pesky glove. Dubbed Digits, the Kinect-inspired rig latches onto a user's wrist and utilizes a diffuse infrared light, IR laser, camera and inertial measurement unit to track fingertips and just five key points of a hand. Leveraging a pair of mathematical models developed in-house after studying the mechanics of the human hand, the group uses the captured data to extrapolate the position of a user's paw. The team envisions the solution as a supplement to touch-based interfaces, a method for eyes-free control of mobile devices and as a gaming controller that could work in conjunction with Kinect or similar systems. In its current state, the device is composed of off-the-shelf parts and needs to be tethered to a laptop, but the ultimate goal is to create a mobile, self contained unit the size of a wrist watch. Hit the break to catch a video of the setup in action or tap the second source link below for more details in the group's academic paper.
Pioneer's latest Raku Navi GPS units take commands from hand gestures
An AR heads-up display wasn't the only navigation hardware Pioneer showed off at CEATEC 2012. The firm also took the opportunity to tear the wraps off a new line of gesture-controlled Raku Navi GPS units. With the infrared-powered Air Gesture feature, drivers can wave their hand in front of a device to pull up a menu with commands such as setting their home or a personal haunt as a destination or skipping to the next tune on a playlist. Once a hand is retracted, the menu will be replaced with the usual map interface. Though the solution isn't completely hands-free, horizontal hand waves can be assigned one of ten different functions. Japanese store shelves will be lined with two dashboard-embeddable units by mid-October, while four console-independent models will join them in early November. As of now, there's no word if the hardware will make the pilgrimage stateside.
Akimbo Kinect hack offers precise control with minimal effort (video)
We've seen Microsoft's Kinect used in countless ways, but 3Gear Systems means to better these predecessors with the beta release of its SDK, which turns all the subtleties of hand movement into actions. In addition to using two Kinect cameras for accuracy, the software compares hand poses against a pre-rendered database so gesture commands are executed with little lag. It offers complete control of a virtual 3D environment from the comfort of your natural desk position, so you won't have to worry about flail fatigue after long stints. A free public beta is available now until November 30th, at which point bigger companies will require a license, while individuals and small enterprises will continue to get complimentary access. We know what you're thinking -- it's just another Kinect hack -- but we suggest you reserve judgment til you've seen the demo below, showing examples of how the API could be used for CAD, medical, and of course, gaming applications.
Chrome experiment explores new types of navigation, degrees of embarrassment
What you're about to see, should you choose to click the source link below, is far from perfect. On the other hand, it's clearly had a lot of effort and expertise put into it -- not only by HTML5-savvy coders, but also by a troupe of performers from the Cirque du Soleil. It's called Movi.Kanti.Revo, which is a fancy way of saying Move.Sing.Dream, and it involves navigating through an ethereal and slightly laggy landscape using only swaying gestures, your singing voice (mournful sobbing sounds also worked for us) and a bunch of APIs that conveniently fail to work on FireFox, Safari or Internet Explorer. It's well-suited to those with a mic and webcam, preferably sitting in a open-plan and bully-ridden workplace, and if you don't like it there's always Bastion.
Kinect Toolbox update turns hand gestures into mouse input, physical contact into distant memory
Using Microsoft's Kinect to replace a mouse is often considered the Holy Grail of developers; there have been hacks and other tricks to get it working well before Kinect for Windows was even an option. A lead Technical Evangelist for Microsoft in France, David Catuhe, has just provided a less makeshift approach. The 1.2 update to his Kinect Toolbox side project introduces hooks to control the mouse outright, including 'magnetic' control to draw the mouse from its original position. To help keep the newly fashioned input (among other gestures) under control, Catuhe has also taken advantage of the SDK 1.5 release to check that the would-be hand-waver is sitting and staring at the Kinect before accepting any input. The open-source Windows software is available to grab for experimentation today, so if you think hands-free belongs as much on the PC desktop as in a car, you now have a ready-made way to make the dream a reality... at least, until you have to type.
Leap Motion taps former Apple iAd VP Andy Miller to be President and COO
Apple's former iAd VP (and Quattro co-founder) Andy Miller only just took a job as a general partner at Highland Capital last year after leaving the gang in Cupertino, but he's now already moving on to another fairly high profile gig. Leap Motion has announced today that Miller will become its new President and CEO COO, placing him in a central role at a company that's facing the rather difficult task of actually delivering the goods after wowing most everyone with its new gesture control technology. As Fortune notes, however, the move doesn't come as a complete surprise. Highland Capital is backing Leap, and Miller himself has reportedly been spending about 80 percent of his time on the company over the past few months. In a statement, Miller said that he's "been fortunate to work with some of the most influential figures and companies in the technology industry, and I'm as excited about the Leap as I've ever been about a technology," adding that the "potential for the Leap is limitless, as it is going to fundamentally change the way we interact with so many devices in our lives." Update: Leap Motion has reached out and informed us that Miller will be President and COO, reporting to current CEO and co-founder Michael Buckwald. The official press release can be found after the break.
Amazon Audible hits WP 7.5, brings gesture controlled audiobooks (update)
It didn't land in the Marketplace yesterday as announced, but Amazon's Audible audio book app for Windows Phone 7.5 is now available for download. This Metro-fied version of the app is free to install (including some short samples to get you started), and signing in with your Amazon account lets you purchase any books that the service has on offer. Media can be controlled using a swipe gesture interface, and there are even varying levels of badges to reward how much of a book-worm you become. That said, we haven't been able to use the voice control functionally shown off by Microsoft at its Developers Summit is naturally a WP 8-only affair, so you won't find that feature here. If you're eager to get your literary listening on, you'll find a download and more info about the app at the source link below. Update: As many of you have pointed out in the comments, the voice control aspect is specific to Windows Phone 8. We've updated our language in the post to reflect this.
LG launches 'upgraded' SP820 Smart TV Upgrader box in June for about $170 US
Should you have the impulse to turn your dumb display into a full-fledged Smart TV, LG has revealed the second iteration of its Smart TV Upgrader box is ready to hit the marketplace. The original ST600 box was released last year, and this new SP820 was announced earlier this year at CES. It adds LG's Smart TV experience complete with Magic gesture and voice controlled remote to any HDTV with an HDMI input. There's access to both 2D and 3D streaming content from the internet, DLNA, Wi-Fi Direct and any new apps LG rolls out for its platform. Similar to Apple's TV box and the Roku family, it's a palm sized device intended for easy installations. An even smaller, stripped down SP520 version that supports fewer apps is already on shelves with a $120 MSRP, although sale prices range from $80 to $99. The SP is shipping in June for 199,000 won ($169 US), while there's no word yet on a US release, we'll probably wait to see if LG can add enough apps to compete as a third party before jumping in.
Leap Motion gesture control technology hands-on
Leap Motion unveiled its new gesture control technology earlier this week, along with videos showing the system tracking ten fingers with ease and a single digit slicing and dicing a grocery store's worth of produce in Fruit Ninja. Still, doubts persisted as to the veracity of the claim that the Leap is 200 times more accurate than existing tech. So, we decided to head up to San Francisco to talk with the men behind Leap, David Holz and Michael Buckwald, and see it for ourselves. Join us after the break to learn a bit more about Leap, our impressions of the technology, and a video of the thing in action.%Gallery-156126%
Hillcrest Labs takes its TV motion control system to China, becomes TCL's new best friend
It's only been a few days since Hillcrest Labs open sourced its Kylo web browser for TVs, and now the company's back with yet another announcement. Well, this time it's more about TCL who's just declared its top TV market share in China. Much like the Roku 2 and LG TVs with Magic Motion remote, Hillcrest's Freespace engine has been outted as the enabling technology behind TCL's recently announced V7500, a 3D smart TV series featuring a heavily customized Android 4.0.3 and a 7.9mm-thick bezel. This means users can interact with and play games on this slim TV via motion and cursor control on the remote (there's also voice control here but it doesn't look like Hillcrest has anything to do with it). There are no dates or prices just yet, but TCL better be quick as Lenovo's got something very similar ready to ship soon.
Leap Motion reveals super-accurate motion control tech, $70 device to change the UI game
In many respects, Microsoft has led the charge towards a future of gesture-based controls with its Kinect, and other tech giants like Samsung and Apple are getting in on the action, too. The move to motion controls isn't limited to the big boys, however. Leap Motion has created a new device, called the Leap, it claims is 200 times more accurate than existing technology and will take gesture controls to the next level. It's about the size of a pack of gum, and once connected to your computer via USB, it creates a eight-cubic-foot virtual workspace. Within that area, it tracks all ten of your fingers simultaneously to within 1/100 of a millimeter -- that level of accuracy allows for rudimentary gestures like pinch-to-zoom and more complex actions like manipulating 3D-rendered objects. Naturally, the company isn't telling much about the black magic making it happen, but Leap Motion claims that its software can be embedded in almost anything with an onboard computer, from phones to refrigerators. Users can customize it to suit their needs with custom gestures and sensitivity settings, in addition to chaining multiple Leap devices together to create a larger workspace. Plus, Leap Motion has created an SDK for devs to create Leap-compatible applications and an app discovery platform to distribute them to others. That means the Leap can work in a variety of use cases, from simply navigating your desktop to gaming and computer-aided design. The best part? Leap brings you this next-gen UX for a mere $69.99, and a select few can pre-order them now, with the full roll-out coming this winter. Full details follow in the PR below, and you can see the Leap in action in the videos after the break.
Samsung shows off production 55-inch OLED HDTVs at the 2012 World's Fair
We got a first hand look at Samsung's stunning 55-inch OLED HDTV prototypes earlier this year during CES, but now it's surprising the world by showing off the first mass produced ES9500 models at the 2012 World's Fair (which is apparently still a thing?) in Korea. Beyond the Smart Interaction voice and gesture control, Smart Content and Smart Evolution upgradeable dual-core CPU features found in its other high-end HDTVs, Samsung has also built in Smart Dual View technology. This lets users watch two different programs (2D) on one screen at the same time using the set's 3D glasses and sound fed through headphones. Since each pixel is individually lit, Samsung says its OLED tech has 20 percent better color reproduction than existing LED-backlit LCD HDTVs. There's still no word on exactly when these will ship and for how much, however with competition on the way from LG, these fresh-off-the-factory-line flat panels are a sign we won't be waiting long. Other than new display tech, Samsung also took the opportunity to officially announce bigger LCD models on the way in sizes from 60- to 75-inches. Check the galleries below for a few pictures straight from the expo, as well as our shots of the CES display. Update: According to the Associated Press, company officials expect it to go on sale in the second half of the year for over 10 million won, around $9,000 US. %Gallery-155121%
Huawei throws R&D dollars at gesture control, cloud storage, being more 'disruptive'
Undeterred by the fact that even humans struggle to interpret certain gestures, Huawei says it's allocating a chunk of its growing R&D budget to new motion-sensing technology for smartphones and tablets. The company's North American research chief, John Roese, told Computerworld that he wants to allow "three-dimensional interaction" with devices using stereo front-facing cameras and a powerful GPU to make sense of the dual video feed. Separately, the Chinese telecoms company is also putting development cash into a cloud computing project that promises to "change the economics of storage by an order of magnitude." Roese provided scant few details on this particular ambition, but did mention that Huawei has teamed up with CERN to conduct research and has somehow accumulated over 15 petabytes of experimental physics data in the process. Whatever it's up to, Huawei had better get a move on -- others are snapping up gesture recognition and cloud patents faster than you can say fa te ne una bicicletta with your hands.
Sony VAIO E Series 14P gets Ivy Bridge processor nudge, improved display
While they may not be the Sony ultrabooks we're still all itching to see, the company's E Series 14P laptops have reappeared with some Ivy Bridge bones. According to Sony Australia, the previously Intel Core i3 processor has been bulked up to a third-generation 2.1GHz Core i7-3612QM, capable of 3.1GHz with Turbo Boost. That's not the only difference, with the 14-inch display boosted to 1600 x 900 and a new choice between AMD'S Radeon HD 7670M or Intel's HD Graphics 4000 to provide the graphical horse power in the updated hardware. The aluminum-splashed laptops, priced at $1,500 AUD (around $1,608 USD), will still house Sony's Gesture Control functions. This should allow you to navigate around websites and media playback with some arm flailing -- provided you're using Microsoft perennials like Internet Explorer 9 and Windows Media Player. These updated specs are tinged with some (minor) bad news; it looks like the pink iteration won't be getting the same improvements seen on the black and white models. Regardless, monochrome fans can hit up the source for all the new details.
Sony unveils E Series 14P laptops with gesture-based controls
They may not be the thinnest or most powerful machines Sony's ever introduced, but the new trio hopes to catch a few hearts here and there. A follow-up to those flashy VAIOs we saw a while back, these E Series models are each packing a 14-inch, 1366 x 768 display, an Intel Core i3 2550M CPU with 4GB of RAM and your choice of AMD Radeon HD 7670M or Intel HD Graphics 3000 -- all while promising up to seven hours of battery life. Run-of-the-mill specs aside, Sony's Gesture Control feature will allow you to swipe between pages and adjust bits like music playback -- though, at the moment it only works with Windows Media Player, IE9, PowerPoint and PowerDVD. The company's yet to reveal the 14P's price tag, but in the meantime you can decide which color best suits you by checking out the gallery below.
Samsung unleashes Smart Touch Remote and Wireless Keyboard, we go eyes-on (video)
Along with announcing the official release details for its 2012 Plasma and Smart Interaction TV lineup today, Samsung also introduced its Smart Touch Remote and Wireless Keyboard. Essentially serving as the replacement for its 2011 Qwerty remote, the new Touch variant will come included with the ES7500 and ES8000 LED models and E8000 Plasma display. The retro-looking slab features tactile controls for channel switching and adjusting volume on its edges, while the middle section is dedicated to gesture controls for interacting with services like Smart Hub. Notably, the remote also features a built-in microphone which will assist with voice controls if ya happen to be far away from your TV. Moving along for those who like to type, the Wireless Keyboard will be available separately and features most of what you'll find on the remote cleanly affixed on its right side. We're also told that it's compatible with both models of the Galaxy Tab 2. We haven't heard any word on pricing or availability, but check out the gallery below and a cameo of the remote in the video past the break for further details.Update: Sammy reached out and let us know that its new Wireless Keyboard will be priced at $99 once it hits shelves. %Gallery-149798%Edgar Alvarez contributed to this post.
The best Kinect to come: Microsoft's Xbox 360 spring showcase
Like the Nintendo Wii before it, Microsoft's Kinect has been braving the storm of new peripheral adolescence, awkwardly shuffling users through jump, wave, lean and jiggling gameplay, typically at a leisurely pace. Sure it's had its moments on the dance floor, but aside from being a good listener, the spatially aware sensor hasn't exactly redefined core gaming. Almost a year and half after its launch, however, the often hacked device is taking another crack at reaching the hardcore. We dropped in on Xbox's spring showcase this weekend to find out how that effort is going -- see what we found after the break.
LG Google TV and Magic Remote Qwerty hands-on
While Samsung waits to debut its take on the Google TV platform, LG is already showing off its hardware, including a new remote control. For LG's part, it has decided to blend the QWERTY needs of a Google TV controller with its existing Magic Motion remote gesture control and scroll wheel technology. The result is a decently well balanced dual-sided remote with relatively simple controls. Because of the shape and added weight, we actually preferred this remote to the lighter original Magic Motion remote for pointing in our brief hands-on time. The scroll wheel was also a great help, and made it an improvement over the v1 Google TV remotes in pretty much every way possible. We'll need more time with the clicker to know for sure, but the Magic Remote Qwerty is probably our favorite out of the three options presented at CES (Sony, Vizio). We won't lean either way on LG's skinning of the Google TV experience just yet, although if you're a fan of the company's existing connected TV menus (we weren't so much in our review) then you'll be glad to know these are very similar. Check the gallery below for a couple more pics of the remote and the TV itself.
Samsung Smart Interaction gesture controlled HDTV demo (video)
Samsung revealed some of its 2012 HDTVs would include a built in camera and mic to enable a feature it calls Smart Interaction, which is just a brand name for voice and gesture control. We stopped by the company's massive CES booth today and squeezed between all of those 55-inch OLEDs to get a quick demo, and found it mirrored the suddenly common Kinect functionality we've become accustomed to closely. Like Microsoft's add-on, Samsung's setup has a keyword that activates it (Hi TV) and like the recently upgraded Xbox 360 dashboard, there has been a lot of work done to make sure it recognizes many real words. A key difference from the Kinect however, is that Samsung has also developed a Bluetooth-connected IR blaster that can sit in front of your cable box and extend the control to other devices that way. As you can see in our video of the presentation the control was generally tight and responsive, however it still lacks truly natural communication and the test volunteer had some trouble turning the TV off. Check out the video after the break and see if a future of talking to the TV is for you -- we'll be on the couch with our remotes.
Samsung has Smart TVs with dual core CPUs, cameras and more
Samsung's CES 2012 press conference is going on right now, and it's unveiling new products including the top of the line ES8000 LED model that packs a dual core CPU to run its apps, and an integrated camera and microphone for "Smart Interaction". Beyond that, the "Smart Evolution" feature will let users swap out that dual core processor for something heftier later on if they want to upgrade. Finally "Smart Content" is the umbrella term for a wave content and apps including, of course, Angry Birds, and an upgraded version of AllShare that pulls from the cloud, and can even control other compatible devices. The ES8000 edge lit LED line ranges in size from 46- to 65-inches, and features Smart Interaction cameras and mics for videoconferencing as well as voice and gesture control. Check after the break for the press release with all the details, or follow along with our liveblog.