Gesture Control
Latest
Kinect Toolbox update turns hand gestures into mouse input, physical contact into distant memory
Using Microsoft's Kinect to replace a mouse is often considered the Holy Grail of developers; there have been hacks and other tricks to get it working well before Kinect for Windows was even an option. A lead Technical Evangelist for Microsoft in France, David Catuhe, has just provided a less makeshift approach. The 1.2 update to his Kinect Toolbox side project introduces hooks to control the mouse outright, including 'magnetic' control to draw the mouse from its original position. To help keep the newly fashioned input (among other gestures) under control, Catuhe has also taken advantage of the SDK 1.5 release to check that the would-be hand-waver is sitting and staring at the Kinect before accepting any input. The open-source Windows software is available to grab for experimentation today, so if you think hands-free belongs as much on the PC desktop as in a car, you now have a ready-made way to make the dream a reality... at least, until you have to type.
Sigma R&D shows Kinect sign language and Jedi savvy to win gesture challenge (video)
Sigma R&D has won first prize in a gesture challenge to show just how much more talent -- like sign language translation and light saber fun -- can be unlocked in a Kinect. Normally the Microsoft device can only scope body and full mitt movements, but the research company was able to track individual fingers with a Kinect or similar sensor, plus its custom software, allowing a user's hand to become a more finely tuned controller. To prove it, the company introduced a virtual lightsaber to a subject, tracking his swordsmanship perfectly and using his thumb extension to turn it on and off. The system even detected when a passing gesture was made, seamlessly making a virtual transfer of the weapon. The same tech was also used to read sign language, displaying the intended letters on the screen for a quick translation. The SDK is due in the fall, when we can't wait to finally get our hands on a Jedi weapon that isn't dangerous or plasticky. To believe it for yourself, see the videos after the break.
Leap Motion taps former Apple iAd VP Andy Miller to be President and COO
Apple's former iAd VP (and Quattro co-founder) Andy Miller only just took a job as a general partner at Highland Capital last year after leaving the gang in Cupertino, but he's now already moving on to another fairly high profile gig. Leap Motion has announced today that Miller will become its new President and CEO COO, placing him in a central role at a company that's facing the rather difficult task of actually delivering the goods after wowing most everyone with its new gesture control technology. As Fortune notes, however, the move doesn't come as a complete surprise. Highland Capital is backing Leap, and Miller himself has reportedly been spending about 80 percent of his time on the company over the past few months. In a statement, Miller said that he's "been fortunate to work with some of the most influential figures and companies in the technology industry, and I'm as excited about the Leap as I've ever been about a technology," adding that the "potential for the Leap is limitless, as it is going to fundamentally change the way we interact with so many devices in our lives." Update: Leap Motion has reached out and informed us that Miller will be President and COO, reporting to current CEO and co-founder Michael Buckwald. The official press release can be found after the break.
Amazon Audible hits WP 7.5, brings gesture controlled audiobooks (update)
It didn't land in the Marketplace yesterday as announced, but Amazon's Audible audio book app for Windows Phone 7.5 is now available for download. This Metro-fied version of the app is free to install (including some short samples to get you started), and signing in with your Amazon account lets you purchase any books that the service has on offer. Media can be controlled using a swipe gesture interface, and there are even varying levels of badges to reward how much of a book-worm you become. That said, we haven't been able to use the voice control functionally shown off by Microsoft at its Developers Summit is naturally a WP 8-only affair, so you won't find that feature here. If you're eager to get your literary listening on, you'll find a download and more info about the app at the source link below. Update: As many of you have pointed out in the comments, the voice control aspect is specific to Windows Phone 8. We've updated our language in the post to reflect this.
LG launches 'upgraded' SP820 Smart TV Upgrader box in June for about $170 US
Should you have the impulse to turn your dumb display into a full-fledged Smart TV, LG has revealed the second iteration of its Smart TV Upgrader box is ready to hit the marketplace. The original ST600 box was released last year, and this new SP820 was announced earlier this year at CES. It adds LG's Smart TV experience complete with Magic gesture and voice controlled remote to any HDTV with an HDMI input. There's access to both 2D and 3D streaming content from the internet, DLNA, Wi-Fi Direct and any new apps LG rolls out for its platform. Similar to Apple's TV box and the Roku family, it's a palm sized device intended for easy installations. An even smaller, stripped down SP520 version that supports fewer apps is already on shelves with a $120 MSRP, although sale prices range from $80 to $99. The SP is shipping in June for 199,000 won ($169 US), while there's no word yet on a US release, we'll probably wait to see if LG can add enough apps to compete as a third party before jumping in.
Leap Motion gesture control technology hands-on
Leap Motion unveiled its new gesture control technology earlier this week, along with videos showing the system tracking ten fingers with ease and a single digit slicing and dicing a grocery store's worth of produce in Fruit Ninja. Still, doubts persisted as to the veracity of the claim that the Leap is 200 times more accurate than existing tech. So, we decided to head up to San Francisco to talk with the men behind Leap, David Holz and Michael Buckwald, and see it for ourselves. Join us after the break to learn a bit more about Leap, our impressions of the technology, and a video of the thing in action.%Gallery-156126%
Kinect Accelerator company profiles: Freak'n Genius, GestSure Technologies, Kimetric and Styku
Microsoft's Kinect Accelerator program kicked off over a month ago, but at the time we were only made aware of the participant start-ups' names, not their innovations. So, when Microsoft offered us the opportunity to talk with the folks behind four of the program's participants -- Freak'n Genius, GestSure Technologies, Kimetric and Styku -- we jumped at the chance. Join us after the break to see what this quartet of fledgling companies has planned to propogate the Kinect effect further than ever.
Hillcrest Labs takes its TV motion control system to China, becomes TCL's new best friend
It's only been a few days since Hillcrest Labs open sourced its Kylo web browser for TVs, and now the company's back with yet another announcement. Well, this time it's more about TCL who's just declared its top TV market share in China. Much like the Roku 2 and LG TVs with Magic Motion remote, Hillcrest's Freespace engine has been outted as the enabling technology behind TCL's recently announced V7500, a 3D smart TV series featuring a heavily customized Android 4.0.3 and a 7.9mm-thick bezel. This means users can interact with and play games on this slim TV via motion and cursor control on the remote (there's also voice control here but it doesn't look like Hillcrest has anything to do with it). There are no dates or prices just yet, but TCL better be quick as Lenovo's got something very similar ready to ship soon.
Leap Motion reveals super-accurate motion control tech, $70 device to change the UI game
In many respects, Microsoft has led the charge towards a future of gesture-based controls with its Kinect, and other tech giants like Samsung and Apple are getting in on the action, too. The move to motion controls isn't limited to the big boys, however. Leap Motion has created a new device, called the Leap, it claims is 200 times more accurate than existing technology and will take gesture controls to the next level. It's about the size of a pack of gum, and once connected to your computer via USB, it creates a eight-cubic-foot virtual workspace. Within that area, it tracks all ten of your fingers simultaneously to within 1/100 of a millimeter -- that level of accuracy allows for rudimentary gestures like pinch-to-zoom and more complex actions like manipulating 3D-rendered objects. Naturally, the company isn't telling much about the black magic making it happen, but Leap Motion claims that its software can be embedded in almost anything with an onboard computer, from phones to refrigerators. Users can customize it to suit their needs with custom gestures and sensitivity settings, in addition to chaining multiple Leap devices together to create a larger workspace. Plus, Leap Motion has created an SDK for devs to create Leap-compatible applications and an app discovery platform to distribute them to others. That means the Leap can work in a variety of use cases, from simply navigating your desktop to gaming and computer-aided design. The best part? Leap brings you this next-gen UX for a mere $69.99, and a select few can pre-order them now, with the full roll-out coming this winter. Full details follow in the PR below, and you can see the Leap in action in the videos after the break.
Samsung shows off production 55-inch OLED HDTVs at the 2012 World's Fair
We got a first hand look at Samsung's stunning 55-inch OLED HDTV prototypes earlier this year during CES, but now it's surprising the world by showing off the first mass produced ES9500 models at the 2012 World's Fair (which is apparently still a thing?) in Korea. Beyond the Smart Interaction voice and gesture control, Smart Content and Smart Evolution upgradeable dual-core CPU features found in its other high-end HDTVs, Samsung has also built in Smart Dual View technology. This lets users watch two different programs (2D) on one screen at the same time using the set's 3D glasses and sound fed through headphones. Since each pixel is individually lit, Samsung says its OLED tech has 20 percent better color reproduction than existing LED-backlit LCD HDTVs. There's still no word on exactly when these will ship and for how much, however with competition on the way from LG, these fresh-off-the-factory-line flat panels are a sign we won't be waiting long. Other than new display tech, Samsung also took the opportunity to officially announce bigger LCD models on the way in sizes from 60- to 75-inches. Check the galleries below for a few pictures straight from the expo, as well as our shots of the CES display. Update: According to the Associated Press, company officials expect it to go on sale in the second half of the year for over 10 million won, around $9,000 US. %Gallery-155121%
Huawei throws R&D dollars at gesture control, cloud storage, being more 'disruptive'
Undeterred by the fact that even humans struggle to interpret certain gestures, Huawei says it's allocating a chunk of its growing R&D budget to new motion-sensing technology for smartphones and tablets. The company's North American research chief, John Roese, told Computerworld that he wants to allow "three-dimensional interaction" with devices using stereo front-facing cameras and a powerful GPU to make sense of the dual video feed. Separately, the Chinese telecoms company is also putting development cash into a cloud computing project that promises to "change the economics of storage by an order of magnitude." Roese provided scant few details on this particular ambition, but did mention that Huawei has teamed up with CERN to conduct research and has somehow accumulated over 15 petabytes of experimental physics data in the process. Whatever it's up to, Huawei had better get a move on -- others are snapping up gesture recognition and cloud patents faster than you can say fa te ne una bicicletta with your hands.
Sony VAIO E Series 14P gets Ivy Bridge processor nudge, improved display
While they may not be the Sony ultrabooks we're still all itching to see, the company's E Series 14P laptops have reappeared with some Ivy Bridge bones. According to Sony Australia, the previously Intel Core i3 processor has been bulked up to a third-generation 2.1GHz Core i7-3612QM, capable of 3.1GHz with Turbo Boost. That's not the only difference, with the 14-inch display boosted to 1600 x 900 and a new choice between AMD'S Radeon HD 7670M or Intel's HD Graphics 4000 to provide the graphical horse power in the updated hardware. The aluminum-splashed laptops, priced at $1,500 AUD (around $1,608 USD), will still house Sony's Gesture Control functions. This should allow you to navigate around websites and media playback with some arm flailing -- provided you're using Microsoft perennials like Internet Explorer 9 and Windows Media Player. These updated specs are tinged with some (minor) bad news; it looks like the pink iteration won't be getting the same improvements seen on the black and white models. Regardless, monochrome fans can hit up the source for all the new details.
Sony unveils E Series 14P laptops with gesture-based controls
They may not be the thinnest or most powerful machines Sony's ever introduced, but the new trio hopes to catch a few hearts here and there. A follow-up to those flashy VAIOs we saw a while back, these E Series models are each packing a 14-inch, 1366 x 768 display, an Intel Core i3 2550M CPU with 4GB of RAM and your choice of AMD Radeon HD 7670M or Intel HD Graphics 3000 -- all while promising up to seven hours of battery life. Run-of-the-mill specs aside, Sony's Gesture Control feature will allow you to swipe between pages and adjust bits like music playback -- though, at the moment it only works with Windows Media Player, IE9, PowerPoint and PowerDVD. The company's yet to reveal the 14P's price tag, but in the meantime you can decide which color best suits you by checking out the gallery below.
Ubi-Camera frames photos with fingers, fails to call you fabulous (video)
Gesture control's no longer restricted to P.K. Dick novels, having firmly broken away from its fantasist scifi roots into practical, everyday use. It's only natural then that those advancements, typically reserved for computing, would bleed into other areas of consumer tech, like digital imaging. For researchers at Japan's Institute of Advanced Media Arts and Sciences, that manual dexterity appears to be the next great photographic leap, as the L-squared hand-framing you're accustomed to seeing photogs mime on TV and film could wind up replacing physical point-and-shoots soon.The team's prototype, dubbed Ubi-Camera, may look more like a mini-cube than mini-cam, but it works rather intuitively: simply hook it onto your index finger, adjust the focus by moving the "viewfinder" nearer to your face for wide-angle shots or further away for close-ups and then snap away using the side-mounted shutter button. The project's not without its hiccups, however, as the in-development unit's infrared sensor, used to determine range, can be easily affected by lighting conditions. Additionally, there's no zoom function, as that process is handled entirely in post on a desktop PC. All told, these are really rather small bumps in the road to an inevitable marketplace debut. Next up for IAMAS? Crushing people's heads with your fingers. At least, that's on our wish list. Video demo after the break.
Samsung unleashes Smart Touch Remote and Wireless Keyboard, we go eyes-on (video)
Along with announcing the official release details for its 2012 Plasma and Smart Interaction TV lineup today, Samsung also introduced its Smart Touch Remote and Wireless Keyboard. Essentially serving as the replacement for its 2011 Qwerty remote, the new Touch variant will come included with the ES7500 and ES8000 LED models and E8000 Plasma display. The retro-looking slab features tactile controls for channel switching and adjusting volume on its edges, while the middle section is dedicated to gesture controls for interacting with services like Smart Hub. Notably, the remote also features a built-in microphone which will assist with voice controls if ya happen to be far away from your TV. Moving along for those who like to type, the Wireless Keyboard will be available separately and features most of what you'll find on the remote cleanly affixed on its right side. We're also told that it's compatible with both models of the Galaxy Tab 2. We haven't heard any word on pricing or availability, but check out the gallery below and a cameo of the remote in the video past the break for further details.Update: Sammy reached out and let us know that its new Wireless Keyboard will be priced at $99 once it hits shelves. %Gallery-149798%Edgar Alvarez contributed to this post.
The best Kinect to come: Microsoft's Xbox 360 spring showcase
Like the Nintendo Wii before it, Microsoft's Kinect has been braving the storm of new peripheral adolescence, awkwardly shuffling users through jump, wave, lean and jiggling gameplay, typically at a leisurely pace. Sure it's had its moments on the dance floor, but aside from being a good listener, the spatially aware sensor hasn't exactly redefined core gaming. Almost a year and half after its launch, however, the often hacked device is taking another crack at reaching the hardcore. We dropped in on Xbox's spring showcase this weekend to find out how that effort is going -- see what we found after the break.
Qualcomm's Snapdragon S4 flexes its imaging muscle (video)
While we already know that Qualcomm's Snapdragon S4 will offer a quad-core variant, incorporate LTE and use a 28nm manufacturing process, the company posted an article to its media blog ahead of Mobile World Congress showcasing the new features provided by the chipset's Image Signal Processor. You're likely familiar with some of the imaging functionality available in Qualcomm's existing Snapdragon processors -- technology like Scalado's Rewind (pictured above) which we've covered before. The new SoC cranks things up a notch with support for up to three cameras (two in the back for 3D plus one front-facing), 20-megapixel sensors and 1080p HD video recording at 30fps. In addition to zero shutter lag, the Snapdragon S4 includes proprietary 3A processing (autofocus, auto exposure and auto white balance) along with improved blink / smile detection, gaze estimation, range finding and image stabilization. Rounding things off are gesture detection / control, augmented reality and computer vision (via Quacomm's FastCV). Want to know more? Check out the source link below, then hit the break for video demos of the S4's image stabilization and gesture-based imaging chops.
Kinect for Media Center released, why not wave and shout at your HTPC?
Kinect hacks previously brought gesture and voice control to Boxee and XBMC, and now that the Kinect for Windows hardware has been released we've got a solution for Windows Media Center. The aptly named Kinect for Media Center brings all the normal playback controls (for WMC and add-ins like Netflix) to your fingertips and lips, at the cost of $6.99. While its control scheme seems to be fully featured there are unfortunately some limitations -- it doesn't work with the Xbox 360 Kinect due to Microsoft's restrictions, and it also doesn't work with WMC extenders. What is included are filters to keep your content from accidentally triggering the voice controls (something some of us have had problems with on the Xbox 360), and configurable settings for right or left hand dominance or sensitivity. You can check out a video demo of the beta version (compare to a demo we saw last year from the makers of the Amulet voice control remotes) embedded after the break, or head directly to the site to try it out yourself if you're sure that finding the remote has simply become to much of a hassle.
LG Google TV and Magic Remote Qwerty hands-on
While Samsung waits to debut its take on the Google TV platform, LG is already showing off its hardware, including a new remote control. For LG's part, it has decided to blend the QWERTY needs of a Google TV controller with its existing Magic Motion remote gesture control and scroll wheel technology. The result is a decently well balanced dual-sided remote with relatively simple controls. Because of the shape and added weight, we actually preferred this remote to the lighter original Magic Motion remote for pointing in our brief hands-on time. The scroll wheel was also a great help, and made it an improvement over the v1 Google TV remotes in pretty much every way possible. We'll need more time with the clicker to know for sure, but the Magic Remote Qwerty is probably our favorite out of the three options presented at CES (Sony, Vizio). We won't lean either way on LG's skinning of the Google TV experience just yet, although if you're a fan of the company's existing connected TV menus (we weren't so much in our review) then you'll be glad to know these are very similar. Check the gallery below for a couple more pics of the remote and the TV itself.
Samsung Smart Interaction gesture controlled HDTV demo (video)
Samsung revealed some of its 2012 HDTVs would include a built in camera and mic to enable a feature it calls Smart Interaction, which is just a brand name for voice and gesture control. We stopped by the company's massive CES booth today and squeezed between all of those 55-inch OLEDs to get a quick demo, and found it mirrored the suddenly common Kinect functionality we've become accustomed to closely. Like Microsoft's add-on, Samsung's setup has a keyword that activates it (Hi TV) and like the recently upgraded Xbox 360 dashboard, there has been a lot of work done to make sure it recognizes many real words. A key difference from the Kinect however, is that Samsung has also developed a Bluetooth-connected IR blaster that can sit in front of your cable box and extend the control to other devices that way. As you can see in our video of the presentation the control was generally tight and responsive, however it still lacks truly natural communication and the test volunteer had some trouble turning the TV off. Check out the video after the break and see if a future of talking to the TV is for you -- we'll be on the couch with our remotes.
