gesturecontrol
Latest
Microsoft Research crafts wrist-worn device that tracks hand gestures in 3D space (video)
A team led by researchers at Microsoft's UK-based R&D lab has crafted a system that tracks the full 3D pose of a user's hand without the need for a pesky glove. Dubbed Digits, the Kinect-inspired rig latches onto a user's wrist and utilizes a diffuse infrared light, IR laser, camera and inertial measurement unit to track fingertips and just five key points of a hand. Leveraging a pair of mathematical models developed in-house after studying the mechanics of the human hand, the group uses the captured data to extrapolate the position of a user's paw. The team envisions the solution as a supplement to touch-based interfaces, a method for eyes-free control of mobile devices and as a gaming controller that could work in conjunction with Kinect or similar systems. In its current state, the device is composed of off-the-shelf parts and needs to be tethered to a laptop, but the ultimate goal is to create a mobile, self contained unit the size of a wrist watch. Hit the break to catch a video of the setup in action or tap the second source link below for more details in the group's academic paper.
Pioneer's latest Raku Navi GPS units take commands from hand gestures
An AR heads-up display wasn't the only navigation hardware Pioneer showed off at CEATEC 2012. The firm also took the opportunity to tear the wraps off a new line of gesture-controlled Raku Navi GPS units. With the infrared-powered Air Gesture feature, drivers can wave their hand in front of a device to pull up a menu with commands such as setting their home or a personal haunt as a destination or skipping to the next tune on a playlist. Once a hand is retracted, the menu will be replaced with the usual map interface. Though the solution isn't completely hands-free, horizontal hand waves can be assigned one of ten different functions. Japanese store shelves will be lined with two dashboard-embeddable units by mid-October, while four console-independent models will join them in early November. As of now, there's no word if the hardware will make the pilgrimage stateside.
Akimbo Kinect hack offers precise control with minimal effort (video)
We've seen Microsoft's Kinect used in countless ways, but 3Gear Systems means to better these predecessors with the beta release of its SDK, which turns all the subtleties of hand movement into actions. In addition to using two Kinect cameras for accuracy, the software compares hand poses against a pre-rendered database so gesture commands are executed with little lag. It offers complete control of a virtual 3D environment from the comfort of your natural desk position, so you won't have to worry about flail fatigue after long stints. A free public beta is available now until November 30th, at which point bigger companies will require a license, while individuals and small enterprises will continue to get complimentary access. We know what you're thinking -- it's just another Kinect hack -- but we suggest you reserve judgment til you've seen the demo below, showing examples of how the API could be used for CAD, medical, and of course, gaming applications.
Chrome experiment explores new types of navigation, degrees of embarrassment
What you're about to see, should you choose to click the source link below, is far from perfect. On the other hand, it's clearly had a lot of effort and expertise put into it -- not only by HTML5-savvy coders, but also by a troupe of performers from the Cirque du Soleil. It's called Movi.Kanti.Revo, which is a fancy way of saying Move.Sing.Dream, and it involves navigating through an ethereal and slightly laggy landscape using only swaying gestures, your singing voice (mournful sobbing sounds also worked for us) and a bunch of APIs that conveniently fail to work on FireFox, Safari or Internet Explorer. It's well-suited to those with a mic and webcam, preferably sitting in a open-plan and bully-ridden workplace, and if you don't like it there's always Bastion.
Woven's wearable platform for gaming, cool points and a whole lot more (video)
TshirtOS showed us one take on wearable gadgetry earlier this month, and now it's Woven's turn. This particular e-garment packs quite the selection of hardware, as you can see above -- a trio of LilyPad Arduino boards (and some custom ones), a Bluetooth module, 12 x 12 RGB LED "screen", speakers, bend sensors, a heart rate monitor, shake motors and a power pack. You'll need to accessorize, of course, with a smartphone for hardware harmony and to run companion apps. So what's it for, you ask? Well, the creators are touting it primarily as a "pervasive" gaming platform, and even seem to have a working first title in the form of SPOOKY (think gesture-based ghost-fighting). Other uses (which appear a little more conceptual) see Woven as a workout companion, TV remote, Wii controller, social network alerter or simply a fashion accessory. Check out the videos below to see it in action and imagine all the fun you could have in the five minutes before you're ushered into that padded room.
Qualcomm demos touch-free gesture control for tablets powered by Snapdragon (video)
Tablets are for touching -- that much is understood. But Qualcomm's making it so your fingers will be mostly optional, thanks to the Kinect-like powers of its Snapdragon CPU. To highlight this, the company's uploaded a couple of videos to its YouTube channel that showcase two practical use case scenarios for the gesture tech: gaming and cooking. Using the device's front-facing camera, users will one day soon be able to control onscreen avatars, page forward and back through recipes, setup profiles and even wake their slates all with simple hand or head movements. Alright, so tactile-free navigation of this sort isn't exactly new, but it does up open up the tablet category to a whole new world of innovation. Head past the break to peek the demos in action.
Kinect Toolbox update turns hand gestures into mouse input, physical contact into distant memory
Using Microsoft's Kinect to replace a mouse is often considered the Holy Grail of developers; there have been hacks and other tricks to get it working well before Kinect for Windows was even an option. A lead Technical Evangelist for Microsoft in France, David Catuhe, has just provided a less makeshift approach. The 1.2 update to his Kinect Toolbox side project introduces hooks to control the mouse outright, including 'magnetic' control to draw the mouse from its original position. To help keep the newly fashioned input (among other gestures) under control, Catuhe has also taken advantage of the SDK 1.5 release to check that the would-be hand-waver is sitting and staring at the Kinect before accepting any input. The open-source Windows software is available to grab for experimentation today, so if you think hands-free belongs as much on the PC desktop as in a car, you now have a ready-made way to make the dream a reality... at least, until you have to type.
Sigma R&D shows Kinect sign language and Jedi savvy to win gesture challenge (video)
Sigma R&D has won first prize in a gesture challenge to show just how much more talent -- like sign language translation and light saber fun -- can be unlocked in a Kinect. Normally the Microsoft device can only scope body and full mitt movements, but the research company was able to track individual fingers with a Kinect or similar sensor, plus its custom software, allowing a user's hand to become a more finely tuned controller. To prove it, the company introduced a virtual lightsaber to a subject, tracking his swordsmanship perfectly and using his thumb extension to turn it on and off. The system even detected when a passing gesture was made, seamlessly making a virtual transfer of the weapon. The same tech was also used to read sign language, displaying the intended letters on the screen for a quick translation. The SDK is due in the fall, when we can't wait to finally get our hands on a Jedi weapon that isn't dangerous or plasticky. To believe it for yourself, see the videos after the break.
Leap Motion taps former Apple iAd VP Andy Miller to be President and COO
Apple's former iAd VP (and Quattro co-founder) Andy Miller only just took a job as a general partner at Highland Capital last year after leaving the gang in Cupertino, but he's now already moving on to another fairly high profile gig. Leap Motion has announced today that Miller will become its new President and CEO COO, placing him in a central role at a company that's facing the rather difficult task of actually delivering the goods after wowing most everyone with its new gesture control technology. As Fortune notes, however, the move doesn't come as a complete surprise. Highland Capital is backing Leap, and Miller himself has reportedly been spending about 80 percent of his time on the company over the past few months. In a statement, Miller said that he's "been fortunate to work with some of the most influential figures and companies in the technology industry, and I'm as excited about the Leap as I've ever been about a technology," adding that the "potential for the Leap is limitless, as it is going to fundamentally change the way we interact with so many devices in our lives." Update: Leap Motion has reached out and informed us that Miller will be President and COO, reporting to current CEO and co-founder Michael Buckwald. The official press release can be found after the break.
Amazon Audible hits WP 7.5, brings gesture controlled audiobooks (update)
It didn't land in the Marketplace yesterday as announced, but Amazon's Audible audio book app for Windows Phone 7.5 is now available for download. This Metro-fied version of the app is free to install (including some short samples to get you started), and signing in with your Amazon account lets you purchase any books that the service has on offer. Media can be controlled using a swipe gesture interface, and there are even varying levels of badges to reward how much of a book-worm you become. That said, we haven't been able to use the voice control functionally shown off by Microsoft at its Developers Summit is naturally a WP 8-only affair, so you won't find that feature here. If you're eager to get your literary listening on, you'll find a download and more info about the app at the source link below. Update: As many of you have pointed out in the comments, the voice control aspect is specific to Windows Phone 8. We've updated our language in the post to reflect this.
LG launches 'upgraded' SP820 Smart TV Upgrader box in June for about $170 US
Should you have the impulse to turn your dumb display into a full-fledged Smart TV, LG has revealed the second iteration of its Smart TV Upgrader box is ready to hit the marketplace. The original ST600 box was released last year, and this new SP820 was announced earlier this year at CES. It adds LG's Smart TV experience complete with Magic gesture and voice controlled remote to any HDTV with an HDMI input. There's access to both 2D and 3D streaming content from the internet, DLNA, Wi-Fi Direct and any new apps LG rolls out for its platform. Similar to Apple's TV box and the Roku family, it's a palm sized device intended for easy installations. An even smaller, stripped down SP520 version that supports fewer apps is already on shelves with a $120 MSRP, although sale prices range from $80 to $99. The SP is shipping in June for 199,000 won ($169 US), while there's no word yet on a US release, we'll probably wait to see if LG can add enough apps to compete as a third party before jumping in.
Leap Motion gesture control technology hands-on
Leap Motion unveiled its new gesture control technology earlier this week, along with videos showing the system tracking ten fingers with ease and a single digit slicing and dicing a grocery store's worth of produce in Fruit Ninja. Still, doubts persisted as to the veracity of the claim that the Leap is 200 times more accurate than existing tech. So, we decided to head up to San Francisco to talk with the men behind Leap, David Holz and Michael Buckwald, and see it for ourselves. Join us after the break to learn a bit more about Leap, our impressions of the technology, and a video of the thing in action.%Gallery-156126%
Kinect Accelerator company profiles: Freak'n Genius, GestSure Technologies, Kimetric and Styku
Microsoft's Kinect Accelerator program kicked off over a month ago, but at the time we were only made aware of the participant start-ups' names, not their innovations. So, when Microsoft offered us the opportunity to talk with the folks behind four of the program's participants -- Freak'n Genius, GestSure Technologies, Kimetric and Styku -- we jumped at the chance. Join us after the break to see what this quartet of fledgling companies has planned to propogate the Kinect effect further than ever.
Hillcrest Labs takes its TV motion control system to China, becomes TCL's new best friend
It's only been a few days since Hillcrest Labs open sourced its Kylo web browser for TVs, and now the company's back with yet another announcement. Well, this time it's more about TCL who's just declared its top TV market share in China. Much like the Roku 2 and LG TVs with Magic Motion remote, Hillcrest's Freespace engine has been outted as the enabling technology behind TCL's recently announced V7500, a 3D smart TV series featuring a heavily customized Android 4.0.3 and a 7.9mm-thick bezel. This means users can interact with and play games on this slim TV via motion and cursor control on the remote (there's also voice control here but it doesn't look like Hillcrest has anything to do with it). There are no dates or prices just yet, but TCL better be quick as Lenovo's got something very similar ready to ship soon.
Leap Motion reveals super-accurate motion control tech, $70 device to change the UI game
In many respects, Microsoft has led the charge towards a future of gesture-based controls with its Kinect, and other tech giants like Samsung and Apple are getting in on the action, too. The move to motion controls isn't limited to the big boys, however. Leap Motion has created a new device, called the Leap, it claims is 200 times more accurate than existing technology and will take gesture controls to the next level. It's about the size of a pack of gum, and once connected to your computer via USB, it creates a eight-cubic-foot virtual workspace. Within that area, it tracks all ten of your fingers simultaneously to within 1/100 of a millimeter -- that level of accuracy allows for rudimentary gestures like pinch-to-zoom and more complex actions like manipulating 3D-rendered objects. Naturally, the company isn't telling much about the black magic making it happen, but Leap Motion claims that its software can be embedded in almost anything with an onboard computer, from phones to refrigerators. Users can customize it to suit their needs with custom gestures and sensitivity settings, in addition to chaining multiple Leap devices together to create a larger workspace. Plus, Leap Motion has created an SDK for devs to create Leap-compatible applications and an app discovery platform to distribute them to others. That means the Leap can work in a variety of use cases, from simply navigating your desktop to gaming and computer-aided design. The best part? Leap brings you this next-gen UX for a mere $69.99, and a select few can pre-order them now, with the full roll-out coming this winter. Full details follow in the PR below, and you can see the Leap in action in the videos after the break.
Samsung shows off production 55-inch OLED HDTVs at the 2012 World's Fair
We got a first hand look at Samsung's stunning 55-inch OLED HDTV prototypes earlier this year during CES, but now it's surprising the world by showing off the first mass produced ES9500 models at the 2012 World's Fair (which is apparently still a thing?) in Korea. Beyond the Smart Interaction voice and gesture control, Smart Content and Smart Evolution upgradeable dual-core CPU features found in its other high-end HDTVs, Samsung has also built in Smart Dual View technology. This lets users watch two different programs (2D) on one screen at the same time using the set's 3D glasses and sound fed through headphones. Since each pixel is individually lit, Samsung says its OLED tech has 20 percent better color reproduction than existing LED-backlit LCD HDTVs. There's still no word on exactly when these will ship and for how much, however with competition on the way from LG, these fresh-off-the-factory-line flat panels are a sign we won't be waiting long. Other than new display tech, Samsung also took the opportunity to officially announce bigger LCD models on the way in sizes from 60- to 75-inches. Check the galleries below for a few pictures straight from the expo, as well as our shots of the CES display. Update: According to the Associated Press, company officials expect it to go on sale in the second half of the year for over 10 million won, around $9,000 US. %Gallery-155121%
Huawei throws R&D dollars at gesture control, cloud storage, being more 'disruptive'
Undeterred by the fact that even humans struggle to interpret certain gestures, Huawei says it's allocating a chunk of its growing R&D budget to new motion-sensing technology for smartphones and tablets. The company's North American research chief, John Roese, told Computerworld that he wants to allow "three-dimensional interaction" with devices using stereo front-facing cameras and a powerful GPU to make sense of the dual video feed. Separately, the Chinese telecoms company is also putting development cash into a cloud computing project that promises to "change the economics of storage by an order of magnitude." Roese provided scant few details on this particular ambition, but did mention that Huawei has teamed up with CERN to conduct research and has somehow accumulated over 15 petabytes of experimental physics data in the process. Whatever it's up to, Huawei had better get a move on -- others are snapping up gesture recognition and cloud patents faster than you can say fa te ne una bicicletta with your hands.
Sony VAIO E Series 14P gets Ivy Bridge processor nudge, improved display
While they may not be the Sony ultrabooks we're still all itching to see, the company's E Series 14P laptops have reappeared with some Ivy Bridge bones. According to Sony Australia, the previously Intel Core i3 processor has been bulked up to a third-generation 2.1GHz Core i7-3612QM, capable of 3.1GHz with Turbo Boost. That's not the only difference, with the 14-inch display boosted to 1600 x 900 and a new choice between AMD'S Radeon HD 7670M or Intel's HD Graphics 4000 to provide the graphical horse power in the updated hardware. The aluminum-splashed laptops, priced at $1,500 AUD (around $1,608 USD), will still house Sony's Gesture Control functions. This should allow you to navigate around websites and media playback with some arm flailing -- provided you're using Microsoft perennials like Internet Explorer 9 and Windows Media Player. These updated specs are tinged with some (minor) bad news; it looks like the pink iteration won't be getting the same improvements seen on the black and white models. Regardless, monochrome fans can hit up the source for all the new details.
Sony unveils E Series 14P laptops with gesture-based controls
They may not be the thinnest or most powerful machines Sony's ever introduced, but the new trio hopes to catch a few hearts here and there. A follow-up to those flashy VAIOs we saw a while back, these E Series models are each packing a 14-inch, 1366 x 768 display, an Intel Core i3 2550M CPU with 4GB of RAM and your choice of AMD Radeon HD 7670M or Intel HD Graphics 3000 -- all while promising up to seven hours of battery life. Run-of-the-mill specs aside, Sony's Gesture Control feature will allow you to swipe between pages and adjust bits like music playback -- though, at the moment it only works with Windows Media Player, IE9, PowerPoint and PowerDVD. The company's yet to reveal the 14P's price tag, but in the meantime you can decide which color best suits you by checking out the gallery below.
Ubi-Camera frames photos with fingers, fails to call you fabulous (video)
Gesture control's no longer restricted to P.K. Dick novels, having firmly broken away from its fantasist scifi roots into practical, everyday use. It's only natural then that those advancements, typically reserved for computing, would bleed into other areas of consumer tech, like digital imaging. For researchers at Japan's Institute of Advanced Media Arts and Sciences, that manual dexterity appears to be the next great photographic leap, as the L-squared hand-framing you're accustomed to seeing photogs mime on TV and film could wind up replacing physical point-and-shoots soon.The team's prototype, dubbed Ubi-Camera, may look more like a mini-cube than mini-cam, but it works rather intuitively: simply hook it onto your index finger, adjust the focus by moving the "viewfinder" nearer to your face for wide-angle shots or further away for close-ups and then snap away using the side-mounted shutter button. The project's not without its hiccups, however, as the in-development unit's infrared sensor, used to determine range, can be easily affected by lighting conditions. Additionally, there's no zoom function, as that process is handled entirely in post on a desktop PC. All told, these are really rather small bumps in the road to an inevitable marketplace debut. Next up for IAMAS? Crushing people's heads with your fingers. At least, that's on our wish list. Video demo after the break.
