gesturecontrol
Latest
KinectShop concept is ready to televise your shopping revolution (video)
Does anybody actually enjoy the laborious process of trying out clothes? The sheer physical effort, the risk of breaking a sweat... it's just not for us. We're much more comfortable with virtual reality fitting rooms, which is where Microsoft's Kinect motion camera has found yet another raison for its etre. Razorfish, the folks who already impressed us with some neat Kinect hacking, now have a new shopping platform that's said to actually wrap clothes around your frame and thereby provide a 3D preview of what you and they would look like together. The current iteration only shows some giddy ladies exploring the wide world of handbags, but they do look suitably impressed with the system. There are also sharing options via QR codes and NFC, plus the obligatory social networking tie-ins. Skip after the break to see the KinectShop on video.
Kudo Tsunoda doesn't tell us a thing about Windows 8 support for Kinect
Microsoft asked us to drop by at E3 to chat up a generically identified "Xbox executive," imagine our surprise when we found Kudo Tsunoda hiding behind door number six. Wearing his signature shades, Kudo gave us a brief primer on what makes Kinect great, or at least a heavy endorsement of Kinect Fun Labs. While we can certainly dig the bite-sized gadgetry Fun Labs has to offer, we like to dig deeper -- will the Kinect hardware ever be integrated into other devices? Any plans for Microsoft's 3D tracking camera and Windows 8? Kudo did his best to feed our ravenous appetite for answers. It wasn't easy on poor Kudo, of course -- more than once we saw him glance longingly at his wrangler, a friendly PR rep keeping him from spilling the beans on anything too awesome. Probing about Windows 8 and Kinect produced one such look, and while our man very lightly suggested that Microsoft does more than games -- and that the dual-camera device might start showing up on other devices -- the big M had nothing to announce at that time. Kudo did go on to say, however, that we can expect to see new, innovative, "oh my gosh, I can't believe Kinect can do that" experiences at E3 year after year, citing this year's keynote for some recent examples. While we couldn't coax any leaks about Xbox or Kinect successors out of the man, it's good to see Microsoft's continued dedication to improving the platform.
Kinect integration in Ghost Recon: Future Soldier, hands-off (video)
Microsoft's E3 keynote may have exploded with deeper Kinect support, but nothing caught our eyes quite as sharply as Ghost Recon: Future Soldier's rifle-exploding Gunsmith demo. A Ubisoft representative showed us how it's done: separating your arms separates your deadly firearm into a gorgeous display of floating screws, components, and accessories, which can be effortlessly modified, swapped, and replaced with gesture and voice commands. Too picky to decide for yourself? Then don't: just tell Gunsmith what you're looking for. For instance, saying "Optimize for range" produces a weapon any sniper should be proud of -- even better, we found that commanding Gunsmith to "optimize for awesome" birthed a rifle (pictured above) sporting an underbarrel shotgun attachment. A gun attached to a gun? Yeah, that works. Weapons can be tested in Gunsmith's gesture-controlled firing range, an engaging shooting mode exclusive to the Gunsmith weapon editor and not usable in regular gameplay. Head past the break for a hands-on (figuratively speaking) video.
Netflix for Xbox 360 updated with Kinect support, everybody wave!
The next time you hit the Netflix app on your Xbox 360 the update we heard about at CES will be waiting, bringing Kinect owners the ability to flick through their videos (like ESPN3 and Zune have since the peripheral launched) without digging a controller out of the couch cushions. After the 43Mb update downloads waving ones hand for the camera or saying Xbox will pull up the new menu seen above, which auto sorts selections for browsing by voice or gesture based on what it thinks you may want to watch next. Selecting "browse all" brings you right back to the standard menu and is probably the method most will want to stick with, however being able to pause the movie quickly during playback by simply saying Xbox, Pause (or FF, rewind, skip scene, etc.) is quite convenient. Not near your Xbox? Check out a brief video of it in action after the break. [Thanks, George]
Sony's Move.me database used to create gesture-enabled mouse driver (video)
Unless you're into weird promotional mascots, video games, or measuring the rotation of the earth, the PlayStation Move probably hasn't caught your eye. Here's an idea: what if you could wave it about to control your PC? Earlier this week, electronics hobbyist Jacob Pennock used the Move.me C library to build a gesture-controlled mouse driver, and we've got the project's tech demo after the break. Watch as Pennock launches Facebook by drawing an "F," starts a video with a jaunty "V," and closes a few items with a quick "X" motion over the offending windows. Control motions are loaded through the creator's own gesture recognition library, called hyperglyph, which he claims can record motions with 98 percent accuracy. As Move.me is currently a closed beta, Pennock is keeping the source code under wraps, but he hopes to eventually put the driver to use controlling a gesture-based Linux media center. Pretty neat, but not quite enough to stave off our Kinect hack envy. [Thanks, Robert]
Gmail Motion April Fools' gag inevitably turned into reality using Kinect (video)
It had to happen. When Google showed off a new and revolutionary Gmail Motion control scheme yesterday, it failed to fool most people, but it didn't fail to catch the attention of some motion control geeks with Kinect cameras on hand. Yep, the FAAST crew that's already brought us a Kinect keyboard emulator for World of Warcraft has taken Google to task and actually cooked up the software to make Gmail Motion work. All your favorite gestures are here: opening an email as if it were an envelope, replying by throwing a thumb back and, of course, "licking the stamp" to send your response on its way. Marvelous stuff! Jump past the break to see it working, for real this time.
Xbox 360 IPTV rumors ride again with 'Project Orapa'
Just because Microsoft's Mediaroom IPTV service is finally supported on the Xbox 360 after years and years of expectations (as seen above) doesn't mean the rumor mill stops, with rumors surfacing of a "Project Orapa" that reportedly combines Xbox Live, Kinect and IPTV service all in one. ZDNet's Mary Jo Foley has heard from tipsters that it's related to the previously rumored Ventura multimedia project and will let subscribers to Mediaroom powered IPTV services like U-Verse use Kinect's gesture and voice recognition like ESPN3 already does to control their TV experience while Xbox users would get "more content." We should find out how much of this is reality and how it ties into previous rumors pretty quickly, since it's apparently going to be in testing this month, and available by the upcoming holiday season.
Kinect hack turns Arduino-controlled delta robot into aggressive claw crane (video)
Candy crane, teddy picker, claw machine, whatever you call it, this arcade mainstay was robbing children of their golden tokens long before we slid into our first pair of Hammer pants, but despite the changing face of the plush offerings within, the crane game's remained mostly the same. Now a team of students at the Bartlett School of Architecture have produced a Kinect hack that could change the way you drop that claw. The rather temperamental delta robot enlists the ever-hackable peripheral in combination with Processing and Arduino to mimic the movements of a user's arm. As you can tell by the video below, the delta hasn't quite figured out the subtleties of human gestures, but the robot's creators say they intend to implement "several autonomous behaviors" once all the kinks are worked out. Frankly, we'd pay our weight in tokens to see the crane game bite back at an unsuspecting whippersnapper. Video after the break.
Interactive storefront displays show up at Canadian Starbucks, window licking discouraged
Starbucks has given the caffeinated crowd a new reason, other than the free WiFi, to stop by a couple of locations in Toronto and Vancouver -- interactive window displays! Taking sidewalk passers-by on a journey to assemble their favorite Tazo teas, the interactivity comes via a vinyl screen, projector, and gesture controls. We've already seen an interactive storefront in the US, so its about time our friends up north got some geekified advertising of their own. Vid's after the break.
ASUS Wavi Xtion motion sensing control system demoed at CES (video)
ASUS may not be anywhere close to ready for its Wavi Xtion to hit retail shelves (we're hearing Q2 of 2012), but that didn't stop our brethren over at Engadget Spanish from stopping by for a hands-on demonstration at CES. We'll spare you the details on how it works, but in practice, we learned that it's quite similar to Kinect. Not shocking considering that PrimeSense is behind both boxes, but the primarily difference seemed to be the reaction time. ASUS' solution wasn't quite as snappy as the Kinect, being slower to recognize and translate motions in testing. Of course, we wouldn't expect a product that's 18 months out from mass production to be completely on top of its game, but feel free to head on past the break to see exactly what we mean.
Philips uWand hands-on
Philips has been touting its uWand "direct pointer" remote for a good while now, but we've never had the chance to actually use one ourselves. Today that omission has been rectified as we got our mitts around this motion / gesture-based controller and gave it a quick test drive. It works by having an infrared camera embedded in the front, which detects an IR beacon in your TV and thereby judges its own distance, tilt and relation to the TV. That then allows for things like motion-based zooming, pointing the remote at the particular thing on the television that you want to "click" on, and navigational shortcuts attached to gestures performed with this handheld. There's also a nice spacious keyboard on the back, assisting in the use of all these Smart TVs CES has been littered with. Philips' intention is to license the technology out to other manufacturers, which could result in consumer products by 2012 -- so yeah, it's not terribly close to your living room yet, but our gallery of images is. %Gallery-113562%
LG's CES 2011 HD lineup: SmartTV platform, network Blu-ray players and HDTVs
Thanks to a couple of carefully planned slips over in South Korea, hardly anything about LG's CES 2011 is apt to take you fully by surprise. But if you just so happened to disconnect over the holidays, we'll break it all down below to ensure you remain firmly in the loop. For starters, the outfit seems pretty darn proud of its new SmartTV platform. Hinted at last month, this system enables HDTVs, Blu-ray players and other sources to access all sorts of streaming media, apps and even provides users with a way to surf the web. Four main sections are given -- TV Live, Premium Content, TV Apps and a Launch Bar -- and for TV models, owners will control things with a wave of the hand (read: Magic Remote). SmartTV picks up where NetCast left off, offering access to Vudu, Netflix, YouTube, CinemaNow, Hulu Plus, Amazon Video on Demand, NHL Gamecenter, NBA Game Live and MLB.tv. This here functionality is baked into quite a few of the outfit's 2011 HDTVs, but should own an older model... Then there's the all-new SmartTV upgrader! The ST600 is a minuscule set-top box that aims to transform any TV into a SmartTV. So long as your set has an HDMI input, you'll be able to access the content mentioned above. But, of course, it's on you to source your own Magic Remote. If it's an all-new TV you're after, the company is also revealing its 2011 LED and LCD HDTV line. Nary a one is different than those we heard about last week, but at least you can now rest easy knowing that the LW9500 and LW7700 Nano Full HD 3D models will indeed see a stateside release this month. The best news here is the use of polarizing glasses -- none of that headache-inducing active shutter mess. There are 13 new LED LCD models in all, with nine of 'em shipping with the SmartTV platform embedded. Unfortunately, LG's not dishing out pricing information on these bad boys just yet. Not so keen on picking up an LCD? Plasma still lives, you know! LG's rolling out its 1080p Infinia PZ950 and PZ750 lines here at CES, with both available in 50-inch and 60-inch class sizes. Both lines come equipped with the SmartTV platform, a gesture-based Magic Motion remote andl as a free Android / iPhone app if you'd rather use your phone as a remote. The 50- / 60-inch PZ550 is saddling with NetCast 1.0, but it -- along with the PW350, PZ950 and PZ750 lines -- can handle 3D imagery. Sadly, LG's also straying from providing pricing details on these. Wrapping things up, the company is debuting its 2011 line of networked Blu-ray players and home theater systems. The BD690 supports 3D BD playback and ships with an inbuilt 250GB HDD and the SmartTV platform. The majority of LG's line also includes WiFi, DLNA streaming support and a MusicID feature by Gracenote that enables consumers to play a song from a movie of TV show by mashing a single button on the remote. The BD670, BD650, BD640, BD630 and BD650 are also seeing the light of day, with the latter being LG's first portable BD deck. Finally, LG snuck in an image (seen above) of a 3D mobile TV prototype. We've no details whatsoever to go on, but you can rest assured we'll be scouring the show floor in search of just that. For more information on all of the goods here, head on past the break for the full releases. Don't expect to find any pricing information, though. %Gallery-112603%
LG's 2011 Smart TVs focus on easy, instant access
We already got a peek at LG's Smart TV Upgrader box, but now it's revealing a bit more info about why it thinks anyone will be opting for their app-laden displays this year. Deriding the QWERTY remotes offered by competitors, LG's big idea is a simple dashboard with four elements, controlled by its Magic Motion gesture control remote. We'll still need to wait for some hands on time with its DLNA sharing and web browser to see if the simple life is the way, but if you were freaked out by all the buttons on Sony's Google TV remote then your sometime is now.
PrimeSense and ASUS team, bring Kinect-like Wavi Xtion to your living room TV (update)
PrimeSense provides some of the brains behind Microsoft's Kinect, and wants a bigger piece of the pie; ASUS has a reputation for announcing wonderfully wacky peripherals every year. At CES 2011, the Wavi Xtion will check off both boxes nicely. In a nutshell, the Xtion is a PrimeSense 3D depth camera built exclusively for PC, but with an important twist -- it connects to a pair of ASUS Wavi boxes, which wirelessly streams its data to your living room PC between your TV and a Windows PC over the 5GHz band. Oh, and should ASUS attract enough developers, it will even pull down applications from an Xtion online store. ASUS says we'll see the package commercially available around the world in Q2 of next year -- with a UI and selection of apps and games on board -- but they'll release an Xtion PRO developer kit in February to tempt all you Kinect hackers into coding magical things for the platform. No more details for now, but there's an event in Vegas this week where ASUS is all but guaranteed to show it off. PR after the break. Update: Did we say HTPC? Turns out it doesn't quite work that way -- the Wavi are actually a pair of boxes that wirelessly sling data between them. You put the Xtion sensor on top of your TV, connect it to Wavi #1, then plug Wavi #2 into a PC up to 25 meters away. Mind you, it looks like the Xtion may not be quite as capable as Microsoft's unit, as there's only infrared hardware inside -- it might be fine for gesture control, but don't expect any augmented reality lightsaber fights. See some mockups below! %Gallery-112375%
Elliptic Labs set to save your iPad from smudges with 3D gesture-sensing dock (video)
The dream of kitchen computing still isn't here, with many chefs forced to read from archaic paper-based recipe lists or, worse yet, memorize the things. Maybe all we need is a way to interact with our gadgets without getting them all messy, and maybe Elliptic Labs can get us there. Finally. The company has been teasing us with its 3D gesture interface for years now and it looks set to finally show off an actual product, a motion-sensing iPad dock prototype making its debut at CES in a few weeks. The idea is you perch this sucker in your kitchen and it gives you full control whether you're kneading sourdough or mixing meatballs, keeping your tablet streak-free -- and hygienic. That seems like somewhat limited usefulness to us, but check out the video of an earlier prototype below and see if it doesn't make you want to bake some cookies. And, if it does, feel free to bring us some.
Kinect admits itself to hospital, treated for gesture control of medical images
At this point, we all have a serious question to ask: is there anything the Kinect can't do? While Microsoft has managed to move quite a few of the camera-laden tubes, a good amount of 'em have been put to use in applications not named gaming. Take the Virtopsy Project, for instance. This particular setup uses the Kinect camera bar to control a PACS system (OsiriX, in this case), and it relies on software based on "ofxKinect, libfreenect and open frameworks." That's a lot of technobabble for sure, but as they say, the proof is in the YouTube video. Ever dreamed of swirling medical images around with hand gestures? Head on down and mash play -- fantasyland awaits.
Microsoft seeking to quadruple Kinect accuracy?
Hacked your Kinect recently? Then you probably know something most regular Xbox 360 gamers don't -- namely, that the Kinect's infrared camera is actually capable of higher resolution than the game console itself supports. Though Microsoft originally told us it ran at 320 x 240, you'll find both color and depth cameras display 640 x 480 images if you hook the peripheral up to a PC, and now an anonymous source tells Eurogamer that Microsoft wants to do the very same in the video game space. Reportedly, Redmond artificially limited the Kinect on console in order to leave room for other USB peripherals to run at the same time, but if the company can find a way around the limitation, it could issue a firmware update that could make the Kinect sensitive enough to detect individual finger motions and inevitably lead to gesture control. One of multiple ways Microsoft intends to make the world of Minority Report a reality, we're sure.
Gesture-controlled robot arm enables civilization's most meta high five
This video, criminally, doesn't actually show any high fives, but we're sure the students at the University of Tsukuba have sustained endless LOLs over the past few months, pushing their gesture-driven robot arm system to the limits of human-robot high five interaction. The system itself is relatively simple: it uses two cameras to track a hand's movements, including specific finger gestures, which are then processed and translated into robotic movement in real time. The end result is basically the world's most elaborate claw machine game, as demonstrated above.
Kinect Hacks Daily, Episode 47: Kinect taught to control XBMC through hand gestures
One of our favorite parts of Kinect, at least theoretically, was the idea of controller-free and remote-free control of the dashboard and media playbook. Sure, it's never going to be as optimized and snappy as those tried-and-true digital buttons, but it's a great party trick, and we're all about the party tricks. Well, now you can get some of that gesture mojo going on with your XBMC setup -- and we're guessing eventually you'll be able to control just about anything else you'd use basic "left, right, click" actions for navigation. Our only suggestion? Get some of that Dance Central-style menu navigation going on here. That goes for you, too, Microsoft. [Thanks, Joshua]
Kinect finally fulfills its Minority Report destiny (video)
Not to denigrate the numerous fine hacks that Kinect's undergone since its launch, but it's always nice to see the professionals come in and shake things up a little. A crew from MIT's brain labs has put together a hand detection system on Microsoft's ultra-versatile cam, which is sophisticated enough to recognize the position of both your palms and fingers. Just as a demonstration, they've tied that good stuff up to a little picture-scrolling UI, and you won't be surprised to hear that it's the closest thing to Minority Report's interactive gesture-based interface that we've seen yet. And it's all achieved with a freaking console peripheral. Video after the break.
