gesturecontrol
Latest
LG's Magic Remote enables voice control for its smart TVs
LG was quick to introduce Wii-style motion controls and pointing to its smart TV controllers, but its new Magic Remote also adds voice recognition, allowing you to enter search terms without ever contemplating the alphabet. In a radical move, it also conjures up a scroll wheel -- perhaps for no reason other than to spite Samsung's now dowdy-looking QWERTY rival. The fact that it can control your LG Cinema 3D TV without forcing you to star-jump is a happy bonus. There's a full PR after the break, although no sign yet of availability or pricing.
Hisense Series XT710 TV helps you exercise your La-Z-Boy sans remote
You might feel like the king of the couch, but let's face it -- picking up the remote can be exhausting. Hisense is hoping to lighten your load with the launch of its new Android-based Smart TV with hands-free eyeSight gesture recognition technology -- the Series XT710. Slated to launch in China, the TV features a 2D sensor, designed to understand your hand movements and interpret your every channel changing whim. Besides flipping between reruns of Law and Order and Jersey Shore, couch potatoes will also be able to play games and access Android applications through the intelligent tube. Now, if it could only help us pop our popcorn. Jump past the break to check out the full PR.
Microsoft reportedly preparing Silverlight-like app framework ahead of Xbox Live update
Earlier this month, Microsoft announced a new slate of Xbox Live partnerships with Verizon, Comcast, and a host of other content providers. Now, the company has unveiled new details about the code upon which these new apps will run. Sources close to the situation tell GigaOM that the new framework, code-named "Lakeview," will be based on Silverlight, but will also bring a few new features from Xbox Kinect, including voice recognition and gesture-based controls. More intriguing, perhaps, are insider claims that Microsoft's new content partners stream video using Apple's HTTP Live Streaming, rather than Redmond's Smooth Streaming. GigaOM's sources went on to say that Microsoft has been introducing major changes to the platform over the past few weeks, in the hopes of having it ready for third-party developers once the Xbox Live update rolls out. Spokespersons for Xbox and Silverlight said they have "nothing to announce" about the new framework, though GigaOM reports that Redmond is aiming to release the update on Black Friday.
Microsoft reveals new TV providers including Verizon and Comcast coming to Xbox 360 (video)
Just as the rumors indicated, Microsoft is bringing video from a number of providers beyond the ones it initially announced to the Xbox 360 in its fall update, including big guns like Verizon and Comcast. While Verizon is promising "a selection" of its live TV channels on the Xbox 360 as expected, Comcast is only bringing its Xfinity TV video on-demand offerings (no AnyPlay powered live TV -- yet) to subscribers when it launches "in the coming months." Other notable providers include Lovefilm (UK, Germany), BBC TV (UK), HBO Go, and Syfy. As promised during E3, the services integrated with Xbox will offer support for search across all available video, as well as support for Kinect voice and gesture controls. The universal search is looking good since it pulls together various services into one UI (as we discussed on our podcast yesterday), but the reality is content providers and geographical limits on what services you can pick from are still throwing up walls between users and content. Check after the break for PR detailing what you'll be able to access and where, as well as a video intro to all the tasty new TV services. %Gallery-135845%
Fujitsu Arrows Tab LTE F-01D with gesture control hands-on (video)
NEC's waterproof MEDIAS N-06C to get a sprinkle of Gingerbread and 1GHz power Wireless, Tablet PCs Sony's Tablet S and P get 3G in Japan NTT DoCoMo begins testing automated Japanese / English translation app that actually works (video) We'll probably never match Japan's obsession with waterproof gadgets, but anyone would appreciate how the local manufacturers also manage to keep them thin and light at the same time. The Fujitsu Arrows Tab LTE F-01D we fiddled with here at CEATEC is one such example: while it's thicker than Samsung's 10.1-inch counterpart by almost 3mm, we were surprised that Fujitsu's latest Android tablet also weighs just under 600g -- not bad considering it's suitable for use in the shower. What's more, the F-01D comes with a rather unique feature that's great for use in the bathroom or the kitchen: camera-based gesture control, which works in the browser (to scroll pages or go back and forth) as well as the 1seg or DLNA TV viewer (to change the channel and volume). You'll see in our video after the break that the gestures worked liked a charm for us, though initially we had to make sure that the tablet wasn't facing any strong light behind us (a typical problem in large conventions). Anyhow, if you're up for grabbing an F-01D, it'll be available on NTT DoCoMo in Japan next week. %Gallery-135783%
Microsoft Surface-controlled robots to boldly go where rescuers have gone before (video)
Ready to get hands-on in the danger zone -- from afar? That's precisely what an enterprising team of University of Massachusetts Lowell researchers are working to achieve with a little Redmond-supplied assistance. The Robotics Lab project, dubbed the Dynamically Resizing Ergonomic and Multi-touch (DREAM) Controller, makes use of Microsoft's Surface and Robotics Developer Studio to deploy and coordinate gesture-controlled search-and-rescue bots for potentially hazardous emergency response situations. Developed by Prof. Holly Yanco and Mark Micire, the tech's Natural User Interface maps a virtual joystick to a user's fingertips, delegating movement control to one hand and vision to the other -- much like an Xbox controller. The project's been under development for some time, having already aided rescue efforts during Hurricane Katrina, and with future refinements, could sufficiently lower the element of risk for first responders. Head past the break for a video demonstration of this life-saving research.
Apple seeks patents for 3D and 'physics metaphor' gesture controls
Deep in the stodgy bowels of the USPTO sits a folder full of Apple patent applications specifically for gesture controls. A few more pages from that expanding tome were just made public, and the concepts unearthed are certainly thought-provoking. The first involves using a proximity sensor in addition to the touch panel to register gestures in 3D. For example, you could use three fingers to mark out the corners of a triangle on the screen and then "pull up" and pinch to create a pyramid for use in a CAD application. The second idea involves gestures based on intuitive "physics metaphors" that are recognized using motion sensors. So instead of navigating menus in order to start a file transfer between an iPhone and iPad, the user could arrange the desired files on the phone's screen and then pretend to "pour" them onto the tablet -- an idea which rather reminds of the funky Project Blox. Oh, did we just make a Cupertino lawyer twitch?
Kudo Tsunoda doesn't tell us a thing about Windows 8 support for Kinect
Microsoft asked us to drop by at E3 to chat up a generically identified "Xbox executive," imagine our surprise when we found Kudo Tsunoda hiding behind door number six. Wearing his signature shades, Kudo gave us a brief primer on what makes Kinect great, or at least a heavy endorsement of Kinect Fun Labs. While we can certainly dig the bite-sized gadgetry Fun Labs has to offer, we like to dig deeper -- will the Kinect hardware ever be integrated into other devices? Any plans for Microsoft's 3D tracking camera and Windows 8? Kudo did his best to feed our ravenous appetite for answers. It wasn't easy on poor Kudo, of course -- more than once we saw him glance longingly at his wrangler, a friendly PR rep keeping him from spilling the beans on anything too awesome. Probing about Windows 8 and Kinect produced one such look, and while our man very lightly suggested that Microsoft does more than games -- and that the dual-camera device might start showing up on other devices -- the big M had nothing to announce at that time. Kudo did go on to say, however, that we can expect to see new, innovative, "oh my gosh, I can't believe Kinect can do that" experiences at E3 year after year, citing this year's keynote for some recent examples. While we couldn't coax any leaks about Xbox or Kinect successors out of the man, it's good to see Microsoft's continued dedication to improving the platform.
Kinect integration in Ghost Recon: Future Soldier, hands-off (video)
Microsoft's E3 keynote may have exploded with deeper Kinect support, but nothing caught our eyes quite as sharply as Ghost Recon: Future Soldier's rifle-exploding Gunsmith demo. A Ubisoft representative showed us how it's done: separating your arms separates your deadly firearm into a gorgeous display of floating screws, components, and accessories, which can be effortlessly modified, swapped, and replaced with gesture and voice commands. Too picky to decide for yourself? Then don't: just tell Gunsmith what you're looking for. For instance, saying "Optimize for range" produces a weapon any sniper should be proud of -- even better, we found that commanding Gunsmith to "optimize for awesome" birthed a rifle (pictured above) sporting an underbarrel shotgun attachment. A gun attached to a gun? Yeah, that works. Weapons can be tested in Gunsmith's gesture-controlled firing range, an engaging shooting mode exclusive to the Gunsmith weapon editor and not usable in regular gameplay. Head past the break for a hands-on (figuratively speaking) video.
Netflix for Xbox 360 updated with Kinect support, everybody wave!
The next time you hit the Netflix app on your Xbox 360 the update we heard about at CES will be waiting, bringing Kinect owners the ability to flick through their videos (like ESPN3 and Zune have since the peripheral launched) without digging a controller out of the couch cushions. After the 43Mb update downloads waving ones hand for the camera or saying Xbox will pull up the new menu seen above, which auto sorts selections for browsing by voice or gesture based on what it thinks you may want to watch next. Selecting "browse all" brings you right back to the standard menu and is probably the method most will want to stick with, however being able to pause the movie quickly during playback by simply saying Xbox, Pause (or FF, rewind, skip scene, etc.) is quite convenient. Not near your Xbox? Check out a brief video of it in action after the break. [Thanks, George]
Xbox 360 IPTV rumors ride again with 'Project Orapa'
Just because Microsoft's Mediaroom IPTV service is finally supported on the Xbox 360 after years and years of expectations (as seen above) doesn't mean the rumor mill stops, with rumors surfacing of a "Project Orapa" that reportedly combines Xbox Live, Kinect and IPTV service all in one. ZDNet's Mary Jo Foley has heard from tipsters that it's related to the previously rumored Ventura multimedia project and will let subscribers to Mediaroom powered IPTV services like U-Verse use Kinect's gesture and voice recognition like ESPN3 already does to control their TV experience while Xbox users would get "more content." We should find out how much of this is reality and how it ties into previous rumors pretty quickly, since it's apparently going to be in testing this month, and available by the upcoming holiday season.
ASUS Wavi Xtion motion sensing control system demoed at CES (video)
ASUS may not be anywhere close to ready for its Wavi Xtion to hit retail shelves (we're hearing Q2 of 2012), but that didn't stop our brethren over at Engadget Spanish from stopping by for a hands-on demonstration at CES. We'll spare you the details on how it works, but in practice, we learned that it's quite similar to Kinect. Not shocking considering that PrimeSense is behind both boxes, but the primarily difference seemed to be the reaction time. ASUS' solution wasn't quite as snappy as the Kinect, being slower to recognize and translate motions in testing. Of course, we wouldn't expect a product that's 18 months out from mass production to be completely on top of its game, but feel free to head on past the break to see exactly what we mean.
Philips uWand hands-on
Philips has been touting its uWand "direct pointer" remote for a good while now, but we've never had the chance to actually use one ourselves. Today that omission has been rectified as we got our mitts around this motion / gesture-based controller and gave it a quick test drive. It works by having an infrared camera embedded in the front, which detects an IR beacon in your TV and thereby judges its own distance, tilt and relation to the TV. That then allows for things like motion-based zooming, pointing the remote at the particular thing on the television that you want to "click" on, and navigational shortcuts attached to gestures performed with this handheld. There's also a nice spacious keyboard on the back, assisting in the use of all these Smart TVs CES has been littered with. Philips' intention is to license the technology out to other manufacturers, which could result in consumer products by 2012 -- so yeah, it's not terribly close to your living room yet, but our gallery of images is. %Gallery-113562%
LG's CES 2011 HD lineup: SmartTV platform, network Blu-ray players and HDTVs
Thanks to a couple of carefully planned slips over in South Korea, hardly anything about LG's CES 2011 is apt to take you fully by surprise. But if you just so happened to disconnect over the holidays, we'll break it all down below to ensure you remain firmly in the loop. For starters, the outfit seems pretty darn proud of its new SmartTV platform. Hinted at last month, this system enables HDTVs, Blu-ray players and other sources to access all sorts of streaming media, apps and even provides users with a way to surf the web. Four main sections are given -- TV Live, Premium Content, TV Apps and a Launch Bar -- and for TV models, owners will control things with a wave of the hand (read: Magic Remote). SmartTV picks up where NetCast left off, offering access to Vudu, Netflix, YouTube, CinemaNow, Hulu Plus, Amazon Video on Demand, NHL Gamecenter, NBA Game Live and MLB.tv. This here functionality is baked into quite a few of the outfit's 2011 HDTVs, but should own an older model... Then there's the all-new SmartTV upgrader! The ST600 is a minuscule set-top box that aims to transform any TV into a SmartTV. So long as your set has an HDMI input, you'll be able to access the content mentioned above. But, of course, it's on you to source your own Magic Remote. If it's an all-new TV you're after, the company is also revealing its 2011 LED and LCD HDTV line. Nary a one is different than those we heard about last week, but at least you can now rest easy knowing that the LW9500 and LW7700 Nano Full HD 3D models will indeed see a stateside release this month. The best news here is the use of polarizing glasses -- none of that headache-inducing active shutter mess. There are 13 new LED LCD models in all, with nine of 'em shipping with the SmartTV platform embedded. Unfortunately, LG's not dishing out pricing information on these bad boys just yet. Not so keen on picking up an LCD? Plasma still lives, you know! LG's rolling out its 1080p Infinia PZ950 and PZ750 lines here at CES, with both available in 50-inch and 60-inch class sizes. Both lines come equipped with the SmartTV platform, a gesture-based Magic Motion remote andl as a free Android / iPhone app if you'd rather use your phone as a remote. The 50- / 60-inch PZ550 is saddling with NetCast 1.0, but it -- along with the PW350, PZ950 and PZ750 lines -- can handle 3D imagery. Sadly, LG's also straying from providing pricing details on these. Wrapping things up, the company is debuting its 2011 line of networked Blu-ray players and home theater systems. The BD690 supports 3D BD playback and ships with an inbuilt 250GB HDD and the SmartTV platform. The majority of LG's line also includes WiFi, DLNA streaming support and a MusicID feature by Gracenote that enables consumers to play a song from a movie of TV show by mashing a single button on the remote. The BD670, BD650, BD640, BD630 and BD650 are also seeing the light of day, with the latter being LG's first portable BD deck. Finally, LG snuck in an image (seen above) of a 3D mobile TV prototype. We've no details whatsoever to go on, but you can rest assured we'll be scouring the show floor in search of just that. For more information on all of the goods here, head on past the break for the full releases. Don't expect to find any pricing information, though. %Gallery-112603%
LG's 2011 Smart TVs focus on easy, instant access
We already got a peek at LG's Smart TV Upgrader box, but now it's revealing a bit more info about why it thinks anyone will be opting for their app-laden displays this year. Deriding the QWERTY remotes offered by competitors, LG's big idea is a simple dashboard with four elements, controlled by its Magic Motion gesture control remote. We'll still need to wait for some hands on time with its DLNA sharing and web browser to see if the simple life is the way, but if you were freaked out by all the buttons on Sony's Google TV remote then your sometime is now.
PrimeSense and ASUS team, bring Kinect-like Wavi Xtion to your living room TV (update)
PrimeSense provides some of the brains behind Microsoft's Kinect, and wants a bigger piece of the pie; ASUS has a reputation for announcing wonderfully wacky peripherals every year. At CES 2011, the Wavi Xtion will check off both boxes nicely. In a nutshell, the Xtion is a PrimeSense 3D depth camera built exclusively for PC, but with an important twist -- it connects to a pair of ASUS Wavi boxes, which wirelessly streams its data to your living room PC between your TV and a Windows PC over the 5GHz band. Oh, and should ASUS attract enough developers, it will even pull down applications from an Xtion online store. ASUS says we'll see the package commercially available around the world in Q2 of next year -- with a UI and selection of apps and games on board -- but they'll release an Xtion PRO developer kit in February to tempt all you Kinect hackers into coding magical things for the platform. No more details for now, but there's an event in Vegas this week where ASUS is all but guaranteed to show it off. PR after the break. Update: Did we say HTPC? Turns out it doesn't quite work that way -- the Wavi are actually a pair of boxes that wirelessly sling data between them. You put the Xtion sensor on top of your TV, connect it to Wavi #1, then plug Wavi #2 into a PC up to 25 meters away. Mind you, it looks like the Xtion may not be quite as capable as Microsoft's unit, as there's only infrared hardware inside -- it might be fine for gesture control, but don't expect any augmented reality lightsaber fights. See some mockups below! %Gallery-112375%
Elliptic Labs set to save your iPad from smudges with 3D gesture-sensing dock (video)
The dream of kitchen computing still isn't here, with many chefs forced to read from archaic paper-based recipe lists or, worse yet, memorize the things. Maybe all we need is a way to interact with our gadgets without getting them all messy, and maybe Elliptic Labs can get us there. Finally. The company has been teasing us with its 3D gesture interface for years now and it looks set to finally show off an actual product, a motion-sensing iPad dock prototype making its debut at CES in a few weeks. The idea is you perch this sucker in your kitchen and it gives you full control whether you're kneading sourdough or mixing meatballs, keeping your tablet streak-free -- and hygienic. That seems like somewhat limited usefulness to us, but check out the video of an earlier prototype below and see if it doesn't make you want to bake some cookies. And, if it does, feel free to bring us some.
Kinect admits itself to hospital, treated for gesture control of medical images
At this point, we all have a serious question to ask: is there anything the Kinect can't do? While Microsoft has managed to move quite a few of the camera-laden tubes, a good amount of 'em have been put to use in applications not named gaming. Take the Virtopsy Project, for instance. This particular setup uses the Kinect camera bar to control a PACS system (OsiriX, in this case), and it relies on software based on "ofxKinect, libfreenect and open frameworks." That's a lot of technobabble for sure, but as they say, the proof is in the YouTube video. Ever dreamed of swirling medical images around with hand gestures? Head on down and mash play -- fantasyland awaits.
Microsoft seeking to quadruple Kinect accuracy?
Hacked your Kinect recently? Then you probably know something most regular Xbox 360 gamers don't -- namely, that the Kinect's infrared camera is actually capable of higher resolution than the game console itself supports. Though Microsoft originally told us it ran at 320 x 240, you'll find both color and depth cameras display 640 x 480 images if you hook the peripheral up to a PC, and now an anonymous source tells Eurogamer that Microsoft wants to do the very same in the video game space. Reportedly, Redmond artificially limited the Kinect on console in order to leave room for other USB peripherals to run at the same time, but if the company can find a way around the limitation, it could issue a firmware update that could make the Kinect sensitive enough to detect individual finger motions and inevitably lead to gesture control. One of multiple ways Microsoft intends to make the world of Minority Report a reality, we're sure.
Gesture-controlled robot arm enables civilization's most meta high five
This video, criminally, doesn't actually show any high fives, but we're sure the students at the University of Tsukuba have sustained endless LOLs over the past few months, pushing their gesture-driven robot arm system to the limits of human-robot high five interaction. The system itself is relatively simple: it uses two cameras to track a hand's movements, including specific finger gestures, which are then processed and translated into robotic movement in real time. The end result is basically the world's most elaborate claw machine game, as demonstrated above.