Gesture Control
Latest
Samsung has Smart TVs with dual core CPUs, cameras and more
Samsung's CES 2012 press conference is going on right now, and it's unveiling new products including the top of the line ES8000 LED model that packs a dual core CPU to run its apps, and an integrated camera and microphone for "Smart Interaction". Beyond that, the "Smart Evolution" feature will let users swap out that dual core processor for something heftier later on if they want to upgrade. Finally "Smart Content" is the umbrella term for a wave content and apps including, of course, Angry Birds, and an upgraded version of AllShare that pulls from the cloud, and can even control other compatible devices. The ES8000 edge lit LED line ranges in size from 46- to 65-inches, and features Smart Interaction cameras and mics for videoconferencing as well as voice and gesture control. Check after the break for the press release with all the details, or follow along with our liveblog.
Google TV adds LG to the fold, will demo new hardware along with Sony, Vizio (update: video, pics!)
The second round of Google TV hardware will be in full swing at CES 2012, and the folks at Mountain View just officially announced LG is joining the list of hardware partners at the show. While we know Logitech was taking a pass on the latest hardware, previously announced partners Samsung, Sony and Vizio are still in and the latter two will have new hardware to show next week. While this morning's announcement by Marvell revealed the platform's switch to ARM processors from the Intel chips it launched on, the company mentioned MediaTek is also on board to build compatible chipsets, while the line of products from LG will run on the company's own L9 setup. LG's press release (included after the break) reveals the HDTVs it's bringing out will feature its Cinema 3D FPR technology as well as support for a "Magic Remote QWERTY" that combines its gesture and voice control Magic Remote with, you guessed it, a QWERTY keyboard. It will have two lines of TVs based on the Android OS, while it continues to feature its own NetCast setup in other displays. While Samsung is mentioned as building new devices, it does not appear they'll have any to show off just yet, which matches the rumors that had gone around earlier. Update: LG has posted some pics of the Google TV sets (above, after the break) featuring its custom interface, although we're still waiting for a peek at that remote. According to the company, users will have the option of using LG's UI or the default Google TV build, so whichever way you prefer should work. The Google TV team has also uploaded a fresh trailer on YouTube ahead of CES, featuring several apps and promising this is just the beginning -- check it out embedded after the break.
LG's Magic Remote enables voice control for its smart TVs
LG was quick to introduce Wii-style motion controls and pointing to its smart TV controllers, but its new Magic Remote also adds voice recognition, allowing you to enter search terms without ever contemplating the alphabet. In a radical move, it also conjures up a scroll wheel -- perhaps for no reason other than to spite Samsung's now dowdy-looking QWERTY rival. The fact that it can control your LG Cinema 3D TV without forcing you to star-jump is a happy bonus. There's a full PR after the break, although no sign yet of availability or pricing.
Trio of Microsoft projectors lets you get quasi-physical with AR interaction (video)
You have to hand it to the tireless folks toiling away within Microsoft's Research department. They're hard at the task of making tomorrowland today's province. Perhaps spurred on by the rapturous response to their HoloDesk, the Cambridge gang's previewing yet another virtual reality, and this time it's a handheld trio. The palm-friendly devices, split up into camera, room and SLAM models, incorporate pico projectors, coaxial IR cameras, inertial measurement units (IMUs) and the company's Kinect (for the latter two only) to project augmented visions onto surrounding surfaces. If you've been honing your shadow puppetry game over the years, that oft-used skill's about to get very useful. The environmentally aware (no, not the Go Green! kind) systems allow for shadow- and touch-based interaction with the CG overlays, offering pinch functionality, icon selection and even painting -- don't worry, it's definitely removable. This neat tech hat trick could one day soon spare you a trip to IKEA, letting you test out potential decorative pieces from the comfort of your home. Unfortunately, we can't get handsy with the futuristic projectors just yet, so the video after the break will have to suffice. [Thanks, Pradeep]
Hisense Series XT710 TV helps you exercise your La-Z-Boy sans remote
You might feel like the king of the couch, but let's face it -- picking up the remote can be exhausting. Hisense is hoping to lighten your load with the launch of its new Android-based Smart TV with hands-free eyeSight gesture recognition technology -- the Series XT710. Slated to launch in China, the TV features a 2D sensor, designed to understand your hand movements and interpret your every channel changing whim. Besides flipping between reruns of Law and Order and Jersey Shore, couch potatoes will also be able to play games and access Android applications through the intelligent tube. Now, if it could only help us pop our popcorn. Jump past the break to check out the full PR.
Microsoft reportedly preparing Silverlight-like app framework ahead of Xbox Live update
Earlier this month, Microsoft announced a new slate of Xbox Live partnerships with Verizon, Comcast, and a host of other content providers. Now, the company has unveiled new details about the code upon which these new apps will run. Sources close to the situation tell GigaOM that the new framework, code-named "Lakeview," will be based on Silverlight, but will also bring a few new features from Xbox Kinect, including voice recognition and gesture-based controls. More intriguing, perhaps, are insider claims that Microsoft's new content partners stream video using Apple's HTTP Live Streaming, rather than Redmond's Smooth Streaming. GigaOM's sources went on to say that Microsoft has been introducing major changes to the platform over the past few weeks, in the hopes of having it ready for third-party developers once the Xbox Live update rolls out. Spokespersons for Xbox and Silverlight said they have "nothing to announce" about the new framework, though GigaOM reports that Redmond is aiming to release the update on Black Friday.
Microsoft reveals new TV providers including Verizon and Comcast coming to Xbox 360 (video)
Just as the rumors indicated, Microsoft is bringing video from a number of providers beyond the ones it initially announced to the Xbox 360 in its fall update, including big guns like Verizon and Comcast. While Verizon is promising "a selection" of its live TV channels on the Xbox 360 as expected, Comcast is only bringing its Xfinity TV video on-demand offerings (no AnyPlay powered live TV -- yet) to subscribers when it launches "in the coming months." Other notable providers include Lovefilm (UK, Germany), BBC TV (UK), HBO Go, and Syfy. As promised during E3, the services integrated with Xbox will offer support for search across all available video, as well as support for Kinect voice and gesture controls. The universal search is looking good since it pulls together various services into one UI (as we discussed on our podcast yesterday), but the reality is content providers and geographical limits on what services you can pick from are still throwing up walls between users and content. Check after the break for PR detailing what you'll be able to access and where, as well as a video intro to all the tasty new TV services. %Gallery-135845%
Fujitsu Arrows Tab LTE F-01D with gesture control hands-on (video)
NEC's waterproof MEDIAS N-06C to get a sprinkle of Gingerbread and 1GHz power Wireless, Tablet PCs Sony's Tablet S and P get 3G in Japan NTT DoCoMo begins testing automated Japanese / English translation app that actually works (video) We'll probably never match Japan's obsession with waterproof gadgets, but anyone would appreciate how the local manufacturers also manage to keep them thin and light at the same time. The Fujitsu Arrows Tab LTE F-01D we fiddled with here at CEATEC is one such example: while it's thicker than Samsung's 10.1-inch counterpart by almost 3mm, we were surprised that Fujitsu's latest Android tablet also weighs just under 600g -- not bad considering it's suitable for use in the shower. What's more, the F-01D comes with a rather unique feature that's great for use in the bathroom or the kitchen: camera-based gesture control, which works in the browser (to scroll pages or go back and forth) as well as the 1seg or DLNA TV viewer (to change the channel and volume). You'll see in our video after the break that the gestures worked liked a charm for us, though initially we had to make sure that the tablet wasn't facing any strong light behind us (a typical problem in large conventions). Anyhow, if you're up for grabbing an F-01D, it'll be available on NTT DoCoMo in Japan next week. %Gallery-135783%
ASIMO mimics your every move, edges closer towards Single White Robot territory (video)
Hey, look Engadgeteers! It's another Kinect hack -- except this one uses a real deal robot. Honda ushered ASIMO out to the crowds at IEEE's 2011 International Conference on Intelligent Robots and Systems to show off its newly acquired pop and lock skills. Alright, so the silicon-gutted fella can't krump with the best of'em yet, but he can probably do the locomotion -- it all depends on your dance repertoire. After toiling away in their mad scientist lairs, the researchers behind the bot have managed to devise a means of mimicking human movement that translates mapped points on a user's upper body into real-time, robot-replicated motion. The devious among you are likely imagining left-of-center uses for the tech, but let us deflate that mischievous balloon; there'll be no instances of "stop hitting yourself ASIMO" here, as engineers have built-in collision and stability safeguards. The so-lifelike-it's-Uncanny advancements don't end there either, since ASIMO also contains a database of text-inspired gestures -- giving our future robot friend a means of physically expressing his cold, "I hate you so much right now" robo-tone. Other than finding himself at home in Italy, these innovations are sure to put ASIMO on the other end of our remote-controlled behest. Click on past the break to see this automated mime drop it like it's hot.
Microsoft Surface-controlled robots to boldly go where rescuers have gone before (video)
Ready to get hands-on in the danger zone -- from afar? That's precisely what an enterprising team of University of Massachusetts Lowell researchers are working to achieve with a little Redmond-supplied assistance. The Robotics Lab project, dubbed the Dynamically Resizing Ergonomic and Multi-touch (DREAM) Controller, makes use of Microsoft's Surface and Robotics Developer Studio to deploy and coordinate gesture-controlled search-and-rescue bots for potentially hazardous emergency response situations. Developed by Prof. Holly Yanco and Mark Micire, the tech's Natural User Interface maps a virtual joystick to a user's fingertips, delegating movement control to one hand and vision to the other -- much like an Xbox controller. The project's been under development for some time, having already aided rescue efforts during Hurricane Katrina, and with future refinements, could sufficiently lower the element of risk for first responders. Head past the break for a video demonstration of this life-saving research.
Apple seeks patents for 3D and 'physics metaphor' gesture controls
Deep in the stodgy bowels of the USPTO sits a folder full of Apple patent applications specifically for gesture controls. A few more pages from that expanding tome were just made public, and the concepts unearthed are certainly thought-provoking. The first involves using a proximity sensor in addition to the touch panel to register gestures in 3D. For example, you could use three fingers to mark out the corners of a triangle on the screen and then "pull up" and pinch to create a pyramid for use in a CAD application. The second idea involves gestures based on intuitive "physics metaphors" that are recognized using motion sensors. So instead of navigating menus in order to start a file transfer between an iPhone and iPad, the user could arrange the desired files on the phone's screen and then pretend to "pour" them onto the tablet -- an idea which rather reminds of the funky Project Blox. Oh, did we just make a Cupertino lawyer twitch?
Kinect app promises you'll wear flowery skirts, and you'll like it (video)
Don't be shy now: which of you doesn't love raiding your mother's closet and trying on her paisley dresses and velour tracksuits? That's more or less the idea behind Virtual Dressing Room, a Kinect program that taps into the clandestine thrill of sneaking into other people's boudoirs. Unlike some other shopping hacks we've seen, the app goes beyond just pilling on 2D pieces, but uses 3D models so that the items mold to your limbs, with the shadows and creases in the virtual fabric changing as you preen for the camera. That all comes courtesy of a special physics engine, while the app itself was written in C# along with Microsoft's XNA tools. Arbuzz, the group that dreamed this up, says the project's still a work in progress, though we can see this, too, being used to relieve those of who are allergic to shopping malls. Until then, you'll just have to settle for watching some other guy work a knee-length skirt.
Microsoft's NUAds interactive advertising to harness powers of Kinect, 'change television as we know it'
The folks over at Microsoft Advertising are quite fond of their latest brainchild, so much so that they're calling the Kinect-enabled advertising platform "irresistibly interactive." NUAds -- which snaked the NU in NUI -- feeds off our need for interactivity, allowing advertisers to lure us in by enabling points of gesture and voice control. Think the latest Snuggie spot is super cool? Just say "Xbox, Tweet," and all your friends will know it. Want to know more about Mariah Carey's latest fragrance? Say "Xbox, More," and the info is all yours. Wondering where you can pick up a box of Nad's edible hair remover? Say "Xbox, Near Me," and you'll get a text with the location of the closest Nad's retailer. Want to vote on the hottest new Bratz doll? Give your girl a thumbs up. So Microsoft may have engaged a host of more respectable partners, namely Adidas, NBC, and Coca Cola, for its demo of the voice and gesture-enabled advertising platform yesterday, and NUAds does indeed serve up promotions in an entirely new way, but will it really change how we view the boob tube for good? Check out the video demo after the break, and weigh in the comments below.
KinectShop concept is ready to televise your shopping revolution (video)
Does anybody actually enjoy the laborious process of trying out clothes? The sheer physical effort, the risk of breaking a sweat... it's just not for us. We're much more comfortable with virtual reality fitting rooms, which is where Microsoft's Kinect motion camera has found yet another raison for its etre. Razorfish, the folks who already impressed us with some neat Kinect hacking, now have a new shopping platform that's said to actually wrap clothes around your frame and thereby provide a 3D preview of what you and they would look like together. The current iteration only shows some giddy ladies exploring the wide world of handbags, but they do look suitably impressed with the system. There are also sharing options via QR codes and NFC, plus the obligatory social networking tie-ins. Skip after the break to see the KinectShop on video.
Kudo Tsunoda doesn't tell us a thing about Windows 8 support for Kinect
Microsoft asked us to drop by at E3 to chat up a generically identified "Xbox executive," imagine our surprise when we found Kudo Tsunoda hiding behind door number six. Wearing his signature shades, Kudo gave us a brief primer on what makes Kinect great, or at least a heavy endorsement of Kinect Fun Labs. While we can certainly dig the bite-sized gadgetry Fun Labs has to offer, we like to dig deeper -- will the Kinect hardware ever be integrated into other devices? Any plans for Microsoft's 3D tracking camera and Windows 8? Kudo did his best to feed our ravenous appetite for answers. It wasn't easy on poor Kudo, of course -- more than once we saw him glance longingly at his wrangler, a friendly PR rep keeping him from spilling the beans on anything too awesome. Probing about Windows 8 and Kinect produced one such look, and while our man very lightly suggested that Microsoft does more than games -- and that the dual-camera device might start showing up on other devices -- the big M had nothing to announce at that time. Kudo did go on to say, however, that we can expect to see new, innovative, "oh my gosh, I can't believe Kinect can do that" experiences at E3 year after year, citing this year's keynote for some recent examples. While we couldn't coax any leaks about Xbox or Kinect successors out of the man, it's good to see Microsoft's continued dedication to improving the platform.
Kinect integration in Ghost Recon: Future Soldier, hands-off (video)
Microsoft's E3 keynote may have exploded with deeper Kinect support, but nothing caught our eyes quite as sharply as Ghost Recon: Future Soldier's rifle-exploding Gunsmith demo. A Ubisoft representative showed us how it's done: separating your arms separates your deadly firearm into a gorgeous display of floating screws, components, and accessories, which can be effortlessly modified, swapped, and replaced with gesture and voice commands. Too picky to decide for yourself? Then don't: just tell Gunsmith what you're looking for. For instance, saying "Optimize for range" produces a weapon any sniper should be proud of -- even better, we found that commanding Gunsmith to "optimize for awesome" birthed a rifle (pictured above) sporting an underbarrel shotgun attachment. A gun attached to a gun? Yeah, that works. Weapons can be tested in Gunsmith's gesture-controlled firing range, an engaging shooting mode exclusive to the Gunsmith weapon editor and not usable in regular gameplay. Head past the break for a hands-on (figuratively speaking) video.
Netflix for Xbox 360 updated with Kinect support, everybody wave!
The next time you hit the Netflix app on your Xbox 360 the update we heard about at CES will be waiting, bringing Kinect owners the ability to flick through their videos (like ESPN3 and Zune have since the peripheral launched) without digging a controller out of the couch cushions. After the 43Mb update downloads waving ones hand for the camera or saying Xbox will pull up the new menu seen above, which auto sorts selections for browsing by voice or gesture based on what it thinks you may want to watch next. Selecting "browse all" brings you right back to the standard menu and is probably the method most will want to stick with, however being able to pause the movie quickly during playback by simply saying Xbox, Pause (or FF, rewind, skip scene, etc.) is quite convenient. Not near your Xbox? Check out a brief video of it in action after the break. [Thanks, George]
Sony's Move.me database used to create gesture-enabled mouse driver (video)
Unless you're into weird promotional mascots, video games, or measuring the rotation of the earth, the PlayStation Move probably hasn't caught your eye. Here's an idea: what if you could wave it about to control your PC? Earlier this week, electronics hobbyist Jacob Pennock used the Move.me C library to build a gesture-controlled mouse driver, and we've got the project's tech demo after the break. Watch as Pennock launches Facebook by drawing an "F," starts a video with a jaunty "V," and closes a few items with a quick "X" motion over the offending windows. Control motions are loaded through the creator's own gesture recognition library, called hyperglyph, which he claims can record motions with 98 percent accuracy. As Move.me is currently a closed beta, Pennock is keeping the source code under wraps, but he hopes to eventually put the driver to use controlling a gesture-based Linux media center. Pretty neat, but not quite enough to stave off our Kinect hack envy. [Thanks, Robert]
Gmail Motion April Fools' gag inevitably turned into reality using Kinect (video)
It had to happen. When Google showed off a new and revolutionary Gmail Motion control scheme yesterday, it failed to fool most people, but it didn't fail to catch the attention of some motion control geeks with Kinect cameras on hand. Yep, the FAAST crew that's already brought us a Kinect keyboard emulator for World of Warcraft has taken Google to task and actually cooked up the software to make Gmail Motion work. All your favorite gestures are here: opening an email as if it were an envelope, replying by throwing a thumb back and, of course, "licking the stamp" to send your response on its way. Marvelous stuff! Jump past the break to see it working, for real this time.
Xbox 360 IPTV rumors ride again with 'Project Orapa'
Just because Microsoft's Mediaroom IPTV service is finally supported on the Xbox 360 after years and years of expectations (as seen above) doesn't mean the rumor mill stops, with rumors surfacing of a "Project Orapa" that reportedly combines Xbox Live, Kinect and IPTV service all in one. ZDNet's Mary Jo Foley has heard from tipsters that it's related to the previously rumored Ventura multimedia project and will let subscribers to Mediaroom powered IPTV services like U-Verse use Kinect's gesture and voice recognition like ESPN3 already does to control their TV experience while Xbox users would get "more content." We should find out how much of this is reality and how it ties into previous rumors pretty quickly, since it's apparently going to be in testing this month, and available by the upcoming holiday season.
