gesture
Latest
Huawei throws R&D dollars at gesture control, cloud storage, being more 'disruptive'
Undeterred by the fact that even humans struggle to interpret certain gestures, Huawei says it's allocating a chunk of its growing R&D budget to new motion-sensing technology for smartphones and tablets. The company's North American research chief, John Roese, told Computerworld that he wants to allow "three-dimensional interaction" with devices using stereo front-facing cameras and a powerful GPU to make sense of the dual video feed. Separately, the Chinese telecoms company is also putting development cash into a cloud computing project that promises to "change the economics of storage by an order of magnitude." Roese provided scant few details on this particular ambition, but did mention that Huawei has teamed up with CERN to conduct research and has somehow accumulated over 15 petabytes of experimental physics data in the process. Whatever it's up to, Huawei had better get a move on -- others are snapping up gesture recognition and cloud patents faster than you can say fa te ne una bicicletta with your hands.
Ubi-Camera frames photos with fingers, fails to call you fabulous (video)
Gesture control's no longer restricted to P.K. Dick novels, having firmly broken away from its fantasist scifi roots into practical, everyday use. It's only natural then that those advancements, typically reserved for computing, would bleed into other areas of consumer tech, like digital imaging. For researchers at Japan's Institute of Advanced Media Arts and Sciences, that manual dexterity appears to be the next great photographic leap, as the L-squared hand-framing you're accustomed to seeing photogs mime on TV and film could wind up replacing physical point-and-shoots soon.The team's prototype, dubbed Ubi-Camera, may look more like a mini-cube than mini-cam, but it works rather intuitively: simply hook it onto your index finger, adjust the focus by moving the "viewfinder" nearer to your face for wide-angle shots or further away for close-ups and then snap away using the side-mounted shutter button. The project's not without its hiccups, however, as the in-development unit's infrared sensor, used to determine range, can be easily affected by lighting conditions. Additionally, there's no zoom function, as that process is handled entirely in post on a desktop PC. All told, these are really rather small bumps in the road to an inevitable marketplace debut. Next up for IAMAS? Crushing people's heads with your fingers. At least, that's on our wish list. Video demo after the break.
Researcher proposes Thumb on Hand gestures, no touchscreen necessary (video)
Would you be willing to wear an additional device in order to avoid interacting with another? That's the conundrum posed to us by Christian Loclair, a master's student at the Hasso Plattner Institute. His thesis, titled Thumb on Hand Interaction, proposes that users control their mobile equipment with simple hand gestures that are performed independently of their device's touchscreen. This level of freedom requires that users wear a depth camera on their chest, and builds upon prior research from the Hasso Plattner Institute that required use of both hands. Loclair proposes a diverse new set of gestures that users can perform with only one hand, where one's thumb acts as the primary navigation tool and one's palm serves as a trackpad. Another set of gestures is based on the interaction of one's thumb and index finger, which allows users to control sliders and the like. Perhaps once the research team determines how to implement this technology without making our lives more complex, we'll be able to sink our teeth into this one. In the meantime, you'll find a video demonstration after the break.
Hands-on with wireless, ultrasonic stylus and touchless gestures at MWC (video)
This isn't the first time you've heard of EPOS or XTR, but it's been quite some time since we've checked in with either of the outfits. So, imagine our surprise as we stumbled on new developments from each company as we perused the Texas Instruments booth at MWC. In the case of EPOS, we're shown a stylus that, in addition to offering traditional physical touch input, also allows users to interact with a device via ultrasound. The system is built upon TI's OMAP4 platform and requires that four microphones be placed at the corners of the screen. In this demonstration, we're shown how users can manipulate objects on a 3D plane via the Z-axis by pulling the pen away from the display. Next, we're shown a new application for the touchless gesturing system that XTR first debuted back in 2010. In this scenario, it's demonstrated how tablet owners could use the front-facing camera (at merely QVGA resolution) to flip through pages of a cookbook without worry of getting ingredients on the device. The concept software was developed by a French outfit known as Stonetrip, and also allows users to zoom and pan through the pages. You'll find demonstrations of each technology in a video after the break.
Google's 'continuous gesture' patent application runs circles around copy and paste
You know the drill, you're browsing an article about volcanos on your phone and want to know more about Eyjafjallajokull. You've got two options, commit that bad-boy to memory, or fiddle with copy and paste. Well, Google not only feels your pain, but has some medicine for it too -- if a patent filing is anything to go by. The application describes a two-part continuous gesture for easier searching on touchscreens. Imagine drawing a "g" with your finger, then circling the text or image you want to search in one motion, and you'll get the basic drift. It's also indicated that different letters could be drawn to search different sites, "w" for Wikipedia, "y" for Yahoo and so on. The patent also includes methods to search for multiple words from the same text, or even words and images. Certainly it's not too much of a stretch to imagine this becoming a standard part of Android, but, as always, we don't know for sure. That said, chances are we'll still be typing out our Icelandic friend's name by the time we do find out.
Globe and Mail reveals early details on Apple iTV: Siri wants to hear you shout at the big game
iTV rumors continue to swirl around the shady backwaters of the internet, but it's not often national papers of record decide to wade in -- Canada's, no less. According to an anonymous source who spilled the beans to the Globe and Mail, Apple's TV set will include Siri-powered voice control, with the virtual assistant also helping in those ever-pressing "programming choices". There will also be gesture recognition courtesy of a front-facing camera and (perhaps most worryingly) an on-screen keyboard for typing into a web browser and other apps. The paper couldn't confirm whether the device will play nice with the rest of la familia iOS, although another mole informed the Canadian news source that both Rogers and BCE Inc are jostling to claim a stake in the mysterious device, with Apple apparently actively courting both carriers.
LG waves its wand, unveils Magic Remote for Cinema 3D sets
LG whipped out the magic wand at CES this morning, with the announcement of an enhanced Magic Remote. With this new tool, users will be able to control their Cinema 3D Smart TVs with an expanded set of functions, including voice recognition, a "wheel" function, "magic" gestures and pointing. Expanding beyond the realm of simple push-button functionality, the Magic Remote's voice recognition capabilities allow viewers to enter text and other commands without even lifting a finger, while its wheel, perched at the center of the device, allows them to seamlessly scroll up and down their TVs as they would on a PC. Alternatively, users could simply point the Remote at their displays to move their onscreen cursors around the screen, or input gesture commands to control their Smart TVs with their arms or wrists. The device also features a dedicated button that allows users to instantly convert 2D to 3D, and can be used to control set-top boxes, as well. No word yet on pricing or availability, but you can head past the break for more details in the full PR.
Mogees uses contact microphone and gesture recognition to create music on any surface (video)
The piezoelectric effect is an interesting phenomena. Capable of turning vibrations into electric signals, it's at the heart of the Mogees project from Bruno Zamborlin and Norbert Schnell. Here, a contact microphone is connected to a system that processes sound from unique gestures and then triggers the appropriate instrument in its database -- thereby turning virtually any surface into an experimental jam band. Different gestures may be added to Mogees, which can also recognize the difference between fingers and objects such as coins. The project isn't commercially available, but if you're unfamiliar with the magic of contact microphones, we think the video after the break will be a rather fascinating introduction. Hell, with a similar setup, anyone could be a budding musician. Just don't let it all go to your head if you make the big time.
Western Digital releases Android app to control set-top boxes remotely
This week, you'll be able to control your Western Digital set-top box with a free Android app. And you'll love it. Only days after releasing an equivalent app for iOS, Western Digital has just released WD TV Remote, a free Android app that connects to your Western Digital set-top box over a WiFi connection and allows you to control it from any Android-based device. The app includes one-touch access to every online service available, keyboard entry using Android's on-screen keyboard, a gesture pad for quick navigation and the ability to connect multiple Android devices at once. WD TV Remote requires Android 2.1 or later to install, as well as a WiFi network and third-generation WD TV Live Hub or TV Live system to run. In other news, development on an Android app to paint your house via gesture controls is proceeding quite nicely.
LG's Magic Remote enables voice control for its smart TVs
LG was quick to introduce Wii-style motion controls and pointing to its smart TV controllers, but its new Magic Remote also adds voice recognition, allowing you to enter search terms without ever contemplating the alphabet. In a radical move, it also conjures up a scroll wheel -- perhaps for no reason other than to spite Samsung's now dowdy-looking QWERTY rival. The fact that it can control your LG Cinema 3D TV without forcing you to star-jump is a happy bonus. There's a full PR after the break, although no sign yet of availability or pricing.
Insert Coin: Prototype peripherals incorporate no moving parts, multitouch functionality and freaking lasers
In Insert Coin, we look at an exciting new tech project that requires funding before it can hit production. If you'd like to pitch a project, please send us a tip with "Insert Coin" as the subject line. When in doubt, strip out the moving parts and see what you wind up with. This is the idea inventor Jason Giddings is following as he turns to Kickstarter to help fund the prototype creation for a glass keyboard and mouse, both sporting multitouch functionality. The design uses the same biometric systems that currently capture fingerprints on assorted trackpads and keyboards, and uses a technique known as Frustrated Total Internal Reflection -- which incorporates a series of LEDs on the bottom of a device -- to bounce infrared light beams around the inside of the glass. This process is interrupted when a finger touches the glass, wherein a simple embedded camera captures the event, processes where the keystroke, mouse click or gesture took place and relays the signal to the computer.
Microsoft outlines Code Space, looks to include Kinect in conference rooms, PTA meetings (video)
If there's one thing that's certain about the Kinect, it's this; Microsoft wants it to be versatile. Case in point, Code Space -- the next extracurricular activity for the gaming controller which sees it teaming up with smartphones and laptops to present information on a shared screen. The project is aimed at presenting and exchanging code in developer meetings using a large display and simple hand gestures, though we could easily see this being adopted in both the classroom and the boardroom as well. In other news, the Kinect will be able to paint your house this spring, even if you may not be crazy about the final color... Update: We realize it's a bit slow at times, but if you'd like to see Code Space in action, just hop the break. You'll discover the magic. [Thanks, Andrew] %Gallery-139332%
Trio of Microsoft projectors lets you get quasi-physical with AR interaction (video)
You have to hand it to the tireless folks toiling away within Microsoft's Research department. They're hard at the task of making tomorrowland today's province. Perhaps spurred on by the rapturous response to their HoloDesk, the Cambridge gang's previewing yet another virtual reality, and this time it's a handheld trio. The palm-friendly devices, split up into camera, room and SLAM models, incorporate pico projectors, coaxial IR cameras, inertial measurement units (IMUs) and the company's Kinect (for the latter two only) to project augmented visions onto surrounding surfaces. If you've been honing your shadow puppetry game over the years, that oft-used skill's about to get very useful. The environmentally aware (no, not the Go Green! kind) systems allow for shadow- and touch-based interaction with the CG overlays, offering pinch functionality, icon selection and even painting -- don't worry, it's definitely removable. This neat tech hat trick could one day soon spare you a trip to IKEA, letting you test out potential decorative pieces from the comfort of your home. Unfortunately, we can't get handsy with the futuristic projectors just yet, so the video after the break will have to suffice. [Thanks, Pradeep]
Kinect hack lets you manage your bank account with gestures, will occupy your living room (video)
You know all those convoluted gestures and hate-infused fist pumps you make every time you look at your bank account? Well, you can now put them to good use, thanks to a new Kinect hack from Lithuania-based Etronika. The company's software, which made its debut at last week's CTIA E&A event, effectively brings motion-controlled banking directly to your living room. All you have to do is stand in front of your display, clap your hands to choose an icon, or wave your hand back and forth to navigate across the app's carousel menu. This means you can pay your bills, check your balance and return to fetal position without even touching a sharp object. "A lot of banking software apps are filled with boring crap," Etronika CEO Kestutis Gardziulis explained with refreshing candor. "With our software, you could be on the couch at home, having a beer, all while dealing with your bank account and kicking back." Beer, banking and body language -- sounds scandalous! Head past the break to watch a demo video, starring Pam Beesly's doppelgänger.
Maide Control iPad app lets you build and view 3D models with your bare, sweaty hands (video)
Looking for a hands-on 3D controller that won't require any five-fingered peripherals? Check out Maide Control -- a new app that allows users to manipulate 3D CAD data from the comfort of their iPad displays. Available for $4.99 on iTunes, this app will wirelessly sync an iPad with any compatible 3D program, thereby enabling modelers to mold and view their designs using an array of multitouch gestures. You can also use Maide Control to showcase models on larger displays (say, at a company presentation), or to connect multiple iPads to the same render, in case you're working on a more collaborative project. For now, the app only supports Google SketchUp and Rhino on Windows only, though the company plans to incorporate other 3D apps and Mac support in the near future. Wiggle past the break to see a pair of demo videos, or hit up the source link below to download the app directly from iTunes.
Microsoft reportedly preparing Silverlight-like app framework ahead of Xbox Live update
Earlier this month, Microsoft announced a new slate of Xbox Live partnerships with Verizon, Comcast, and a host of other content providers. Now, the company has unveiled new details about the code upon which these new apps will run. Sources close to the situation tell GigaOM that the new framework, code-named "Lakeview," will be based on Silverlight, but will also bring a few new features from Xbox Kinect, including voice recognition and gesture-based controls. More intriguing, perhaps, are insider claims that Microsoft's new content partners stream video using Apple's HTTP Live Streaming, rather than Redmond's Smooth Streaming. GigaOM's sources went on to say that Microsoft has been introducing major changes to the platform over the past few weeks, in the hopes of having it ready for third-party developers once the Xbox Live update rolls out. Spokespersons for Xbox and Silverlight said they have "nothing to announce" about the new framework, though GigaOM reports that Redmond is aiming to release the update on Black Friday.
Fujitsu Arrows Tab LTE F-01D with gesture control hands-on (video)
NEC's waterproof MEDIAS N-06C to get a sprinkle of Gingerbread and 1GHz power Wireless, Tablet PCs Sony's Tablet S and P get 3G in Japan NTT DoCoMo begins testing automated Japanese / English translation app that actually works (video) We'll probably never match Japan's obsession with waterproof gadgets, but anyone would appreciate how the local manufacturers also manage to keep them thin and light at the same time. The Fujitsu Arrows Tab LTE F-01D we fiddled with here at CEATEC is one such example: while it's thicker than Samsung's 10.1-inch counterpart by almost 3mm, we were surprised that Fujitsu's latest Android tablet also weighs just under 600g -- not bad considering it's suitable for use in the shower. What's more, the F-01D comes with a rather unique feature that's great for use in the bathroom or the kitchen: camera-based gesture control, which works in the browser (to scroll pages or go back and forth) as well as the 1seg or DLNA TV viewer (to change the channel and volume). You'll see in our video after the break that the gestures worked liked a charm for us, though initially we had to make sure that the tablet wasn't facing any strong light behind us (a typical problem in large conventions). Anyhow, if you're up for grabbing an F-01D, it'll be available on NTT DoCoMo in Japan next week. %Gallery-135783%
ASIMO mimics your every move, edges closer towards Single White Robot territory (video)
Hey, look Engadgeteers! It's another Kinect hack -- except this one uses a real deal robot. Honda ushered ASIMO out to the crowds at IEEE's 2011 International Conference on Intelligent Robots and Systems to show off its newly acquired pop and lock skills. Alright, so the silicon-gutted fella can't krump with the best of'em yet, but he can probably do the locomotion -- it all depends on your dance repertoire. After toiling away in their mad scientist lairs, the researchers behind the bot have managed to devise a means of mimicking human movement that translates mapped points on a user's upper body into real-time, robot-replicated motion. The devious among you are likely imagining left-of-center uses for the tech, but let us deflate that mischievous balloon; there'll be no instances of "stop hitting yourself ASIMO" here, as engineers have built-in collision and stability safeguards. The so-lifelike-it's-Uncanny advancements don't end there either, since ASIMO also contains a database of text-inspired gestures -- giving our future robot friend a means of physically expressing his cold, "I hate you so much right now" robo-tone. Other than finding himself at home in Italy, these innovations are sure to put ASIMO on the other end of our remote-controlled behest. Click on past the break to see this automated mime drop it like it's hot.
Microsoft gesture patents reveal possible dual-screen tablet focus
Earlier this year, we heard a slew of whispers promising a late winter launch for Microsoft's Windows 8 tablets -- there was even mention of a tab-specific OS. While it's become clear that Redmond intends for its new operating system to run on multiple devices, insight into its tablet plans are still somewhat shrouded in mystery. From the looks of these gesture patents, however, it's clear MS has been eyeing a dual-screen tablet future (hello Courier). The recently published patents, not yet granted to the company, touch upon methods for off-screen input (read: bezel-based), but mainly focus on these multi-screen input options: dual tap, pinch and expand, hold and page-flip, hold and tap, and finally, bookmark hold. As you can glimpse from the image above, the patents handle simultaneous touch screen input, allowing a user the ability to swap images between screens, or even freeze a page on one side while continuing to browse on the other. By the looks of things, Sony might have some fierce competition in the multi-screen tablet market. Head to the source below to get a fuller look at these touch-based solutions.
Meet Patty, Microsoft's Surface 2.0 stress test robot
Locked behind a gated fence and unseen by the public until now, lives Patty, Microsoft's Surface 2.0 stress test robot. Designed to see just how much Gates' touchscreen can take, this lady bot uses 80 compressed air-driven probes, six motors and a robotic moving head to apply maximum stress to the display. It works as such: by giving Patty a command, engineers can move probes across the screen at 25 inches per second -- mimicking the movement of fingers, hands and whatever else it might encounter IRL. With so much multitasking, it's no wonder she comes with a giant red emergency stop button -- just in case. See Patty do her thing by hitting the source link below.
