gestures
Latest
University of Calgary's Fat Thumb trick allows one-handed phone use, jugglers are thankful (video)
Everyone's let it happen at some point -- that moment where we're desperately trying to use our smartphones in one hand while juggling groceries or coffee in the other. There'll be no way to recover those social graces, but six researchers at the University of Calgary have developed a software technique, Fat Thumb, that should at least keep the contortions and dropped phones to a minimum. As the name implies, it's all based around pressure: a light touch performs the usual commands, while squishing the thumb's wider surface area against the screen allows the equivalent of a multi-touch gesture, such as a pinch to zoom. The advantages for comfort and grip virtually speak for themselves; what's surprising is that Fat Thumb may well be faster than other one-handed gestures. Work on the project is so far confined to a research paper stemming from experiments with an iPhone, although it's easy to see this spreading to other platforms and real products before too long. Catch a glimpse of the cleverness in action after the break.
Leap Motion gesture control technology hands-on
Leap Motion unveiled its new gesture control technology earlier this week, along with videos showing the system tracking ten fingers with ease and a single digit slicing and dicing a grocery store's worth of produce in Fruit Ninja. Still, doubts persisted as to the veracity of the claim that the Leap is 200 times more accurate than existing tech. So, we decided to head up to San Francisco to talk with the men behind Leap, David Holz and Michael Buckwald, and see it for ourselves. Join us after the break to learn a bit more about Leap, our impressions of the technology, and a video of the thing in action.%Gallery-156126%
Leap Motion reveals super-accurate motion control tech, $70 device to change the UI game
In many respects, Microsoft has led the charge towards a future of gesture-based controls with its Kinect, and other tech giants like Samsung and Apple are getting in on the action, too. The move to motion controls isn't limited to the big boys, however. Leap Motion has created a new device, called the Leap, it claims is 200 times more accurate than existing technology and will take gesture controls to the next level. It's about the size of a pack of gum, and once connected to your computer via USB, it creates a eight-cubic-foot virtual workspace. Within that area, it tracks all ten of your fingers simultaneously to within 1/100 of a millimeter -- that level of accuracy allows for rudimentary gestures like pinch-to-zoom and more complex actions like manipulating 3D-rendered objects. Naturally, the company isn't telling much about the black magic making it happen, but Leap Motion claims that its software can be embedded in almost anything with an onboard computer, from phones to refrigerators. Users can customize it to suit their needs with custom gestures and sensitivity settings, in addition to chaining multiple Leap devices together to create a larger workspace. Plus, Leap Motion has created an SDK for devs to create Leap-compatible applications and an app discovery platform to distribute them to others. That means the Leap can work in a variety of use cases, from simply navigating your desktop to gaming and computer-aided design. The best part? Leap brings you this next-gen UX for a mere $69.99, and a select few can pre-order them now, with the full roll-out coming this winter. Full details follow in the PR below, and you can see the Leap in action in the videos after the break.
Google patent application could give Project Glass one true ring controller to rule them all
Let's face it: right now, the head nods and other rudimentary controls of Google's Project Glass are mostly useful for looking good, sharing photos and not much else. A US patent application submitted last September and just now published, however, raises the possibility of more sophisticated control coming from your hands. A ring, a bracelet or a even a fake fingernail with an infrared-reflective layer would serve as a gesture control marker for a receiver on heads-up display glasses. Having this extra control would give the glasses-mounted computing room to grow by learning gestures, and it could even depend on multiple ornaments for more sophisticated commands -- at least, if you don't mind looking like a very nerdy Liberace. We can imagine the headaches a hand-based method might cause for very enthusiastic talkers, among other possible hiccups, so don't be surprised if Project Glass goes without any kind of ring input. That said, we suspect that Sauron would approve.
Sign language translator turns gestures into spoken letters, makes for a better world (video)
By far one of the greatest challenges of sign language has been to translate it for everyday folk that wouldn't know where to begin a conversation with the deaf. Cornell University engineering students Ranjay Krishna, Seonwoo Lee and Si Ping Wang -- along with some help from Jonathan Lang -- used their final project time this past semester to close this gap in one of the more practical solutions we've seen to date. Their prototype glove uses accelerometers, contact sensors and flex sensors to translate complex finger gestures from the American Sign Language alphabet into spoken letters: after converting hand positions to digital signals, the test unit both speaks out the resulting letters and sends them to a computer, where they can be used for anything from a game (shown in the video below) to, presumably, constructing whole sentences. Along with being accurate, the Cornell work is even designed with a mind towards how it would work in the real world, as the glove and its transmitter are both wireless and powered by 9-volt batteries. We hope that the project leads to a real product and an extra bridge between the deaf and the rest of us, but in the meantime, we'll be happy that at least one form of powered glove is being put to the noblest use possible.
Touchpad Free adds Windows 8 gestures to its WP7 app
There's no shortage of apps that let you use your mobile phone as a touchpad for your computer, but Touchpad Free is the first we've heard of that adds explicit support for Windows 8 gestures. The remote pointer app should allow your Mango-powered device to play nice with that preview copy of Win 8 you've been running since it hit the web, complete with the multitouch gestures that are key to navigating the metro interface. To get it up and running you'll have to install a small server app on your PC which you can find at the source. Follow the second source link and you'll come upon Touchpad Free itself. Neat huh? Well, what are you waiting for, go check it out.
Wacom Intuos5 touch review
It's no secret Wacom has a firm grasp on what it takes to make great graphic input devices. Fresh off of its introduction of the Inkling last fall, the outfit recently unveiled the latest member of its high-end pen tablet line, the Intous5 touch. Essentially, Wacom took what made the Intuos4 a great addition to any designer or illustrator's workflow and refined it, with this latest iteration sporting a new rubber-coated shell. It also implements touch gestures -- much like those on the fresh Bamboo models -- which can be customized to speed up tasks you need to complete on the regular, preferably without the aid of a mouse. Sure, a new matte black suit and the ability to navigate Adobe Creative Suite without a pen seem impressive at first glance, but is the new model worth investing northward of $229? Are you better off sticking with the Intuos4 you splurged on a while back? Let's see.
Researcher proposes Thumb on Hand gestures, no touchscreen necessary (video)
Would you be willing to wear an additional device in order to avoid interacting with another? That's the conundrum posed to us by Christian Loclair, a master's student at the Hasso Plattner Institute. His thesis, titled Thumb on Hand Interaction, proposes that users control their mobile equipment with simple hand gestures that are performed independently of their device's touchscreen. This level of freedom requires that users wear a depth camera on their chest, and builds upon prior research from the Hasso Plattner Institute that required use of both hands. Loclair proposes a diverse new set of gestures that users can perform with only one hand, where one's thumb acts as the primary navigation tool and one's palm serves as a trackpad. Another set of gestures is based on the interaction of one's thumb and index finger, which allows users to control sliders and the like. Perhaps once the research team determines how to implement this technology without making our lives more complex, we'll be able to sink our teeth into this one. In the meantime, you'll find a video demonstration after the break.
Hands-on with wireless, ultrasonic stylus and touchless gestures at MWC (video)
This isn't the first time you've heard of EPOS or XTR, but it's been quite some time since we've checked in with either of the outfits. So, imagine our surprise as we stumbled on new developments from each company as we perused the Texas Instruments booth at MWC. In the case of EPOS, we're shown a stylus that, in addition to offering traditional physical touch input, also allows users to interact with a device via ultrasound. The system is built upon TI's OMAP4 platform and requires that four microphones be placed at the corners of the screen. In this demonstration, we're shown how users can manipulate objects on a 3D plane via the Z-axis by pulling the pen away from the display. Next, we're shown a new application for the touchless gesturing system that XTR first debuted back in 2010. In this scenario, it's demonstrated how tablet owners could use the front-facing camera (at merely QVGA resolution) to flip through pages of a cookbook without worry of getting ingredients on the device. The concept software was developed by a French outfit known as Stonetrip, and also allows users to zoom and pan through the pages. You'll find demonstrations of each technology in a video after the break.
Google's 'continuous gesture' patent application runs circles around copy and paste
You know the drill, you're browsing an article about volcanos on your phone and want to know more about Eyjafjallajokull. You've got two options, commit that bad-boy to memory, or fiddle with copy and paste. Well, Google not only feels your pain, but has some medicine for it too -- if a patent filing is anything to go by. The application describes a two-part continuous gesture for easier searching on touchscreens. Imagine drawing a "g" with your finger, then circling the text or image you want to search in one motion, and you'll get the basic drift. It's also indicated that different letters could be drawn to search different sites, "w" for Wikipedia, "y" for Yahoo and so on. The patent also includes methods to search for multiple words from the same text, or even words and images. Certainly it's not too much of a stretch to imagine this becoming a standard part of Android, but, as always, we don't know for sure. That said, chances are we'll still be typing out our Icelandic friend's name by the time we do find out.
Mogees uses contact microphone and gesture recognition to create music on any surface (video)
The piezoelectric effect is an interesting phenomena. Capable of turning vibrations into electric signals, it's at the heart of the Mogees project from Bruno Zamborlin and Norbert Schnell. Here, a contact microphone is connected to a system that processes sound from unique gestures and then triggers the appropriate instrument in its database -- thereby turning virtually any surface into an experimental jam band. Different gestures may be added to Mogees, which can also recognize the difference between fingers and objects such as coins. The project isn't commercially available, but if you're unfamiliar with the magic of contact microphones, we think the video after the break will be a rather fascinating introduction. Hell, with a similar setup, anyone could be a budding musician. Just don't let it all go to your head if you make the big time.
Firefox 9.0 offers Mac OS X Lion gesture support
Firefox 9 is out now (the public page hasn't been updated yet as of this writing, but the build is available from official links already), and while that in itself isn't really big news (the uberpopular browser updates all the time, and plenty of people have already chosen to use Chrome or another browser anyway), there is one big note in this update worth mentioning: The app will now natively support two-finger swiping gestures on your MacBook (or Magic Mouse or trackpad, if you have one of those running). That means that without extra add-ons, you can now swipe two fingers forward or back to browse through your history, in addition to the other usual gestures available to most apps, like using two fingers to scroll and so on. The update to version 9 also adds improved theme navigation for OS X Lion as well, so that's a nice bonus. One thing that's not in the app yet is an actual Lion-style full-screen mode. Firefox has its own fullscreen mode, but it's not exactly the one-app view that Apple expects. And while Firefox is easy enough to install and update on its own, there's no Mac App Store version yet. Mozilla may not be interested in running updates through Apple's App Store, but it might be easier for users to do so. At any rate, if you're running Firefox on your Mac, you should grab the update now. I personally like Firefox, but for some reason it's never run well on my MacBook, and I switched over to Chrome full time a few months ago. But it's a solid browser (aside from some issues with memory leaks, mostly having to do with Flash, in my experience), and this update adds a little more Mac-specific functionality as well.
ASIMO mimics your every move, edges closer towards Single White Robot territory (video)
Hey, look Engadgeteers! It's another Kinect hack -- except this one uses a real deal robot. Honda ushered ASIMO out to the crowds at IEEE's 2011 International Conference on Intelligent Robots and Systems to show off its newly acquired pop and lock skills. Alright, so the silicon-gutted fella can't krump with the best of'em yet, but he can probably do the locomotion -- it all depends on your dance repertoire. After toiling away in their mad scientist lairs, the researchers behind the bot have managed to devise a means of mimicking human movement that translates mapped points on a user's upper body into real-time, robot-replicated motion. The devious among you are likely imagining left-of-center uses for the tech, but let us deflate that mischievous balloon; there'll be no instances of "stop hitting yourself ASIMO" here, as engineers have built-in collision and stability safeguards. The so-lifelike-it's-Uncanny advancements don't end there either, since ASIMO also contains a database of text-inspired gestures -- giving our future robot friend a means of physically expressing his cold, "I hate you so much right now" robo-tone. Other than finding himself at home in Italy, these innovations are sure to put ASIMO on the other end of our remote-controlled behest. Click on past the break to see this automated mime drop it like it's hot.
Microsoft gesture patents reveal possible dual-screen tablet focus
Earlier this year, we heard a slew of whispers promising a late winter launch for Microsoft's Windows 8 tablets -- there was even mention of a tab-specific OS. While it's become clear that Redmond intends for its new operating system to run on multiple devices, insight into its tablet plans are still somewhat shrouded in mystery. From the looks of these gesture patents, however, it's clear MS has been eyeing a dual-screen tablet future (hello Courier). The recently published patents, not yet granted to the company, touch upon methods for off-screen input (read: bezel-based), but mainly focus on these multi-screen input options: dual tap, pinch and expand, hold and page-flip, hold and tap, and finally, bookmark hold. As you can glimpse from the image above, the patents handle simultaneous touch screen input, allowing a user the ability to swap images between screens, or even freeze a page on one side while continuing to browse on the other. By the looks of things, Sony might have some fierce competition in the multi-screen tablet market. Head to the source below to get a fuller look at these touch-based solutions.
Meet Patty, Microsoft's Surface 2.0 stress test robot
Locked behind a gated fence and unseen by the public until now, lives Patty, Microsoft's Surface 2.0 stress test robot. Designed to see just how much Gates' touchscreen can take, this lady bot uses 80 compressed air-driven probes, six motors and a robotic moving head to apply maximum stress to the display. It works as such: by giving Patty a command, engineers can move probes across the screen at 25 inches per second -- mimicking the movement of fingers, hands and whatever else it might encounter IRL. With so much multitasking, it's no wonder she comes with a giant red emergency stop button -- just in case. See Patty do her thing by hitting the source link below.
Microsoft Surface-controlled robots to boldly go where rescuers have gone before (video)
Ready to get hands-on in the danger zone -- from afar? That's precisely what an enterprising team of University of Massachusetts Lowell researchers are working to achieve with a little Redmond-supplied assistance. The Robotics Lab project, dubbed the Dynamically Resizing Ergonomic and Multi-touch (DREAM) Controller, makes use of Microsoft's Surface and Robotics Developer Studio to deploy and coordinate gesture-controlled search-and-rescue bots for potentially hazardous emergency response situations. Developed by Prof. Holly Yanco and Mark Micire, the tech's Natural User Interface maps a virtual joystick to a user's fingertips, delegating movement control to one hand and vision to the other -- much like an Xbox controller. The project's been under development for some time, having already aided rescue efforts during Hurricane Katrina, and with future refinements, could sufficiently lower the element of risk for first responders. Head past the break for a video demonstration of this life-saving research.
Qbo music player robot responds to hand gestures, challenges DJ Roomba to a dance-off (video)
What's a good way to impress your friends? With a robot boom box that responds to your every hand movement, that's how. Meet Qbo, TheCorpora's open-source Linux robot who we've gotten to know over the years, even through his awkward phase. Nowadays, this full grown cutie has stereoscopic "eyes" and a face-identifying system that's capable of learning, recognizing faces, and responding. With his new hand gesture recognition skills, Qbo will start playing music the moment you hold up a fist. Putting your hand out in a "halt" position stops the song and pointing left or right jumps to different tracks in your playlist. Giving Qbo the peace sign increases the volume (yeah, seriously!), while pointing the peace sign down tells him to take it down a few notches. The ultimate party mate and wing man is even so kind as to announce the name and title of the track. The video after the break best explains what hanging with this fellow is like, but if you're keen on textual explanations, just imagine yourself awkwardly doing the robot to control your stereo. Go on, we won't look.
Google Chrome team working on multi-touch gestures
Google has released a new developer build of Chrome that fixes some of the browser navigation gestures that were disrupted with the release of Lion. On pre-Lion systems, a three-finger swipe inside of Chrome would move the user a page forwards or backwards in their web browsing history. Under Lion however, that same three-finger swipe is a system-wide gesture that moves users between different full-screen apps. The newest developer build of Chrome for Mac, version 14.0.835.0, fixes the gesture confusion. Now in Chrome users will use a two-finger swipe to move a page forwards or backwards in their web browsing history. This adheres to Lions built-in gestures, leaving the three-finger swipe for full-screen app switching. No word yet on an exact release date for this next version of Chrome, but Cnet thinks it will be at least a few weeks until it's rolled out to all users.
Qualcomm acquires gesture recognition IP from GestureTek, aims for Snapdragon integration
What's superior to a shiny new Snapdragon, blazing all sorts of benchmarking trails in your next tablet and / or smartphone? Why, a Snapdragon with a pinch of IP from GestureTek, of course! Qualcomm has today announced its intentions to acquire "certain assets" from GestureTek, a long-standing developer of gesture recognition technology. We've seen the aforementioned outfit touch the mobile (and not-so-mobile) realm before, but now it looks like it'll be more aggressively touching devices with Qualcomm silicon. It's a strange move, indeed, but it could be one that signals a shift in the way chip makers are looking out for themselves. OEMs have long tried to skin their Android devices in a way that'll breed loyalty to a brand (rather than an OS), but loyalty to a CPU? According to Qually (yeah, what of it?), the buy will give it access to "key engineering resources," and while GestureTek will maintain "other assets in continuation of its gesture-controlled public display and digital signage business," we suspect the consumer-facing aspects will soon have a new master. We're told that the tech will be woven into current and next-gen Snapdragon processors, but only time will tell what sort of seamless wizardry will result. Hope your digits are ready.
Poll: Did you download Mac OS X Lion (10.7)?
Apple confirmed Lion's big day during the company's Q3 earnings call this week, and Mac OS 10.7 hit the App Store right on schedule yesterday morning, allowing us to give Snow Leopard the boot and make room for the king of the jungle. We've already installed Lion on a half-dozen of our own systems, testing the new operating system with a variety of configurations for our review. But we want to know about your experience. Did you pull an all-nighter on Tuesday, backing up files, reformatting drives, and updating to 10.6.8? Are you still rockin' dial-up and waiting for the $69 flash drive version to ship next month? Or perhaps you're a PC user, holding out for Windows 8? Let us know in the poll below, and feel free to expand on your decision in the comments as well.%Poll-66596%
