gesture
Latest
Microsoft Touch Mouse to take center stage at UIST Student Innovation Contest
It's August, and that can only mean three things: vacations, back to school shopping, and another UIST Student Innovation Contest. Taking center stage this year is Microsoft's Touch Mouse -- a multitouch gesture-based peripheral that we first saw earlier this year. UIST contestants will have to come up with cool new ways to interact with the mouse, with the winning innovator receiving $1500, and $500 going to the runner-up (trophies are apparently involved, as well). All entries will be demoed on October 17th in Santa Barbara, and the winners will be announced on the following day. Hit the source link for information on registration, or squeeze past the break for a video from UIST chair Kayur Patel, along with a clip on the Touch Mouse.
Qualcomm acquires gesture recognition IP from GestureTek, aims for Snapdragon integration
What's superior to a shiny new Snapdragon, blazing all sorts of benchmarking trails in your next tablet and / or smartphone? Why, a Snapdragon with a pinch of IP from GestureTek, of course! Qualcomm has today announced its intentions to acquire "certain assets" from GestureTek, a long-standing developer of gesture recognition technology. We've seen the aforementioned outfit touch the mobile (and not-so-mobile) realm before, but now it looks like it'll be more aggressively touching devices with Qualcomm silicon. It's a strange move, indeed, but it could be one that signals a shift in the way chip makers are looking out for themselves. OEMs have long tried to skin their Android devices in a way that'll breed loyalty to a brand (rather than an OS), but loyalty to a CPU? According to Qually (yeah, what of it?), the buy will give it access to "key engineering resources," and while GestureTek will maintain "other assets in continuation of its gesture-controlled public display and digital signage business," we suspect the consumer-facing aspects will soon have a new master. We're told that the tech will be woven into current and next-gen Snapdragon processors, but only time will tell what sort of seamless wizardry will result. Hope your digits are ready.
Switched On: The bedeviled bezel
Each week Ross Rubin contributes Switched On, a column about consumer technology. One of the few homages that the Palm Pre paid to the Palm Pilot was the gesture area, a separate part of the display face below the screen used for swipes just as the Pilot had a separate area devoted to entering Graffiti strokes. Unfortunately (like Graffiti before it), the gesture area was one of the least intuitive aspects of the Pre's operation, and HP has been moving away from it as a required navigation element. On the TouchPad, the gesture area has been scrapped in favor of an iPad-like bottom button. But HP hasn't outright ignored the bezel on the TouchPad. Users can still swipe inbound from the bezel as an alternative way of bringing up its card view. Indeed, in 2011, it seems like nearly everyone has been taking a swipe at the bezel around touchscreen displays. First, RIM introduced inbound bezel swipes as a key navigation element on the PlayBook for activating menus, bringing up applications to launch, and its own webOS-like app switching interface. Microsoft showed how inbound bezel swipes will be part of the navigation for touchscreen devices in Windows 8. And MeeGo also uses the inbound bezel swipe as its keystone user interface element on smartphones...
Apple seeks patents for 3D and 'physics metaphor' gesture controls
Deep in the stodgy bowels of the USPTO sits a folder full of Apple patent applications specifically for gesture controls. A few more pages from that expanding tome were just made public, and the concepts unearthed are certainly thought-provoking. The first involves using a proximity sensor in addition to the touch panel to register gestures in 3D. For example, you could use three fingers to mark out the corners of a triangle on the screen and then "pull up" and pinch to create a pyramid for use in a CAD application. The second idea involves gestures based on intuitive "physics metaphors" that are recognized using motion sensors. So instead of navigating menus in order to start a file transfer between an iPhone and iPad, the user could arrange the desired files on the phone's screen and then pretend to "pour" them onto the tablet -- an idea which rather reminds of the funky Project Blox. Oh, did we just make a Cupertino lawyer twitch?
Kinect app promises you'll wear flowery skirts, and you'll like it (video)
Don't be shy now: which of you doesn't love raiding your mother's closet and trying on her paisley dresses and velour tracksuits? That's more or less the idea behind Virtual Dressing Room, a Kinect program that taps into the clandestine thrill of sneaking into other people's boudoirs. Unlike some other shopping hacks we've seen, the app goes beyond just pilling on 2D pieces, but uses 3D models so that the items mold to your limbs, with the shadows and creases in the virtual fabric changing as you preen for the camera. That all comes courtesy of a special physics engine, while the app itself was written in C# along with Microsoft's XNA tools. Arbuzz, the group that dreamed this up, says the project's still a work in progress, though we can see this, too, being used to relieve those of who are allergic to shopping malls. Until then, you'll just have to settle for watching some other guy work a knee-length skirt.
Microsoft's NUAds interactive advertising to harness powers of Kinect, 'change television as we know it'
The folks over at Microsoft Advertising are quite fond of their latest brainchild, so much so that they're calling the Kinect-enabled advertising platform "irresistibly interactive." NUAds -- which snaked the NU in NUI -- feeds off our need for interactivity, allowing advertisers to lure us in by enabling points of gesture and voice control. Think the latest Snuggie spot is super cool? Just say "Xbox, Tweet," and all your friends will know it. Want to know more about Mariah Carey's latest fragrance? Say "Xbox, More," and the info is all yours. Wondering where you can pick up a box of Nad's edible hair remover? Say "Xbox, Near Me," and you'll get a text with the location of the closest Nad's retailer. Want to vote on the hottest new Bratz doll? Give your girl a thumbs up. So Microsoft may have engaged a host of more respectable partners, namely Adidas, NBC, and Coca Cola, for its demo of the voice and gesture-enabled advertising platform yesterday, and NUAds does indeed serve up promotions in an entirely new way, but will it really change how we view the boob tube for good? Check out the video demo after the break, and weigh in the comments below.
Sliding Keyboard: it's like Swype, but for Windows Phone 7
In the Android realm, Swype has been life-changing for many; of course, reverting back to the messaging ways of old has been a must when jumping ship to WP7. Now, gesture tracing crosses the aisle, and it's hopping over to Microsoft's turf courtesy of Invoke IT's Sliding Keyboard. With the look of the regular ol' WP7 keyboard, this set of arm floaties records the user tracing out text, just like ex-Android fans are accustomed to. The company goes a bit further by offering a pair of goggles -- in the form of Bing search, text messaging and email options along the bottom of the app. Sure, it's seeing its fair share of first-revision bugs (word recognition seems a bit poor based on early reviews), but at a cool $1.29 (and a free trial preceding that), it's a good bit cheaper than a therapy session. Right?
KinectShop concept is ready to televise your shopping revolution (video)
Does anybody actually enjoy the laborious process of trying out clothes? The sheer physical effort, the risk of breaking a sweat... it's just not for us. We're much more comfortable with virtual reality fitting rooms, which is where Microsoft's Kinect motion camera has found yet another raison for its etre. Razorfish, the folks who already impressed us with some neat Kinect hacking, now have a new shopping platform that's said to actually wrap clothes around your frame and thereby provide a 3D preview of what you and they would look like together. The current iteration only shows some giddy ladies exploring the wide world of handbags, but they do look suitably impressed with the system. There are also sharing options via QR codes and NFC, plus the obligatory social networking tie-ins. Skip after the break to see the KinectShop on video.
Kinect integration in Ghost Recon: Future Soldier, hands-off (video)
Microsoft's E3 keynote may have exploded with deeper Kinect support, but nothing caught our eyes quite as sharply as Ghost Recon: Future Soldier's rifle-exploding Gunsmith demo. A Ubisoft representative showed us how it's done: separating your arms separates your deadly firearm into a gorgeous display of floating screws, components, and accessories, which can be effortlessly modified, swapped, and replaced with gesture and voice commands. Too picky to decide for yourself? Then don't: just tell Gunsmith what you're looking for. For instance, saying "Optimize for range" produces a weapon any sniper should be proud of -- even better, we found that commanding Gunsmith to "optimize for awesome" birthed a rifle (pictured above) sporting an underbarrel shotgun attachment. A gun attached to a gun? Yeah, that works. Weapons can be tested in Gunsmith's gesture-controlled firing range, an engaging shooting mode exclusive to the Gunsmith weapon editor and not usable in regular gameplay. Head past the break for a hands-on (figuratively speaking) video.
Microsoft patent pictures networked, personalized profiles for Kinect-like system
A newly published patent application, submitted by Microsoft to the USPTO back in October 2009, describes the personalization of a "gesture-based system" -- presumably, what would become Kinect -- through detailed user profiles that could be stored on a network. It's anyone's guess if this is a glimpse at where Kinect profiles are going (through potential updates) or what they could have been. The patent outlines a "gesture profile" that could record user preferences for various tasks and system commands. "For example," the application proposes, "a user may prefer to use a checkmark to indicate 'checked' while others may use an X. A user may have a different manner for performing the gesture, such as quicker or more exaggerated motions." Over time, "the system may more fully identify and/or distinguish the user's gestures, thus providing more accuracy and speed for gesture recognition." The proposal also suggests that such a profile could be "roaming in a network." In other words, the user's gesture profile could be connected to any number of potential devices (as pictured). Networked profiles, too, good be updated by the system to make "intelligent" changes to an application's default gesture data based on the users' region. As the patent writers warn, "Different cultures may use similar gestures to impart markedly different meanings." "For instance, an American user who wishes to tell another user to 'look' or 'use his eyes' may put his index finger on his head close to the distal side of his eye," the writers continue. "However, to an Italian user, this gesture may be interpreted as a reference to the mafia." And that's always awkward when you're playing with that shady, old Italian guy.
Microsoft patent application shows custom Kinect gestures, roaming user profiles
Since Kinect entered the world, modders have been hacking it for everything from playing Tetris to controlling a web browser. And really, Microsoft never seemed to mind. In case it wasn't obvious how much the company wants you to help find new uses for the technology, the folks in Redmond have filed a patent application for custom profiles. We can see that having implications for gaming and even Windows shortcuts, but for now Microsoft expects it to improve Kinect's accuracy by learning how you move -- after all, no one jumps or points or apes Lady Gaga's dance moves in exactly the same fashion, right? In other cases, the system might note that you prefer to make an "X" sign instead of a checkmark when selecting an object onscreen. And those personalized settings can roam over a network, shadowing you as you switch devices. Personally, we're stoked about the idea of making our best Julian Assange dance a bona fide gesture, but we'll be happy enough if Kinect can make up for our natural ungainliness.
Kinect-driven 'Jellybean' armchair hands-on (video)
Yes, this is what happens when you combine Kinect with a recliner on a motorized platform -- perfectly normal people doing awesome zombie impersonations! This week at Microsoft's MIX 11 web developer conference, the enterprising Clint Rutkas of Coding4Fun / Channel 9 fame showed off his Kinect-driven "Jellybean" armchair on stage during the keynote, and later let our very own Sean Hollister take it for a spin. Sadly, we missed our chance to capture this special occasion on video for posterity when the laptop used to control this armchair overlord ran out of juice in the final stages of our practice run. The motorized platform uses eight batteries, four omnidirectional wheels each with its own motor, and a pair of motor controllers connected to a laptop which interprets the input from Kinect (using the new SDK for Windows) and provides visual feedback to the driver. A gesture interface brings the entire contraption to life and even includes a hand signal to recline the armchair. Take a look at some closeup shots in our gallery below and watch our video of the recliner in action after the break. %Gallery-121299%
Sony's Move.me database used to create gesture-enabled mouse driver (video)
Unless you're into weird promotional mascots, video games, or measuring the rotation of the earth, the PlayStation Move probably hasn't caught your eye. Here's an idea: what if you could wave it about to control your PC? Earlier this week, electronics hobbyist Jacob Pennock used the Move.me C library to build a gesture-controlled mouse driver, and we've got the project's tech demo after the break. Watch as Pennock launches Facebook by drawing an "F," starts a video with a jaunty "V," and closes a few items with a quick "X" motion over the offending windows. Control motions are loaded through the creator's own gesture recognition library, called hyperglyph, which he claims can record motions with 98 percent accuracy. As Move.me is currently a closed beta, Pennock is keeping the source code under wraps, but he hopes to eventually put the driver to use controlling a gesture-based Linux media center. Pretty neat, but not quite enough to stave off our Kinect hack envy. [Thanks, Robert]
Evoluce releases Kinect-based 'Win & I' gesture interface for Windows 7
We've already seen Evoluce toy around with using a Kinect to control Windows, but it's now taken things one step further with its new "Win & I" software, which promises to let anyone do the same with minimal effort. That comes in both a home edition that offers gesture controls for Windows 7 itself, plus Media Center and other applications (which could be particularly handy for a home theater), as well as a business edition that apparently adds some extra controls specifically tailored to Microsoft Office, and PowerPoint in particular. Head on past the break for a quick video demonstration, and hit up the link below to snag the software if you're interested -- the home edition runs €20, or just under $30 (Kinect not included, obviously). Update: Well, it looks like Evoluce already has a bit of competition. Upstart company So Touch has now also released its Air Presenter software that will let you liven up your next presentation with more gesturing and hand-waving than usual.
Evoluce announces 46-inch display with built-in 3D sensors
We've already seen Evoluce toy around with Kinect hacks and multitouch displays, and it's now inevitably managed to combine the two. The company has just announced its new I-Voluce display, which fuses a standard 46-inch LCD with some integrated "3D depth sensing technology" that's apparently not simply a repurposed Kinect -- exact details on it are light, but it will apparently work from a distance of up to 13 feet, and it relies on Windows 7 for an OS. That's obviously not designed for home use, but Evoluce does see plenty of potential for the displays in public spaces like museums, as well as in office and education environments. For those that prefer a more hands-on approach, Evoluce also has an updated version of its Surface-style multitouch table, the Evoluce Two, which also packs 3D depth sensing technology and can accommodate up to six users simultaneously. Of course, neither exactly come cheap -- look for prices to start at €3,995, or about $5,600.
How to enable multitasking gestures in iOS 4.3
Unfortunately we knew that iOS 4.3 wouldn't end up shipping with those nifty four- and five-finger gestures, but what we didn't know was how easy it'd be to enable them. That's right, getting even more touchy-feely with your brand new iPad 2 is just a few clicks and a 4.5GB download (to your Mac) away -- if you've got $5 for Xcode of course. Sound intriguing? Click past the break for the info.
Kinect hack turns Arduino-controlled delta robot into aggressive claw crane (video)
Candy crane, teddy picker, claw machine, whatever you call it, this arcade mainstay was robbing children of their golden tokens long before we slid into our first pair of Hammer pants, but despite the changing face of the plush offerings within, the crane game's remained mostly the same. Now a team of students at the Bartlett School of Architecture have produced a Kinect hack that could change the way you drop that claw. The rather temperamental delta robot enlists the ever-hackable peripheral in combination with Processing and Arduino to mimic the movements of a user's arm. As you can tell by the video below, the delta hasn't quite figured out the subtleties of human gestures, but the robot's creators say they intend to implement "several autonomous behaviors" once all the kinks are worked out. Frankly, we'd pay our weight in tokens to see the crane game bite back at an unsuspecting whippersnapper. Video after the break.
NEC turns your arm into a touch-sensitive remote control
You may ask yourself, why bother tapping touchscreens or physical buttons when an accelerometer can be strapped to the wrist, turning any ol' arm into a wireless touch panel? That's the claim that NEC is making today. A wrist-worn band of compact acceleration sensors divides the arm into seven sections along the upper, middle, and lower arm that can then be assigned as virtual inputs to an electronic device. No more reaching into a bag to answer the phone, no more plucking at the strings of a guitar to create song -- everything is controlled through a natural tap of the arm or clap of the hands. Once in a lifetime tech that feels the same as it ever was.
Apple patent application opens the door to free-form acoustic gesture commands
Another Apple patent application has come to light that's making us stop the daily grind for a moment and ponder the possibilities. This one talks about scattering a bunch of acoustic transducers (basically, microphones) throughout the case of a laptop. No, they aren't there to pick up the sweet sounds of your humming along with Rihanna and, while the application doesn't make it perfectly clear what their purpose is for, we're liking Patently Apple's conclusion that this is to enable acoustic commands. The application describes a microprocessor that can "interpret electrical signals generated by the one or more acoustic transducers as input." The idea is that these transducers detect a finger making contact with the chassis and register those vibrations as gestures. A similar concept is demonstrated in a video below, so watch that then start dreaming. Dragging your finger along the bezel to scroll? A non-capacitive touchpad as wide as the keyboard? Music games that finally let you show off your finger drumming prowess?
EyeSight brings its gesture controls to Android tablets, Windows-based devices
EyeSight has been bringing its hand-waving UI to all sorts of mobile devices for some time now, and it's now expanded things yet again. Following up its launch on Android last summer, the company has announced that its gesture recognition software has now also been tailored specifically for Android tablets and other "computer-based" Android platforms, and it's announced that it's now available for Windows-based devices as well. As before, the software is able to work with just about any built-in camera, and the company says that it has been "highly optimized" for mobile platforms, with low CPU and memory requirements. It's not something available directly to users, though -- it's up to developers to license it and include the functionality in their applications. Head on past the break for an idea of how it works -- just try to ignore that conspicuously out of place iPad at the beginning of the video.
