gestures
Latest
Adobe's Packager to be updated for iPad support
Adobe is reportedly working to update its Packager for iPhone and will launch it in a new version of the popular Adobe Creative Suite bundle. Packager for iPhone is a utility included in Adobe Flash Professional CS5 and the Adobe AIR SDK that lets developers export their Flash-based applications to the iOS platform. The updated version of Packager for iPhone is rumored to include improved support for the iPad as well as new Android devices. The tool will also improve touch support by including additional gestures such as pinch to zoom. Adobe's Packager for iPhone was bundled into Creative Suite 5, but its development was abandoned when Apple banned the use of third-party development tools before the launch of iOS 4. When Apple reversed this decision several months later, Adobe kicked up the pace of development to improve this application for their Flash developers. According to AppleInsider, Adobe will release this updated tool in an interim version of Adobe Creative Suite that will land before Version 6.0. The version has been referred to internally as Adobe Creative Suite 5.5 Digital Publishing. Screenshots of Adobe Flash Professional CS 5.5 have been spotted, and the application is reportedly under beta testing. Information on a potential launch date is still unknown. [Via AppleInsider and 9to5Mac]
webOS tablet interface leak suggests new gesture controls, same old good looks
What, a full spec sheet for the Topaz not good enough for you? Fine, Pre Central has managed to dig up another little document from HP's 2010 archives, this one delving into tablet-specific UI elements in webOS. The first notable thing is the inclusion of more sophisticated gesture and tap controls, with double-tap, tap-and-hold, and even two-finger tap-and-drag actions serving some unspecified functions in the tablet version of the software. Tabbed browsing also makes an appearance, alongside an auto-expanding email client and a page-turning element, all of which may or may not be in the final build shipping with the final devices. Until finality is reached, however, the source link is your best buddy. [Thanks, Ryan]
iPad multi-touch gestures will be withheld from iOS 4.3
There's bad news for those anticipating multi-touch gestures in iOS 4.3. It seems that the feature won't be a part of the public release. Engadget and others have confirmed that the feature is just a developer preview, so no ninja-level pinching and swiping for us normals. That's unfortunate, as it looks very cool. After the break, there's a video demonstrating some multi-touch features on an iPad running an iOS 4.3 beta. In a nutshell, gestures let you use pinches, swipes and so on to move between applications, history, etc. on your iPad. We saw a patent application for multi-touch gestures back in April of 2010. While cool on the iPad, gestures are somewhat troublesome on the iPhone, as your hand easily covers the entire screen. Would you want to do that with your iPhone? The question is moot, as we won't be getting the feature for a while.
iPhone rumor two-pack: multitasking gestures and MobileMe Photo Streams? (Update: those pics are real)
Looks like the iPad might not have an exclusive on those new "multitasking" gestures unearthed in the latest iOS 4.3 beta, because BGR's got some shots up of an purported internal build that seem to indicate Cupertino intends to push them down to the iPhone line as well. Now, there are a couple of obvious red flags here -- using "four or five fingers" sounds pretty unreasonable for a 3.5-inch display, though it'd certainly tie in with recent rumors that Apple's turning sour on the physical Home button and might indicate that the complete redesign we're hearing about could include a slightly larger display. Of course, it could also indicate that this is really early software with the wrong (read: iPad) wording -- but at any rate, we could definitely see the benefit of, say, a two-finger gesture to swipe between apps. Now, on to part two: 9to5 Mac seems to have unearthed traces in the iOS 4.3 beta of a new feature called "Photo Streams" that seems to be -- you guessed it -- a way to share continuous streams of photos with friends you approve, presumably through MobileMe (which would fit in nicely with the Find my Friends stuff). Alone, that's not worth $99 a year -- plenty of other services offer similar functionality -- but we wouldn't be surprised if this were bundled in with a bunch of MobileMe refreshes this year. Update: We just received an interesting tidbit of information on the above pic (and others that BGR has its hands on). According to sources, after the iPhone 4 barroom debacle, Apple made significant changes to how it keeps track of -- and identifies to third parties -- its devices. Namely, the company began adding clauses to screens on the phones which read "Confidential and Proprietary, if found, please contact..." followed by a 408 number (that's Cupertino, of course). This prevents any misunderstanding from parties who may come across these devices. So what does it all mean? Well, not much, save that it seems these photos we're viewing are in fact the real deal... which means gestures may be headed to your iPhone. Intrigue!
Philips uWand hands-on
Philips has been touting its uWand "direct pointer" remote for a good while now, but we've never had the chance to actually use one ourselves. Today that omission has been rectified as we got our mitts around this motion / gesture-based controller and gave it a quick test drive. It works by having an infrared camera embedded in the front, which detects an IR beacon in your TV and thereby judges its own distance, tilt and relation to the TV. That then allows for things like motion-based zooming, pointing the remote at the particular thing on the television that you want to "click" on, and navigational shortcuts attached to gestures performed with this handheld. There's also a nice spacious keyboard on the back, assisting in the use of all these Smart TVs CES has been littered with. Philips' intention is to license the technology out to other manufacturers, which could result in consumer products by 2012 -- so yeah, it's not terribly close to your living room yet, but our gallery of images is. %Gallery-113562%
Apple patent application suggests yet more possible gestures for iPods
Apple's already put some basic gesture controls to use on its sixth generation iPod nano, but a recently published patent application suggests that it may have some grander designs for a no-look interface of sorts. As you can see above, Apple's using a nano in its illustrations for the patent, but the actual claims suggest that the gestures wouldn't necessarily require a screen at all -- possibly for something similar to that back-side interface that also turned up in an Apple patent application? As for the gestures themselves, they'd apparently involve things like a single tap to pause or play, a double tap to skip forward, a triple tap to skip back, and a circular motion to control the volume. Of course, that aforementioned patent application was published in 2007 and we've yet to see anything result from it, so you may not want to hold your breath for this one either.
Apple patent describes touch gestures on iPod nano
Could "no-look" touch gestures be coming soon to the iPod nano? Recently discovered by ipodnn, a 2009 patent application by Apple shows that it is looking into letting users control their devices using no-look gestures that only require a touch-sensitive surface, like a trackpad, and not necessarily a graphic interface as Apple currently employs on the iPod, iPhone and iPad. Diagrams filed with the patent application show different methods that owners could use gestures on their devices, such as a single tap to play and pause media playback, a double tap to skip forward tracks or a triple tap to skip backwards to previous tracks. This would allow users to still control their device if they were unable to interact directly with the graphical interface we have all become so familiar with. This has been one of the main concerns with the nano switching over to a no-button touchscreen, so a good solution along these lines would be quite helpful. Of course, I imagine that all of you guys have gotten used to calling your friends using only your nose, so learning gestures to control your iPod or iPhone shouldn't be too difficult in comparison! [via ipodnn]
Gesture-controlled robot arm enables civilization's most meta high five
This video, criminally, doesn't actually show any high fives, but we're sure the students at the University of Tsukuba have sustained endless LOLs over the past few months, pushing their gesture-driven robot arm system to the limits of human-robot high five interaction. The system itself is relatively simple: it uses two cameras to track a hand's movements, including specific finger gestures, which are then processed and translated into robotic movement in real time. The end result is basically the world's most elaborate claw machine game, as demonstrated above.
Kinect Hacks Daily, Episode 47: Kinect taught to control XBMC through hand gestures
One of our favorite parts of Kinect, at least theoretically, was the idea of controller-free and remote-free control of the dashboard and media playbook. Sure, it's never going to be as optimized and snappy as those tried-and-true digital buttons, but it's a great party trick, and we're all about the party tricks. Well, now you can get some of that gesture mojo going on with your XBMC setup -- and we're guessing eventually you'll be able to control just about anything else you'd use basic "left, right, click" actions for navigation. Our only suggestion? Get some of that Dance Central-style menu navigation going on here. That goes for you, too, Microsoft. [Thanks, Joshua]
Kinect finally fulfills its Minority Report destiny (video)
Not to denigrate the numerous fine hacks that Kinect's undergone since its launch, but it's always nice to see the professionals come in and shake things up a little. A crew from MIT's brain labs has put together a hand detection system on Microsoft's ultra-versatile cam, which is sophisticated enough to recognize the position of both your palms and fingers. Just as a demonstration, they've tied that good stuff up to a little picture-scrolling UI, and you won't be surprised to hear that it's the closest thing to Minority Report's interactive gesture-based interface that we've seen yet. And it's all achieved with a freaking console peripheral. Video after the break.
Sony fires barrage of touchscreen patent applications, only one points at new PSP
Lawyers for Sony Computer Entertainment America must have been mighty busy last October, hatching the wild scheme that came to light this week -- a series of eight intertwining patent applications all describing a single device with an intriguing touchscreen interface. Though it's hard to tell what form the final device might take -- the apps suggest sliders, clamshells and slates -- a few distinct ideas bubble to the surface, and we'll knock them out one by one. First, the inventors seem to be rather particular about having a touchpad that's separate from the main screen -- perhaps even on its back like the rumored PSP2 -- and Sony's trying to patent a way to manipulate objects through the screen as well. Second, there's a lot of mumbo-jumbo about being able to "enhance" or "transform" the user interface in response to different forms of input, which seems to boil down to this: Sony's trying to get some multitouch up in there, especially pinch-to-zoom. Last but not least, the company's looking to cordon off a section of touchscreen buttons, including a 'paste' command, and patent a "prediction engine" that would dynamically change the onscreen layout based on your past behavior. If most of these ideas sound more at home in a new tablet computer rather than a gaming handheld, then great minds think alike. Still, SCEA is Sony's gaming division -- forlorn Linux computing aside -- so consider us stumped for now.
Kinect used to control Super Mario on a PC, redefine convergence (video)
If, like us, you've been waiting to see Kinect in control of a truly marquee game, your wait has now come to an end. The same fella that brought us the Kinect lightsaber has returned with a hack enabling eager nostalgics to enjoy a bout of Super Mario controlled only by their body contortions. OpenKinect was used to get the motion-sensing peripheral -- originally intended exclusively for use with an Xbox 360 -- to communicate with his PC, while a simple NES emulator took care of bringing the 25-year old plumber to life. The video awaits after the break.
Speedlink Cue does the multitouch hybrid mouse thing
Honestly, while Apple's Magic Mouse is a bit of a pioneer in its application of a multitouch surface on a "regular" tracking mouse, it's not exactly easy or comfortable to perform multitouch gestures with it. Plus there's the little problem of no official driver for Windows. Speedlink's Cue mouse looks to be solving at least one of those problems, maybe even both. The wireless 1000 dpi optical mouse is naturally PC-compatible, with software to allow you to configure your own gestures, and it has a somewhat flatter and more extensive touch surface than the Magic Mouse, which might make gestures a bit more doable. Basically, it's somewhere in between the Magic Mouse and the Magic Trackpad, minus the hyperbole, and plus clear demarcation of right and left click. It'll retail for €40 when it ships in November (about $56 USD).
Nokia's Plug and Touch turns your HDTV into a giant N8 (video)
What do you get when you combine the N8's HDMI output, its 12 megapixel camera, and your trusty old TV set? As Anssi Vanjoki might say, you get a big new smartphone. Nokia's research labs have thrown up a neat little "prototype" app called Plug and Touch, which enhances the N8's already famed HDTV friendliness with the ability to recognize touch input. This is done by positioning your aluminum-clad Nokia about five feet away from the display and letting its camera pick up your hand's gestures and touches, essentially resulting in a massively enlarged Symbian^3 handset device. Naturally, it's not terribly precise at this stage and there are no plans for an actual release, but it sure is a tantalizing glimpse of what may be coming down the pipe. Video after the break.
TI and XTR team up on touchless gesturing system for mobile devices
We've seen a few examples of touchless, gesture-based interfaces for mobile devices, but it looks like Texas Instruments might be closer than most to making it a reality -- it's just announced a partnership with Extreme Reality (also known as XTR) on a new gesture engine and framework specifically designed for its OMAP 4 platform. The two companies actually showed off such a system back at MWC earlier this year (check out a demo of ti after the break), but they've only just now made the partnership official, and they're promising plenty more advancements to come -- including the ability to not only recognize simple gestures, but even things like whole body movements and two-handed gestures. Head on past the break for the complete press release.
Multitouch DJ table lets you swipe to rock
We just recently got a glimpse of one possible future of DJing, but our world has now already been turned upside down once again with this multitouch-enabled rig built by Gregory Kaufman. The big difference with this one, as you can probably guess, is that it employs a gesture-based interface that lets you spin the virtual turntables and use a variety of taps and finger swipes to replicate the main functions of a regular DJ deck. What's more, Kaufman says that the only gear a DJ would have to carry is a USB drive with their own music and settings, which they'd simply plug into the multitouch table at a club -- assuming the idea catches on, that is. Top top things off, the system would also be able to accommodate regular DJ gear for some added flexibility, and even provide enough room for two DJs if you're looking to battle or share the stage. Head on past the break to check it out in action.
Hitachi shows off new gesture-based interface, touts grand plans
Hitachi's already dipped its toes (or hands, as it were) into the gesture-based waters before, but it looks to have refined things quite a bit for its latest Minority Report-esque demo, which the company is showing off as part of its 100th anniversary celebration. While complete details are a bit light, the system does seem to be reasonably responsive, and appears to rely on a projection-based system and a single camera to track movements. Perhaps what's most interesting, however, is that Hitachi eventually sees systems like this being used in everything from digital signage to medical applications -- and, yes, even TVs and desktop computers (though not before mid-2011 at the earliest). Head on past the break to check it out in action.
BBEdit 9.5.1 out now
You lousy kids, with your iPhones and iPads and iGadgets! Back in my day, we worked on real computers, with real keyboards, and mice with one button, and we liked it! BBEdit is a relative relic of that age -- when text ruled the Earth, BBEdit ruled text. And the old Mac app is still being updated. The latest version 9.5.1, adds in a couple of dozen fixes, and reverts some of the capitalization rules to the way it worked in a previous version. There are still some die-hards who swear by BBEdit for coding or editing text, and because of its power and versatility, it's $125 for an initial purchase. The upgrade to 9.5.1 by current users is, of course, free. Nowadays, you've got your drag-and-drop and your touchscreens and your gestural controls, but BBEdit is one of the best apps that does what your computer used to be best at: editing text quickly and well.
EyeSight's hand-waving, gesture-based UI now available for Android (video)
Sure, the Evo's front-facing camera enables you to call your snookums and let them see your mug while you two exchange sweet nothings. But, wouldn't it be much better if you could tell your phone to talk to the hand? Now it can... at least in theory, with the availability eyeSight libraries for Android. EyeSight's Natural User Interface relies on a phone's camera to detect hand motions, enabling developers to write apps that change tracks, ignore callers, and display text messages with a wave. The down-side is that those apps need to be specifically written to work in this way, and while the libraries have been available for Nokia handsets since last year, right now we're seeing a whopping four programs that use it (including the hugely important "Fart Control," which turns your phone into a "motion detecting fart machine"). So, you should probably not expect a revolution here either. Video demo from the Nokia days is embedded just below.
L'Artisan Electronique ushers in the era of the virtual pottery wheel (video)
Want to reenact Ghost but don't care for all the messy bits? Let lasers do the work for you. L'Artisan Electronique uses a laser scanner to detect your hand-sculpting gestures, transfers their gently urging instructions over to a computerized 3D model, and -- should your production exhibit sufficient creativity or je ne sais quoi -- prints it out using a 3D ceramic printer. This is part of a Design by Performance exhibition taking place over in Belgium and is seriously one of the cooler things you're going to come across today -- or any other day, for that matter. See it on video after the break.
