Gesture Control
Latest
Djay Pro AI for iPad now has touchless gesture controls
An update to Algoriddim’s djay Pro AI is now available and its most notable feature is a touchless Gesture Control interface for iPad Pro and iOS 14.
Klipsch’s next true wireless earbuds will include AI and gesture controls
For the second year in a row, Klipsch is introducing new true wireless earbuds at CES. Last year, it offered the first glimpse of its T5 True Wireless earbuds. Now, the company is expanding its lineup with three more true wireless models.
Sling TV now streams on Nest Hub and Nest Hub Max
Sling TV users now have another way to stream their content. Beginning today, Sling TV is available on Nest Hub and Nest Hub Max. Users can control Sling with built-in voice controls on those devices, and on Nest Hub Max, they can pause and resume content on Sling using gesture controls -- hold up your hand and look at the device to pause.
Here's everything Google announced at the Pixel 4 event
Despite all of the leaks ahead of Google's Pixel 4 hardware event today, the company still had plenty to share. Of course, we got our first official look at the Pixelbook Go and Pixel 4/4XL, but we also got to see the new Nest Mini, Nest WiFi and Pixel Buds. And Google had plenty of new features -- like ultrasound sensing and an improved Recorder app -- to wow the crowd.
You'll be able to wave at Pokémon on the Pixel 4
After so many photo and video leaks, the daily revelations about the Google Pixel 4 can officially be referred to as a deluge. The latest comes from 9to5Google, in the form of a tech demo for the Pixel 4 and Pixel 4 XL's radar-equipped motion sensor. The proof-of-concept app lets users pet, splash and wave at Pokémon characters using vertical and horizontal hand gestures.
Leaked Google videos show the Pixel 4's 'Motion Sense' gestures in action
After all the countless Pixel 4 leaks, you may have tuned out at this point, but for those that are still paying attention, 9to5Google has shared what it says are official marketing videos Google will release to promote the phone. The two sets of videos show the Pixel 4's Soli-powered "Motion Sense" gestures in action, as well as the new, faster Assistant the phone will include before any other Android device.
Google confirms Pixel 4 will support face unlock, touch-free gestures
Google is once again validating rumors about the Pixel 4, this time for its touch-free control. The company has confirmed that its next flagship phones will include motion-sensing Soli radar that lets you skip tracks, silence phone calls and otherwise control key phone tasks by waving your hand. Consider it a potentially more sophisticated take on the LG G8's gestures. Moreover, Soli will play a key role in one of the Pixel 4's other signature features: secure face unlock.
Wave goodbye to manual car seat controls with gesture tech
It sounds a bit like an infomercial: Tired of using manual controls and levers to adjust your car seats? There's got to be a better way! And now of course there is, thanks to researchers at the Fraunhofer Institute for Silicate Research ISC. The researchers, in conjunction with Isringhausen GmbH & Co. KG, have developed a fully functional prototype that allows drivers to adjust a seat using only hand gestures.
BMW's 7 Series lets you park by remote control
If you're looking at a BMW's deluxe 7 Series, the 2016 model will awe your yacht club pals with some Bond-worthy gadgets. The remote control parking appears to be a first for a production vehicle, even though we've seen it demo'd by Volvo, Audi and BMW before. When you use the touchscreen-equipped BMW Display Key, it'll squeeze itself into (and out of) a parking space in a fully automatic process. Self-parking is already available on BMW's i3 electric vehicle and many others, but the 7 Series is the first to let you park when you're not even in the driver's seat.
Intel CEO controls a swarm of robot spiders with gestures
Forget the Apple Watch. Forget the Pebble Time. What you really need is a wristband that gives you the power to control an army of scary-looking drones. At IDF in Shenzhen, Intel CEO Brian Krzanich put on a simple Curie-powered wristband with motion detection, which then let him commandeer four robot spiders. With some simple gestures, Krzanich was able to make them stand up, change the LED colors on the drones, make them do "fist" pumps and eventually go back to idling. Sounds cute, right? Maybe not so much when you actually see this in action -- we have a video right after the break.
Myo replaces controllers with arm-controlled Oculus Rift gaming
The Oculus Rift headset is doing its best to draw players into the virtual realities it hosts, but traditional or motion-assisted controllers are typically used to interact with these virtual worlds. Thelmic Labs has a different vision for player interaction however - rather than tracking the positioning of a controller in 3D space, Thelmic's Myo armbands build virtual representations of a player's hands and forearms. According to Thelmic's FAQ page, Myo works by measuring the "electrical activity from your muscles to detect what gesture your hand is making." The armbands use a Bluetooth 4.0 connection to communicate with Windows, Mac, Android or iOS devices. Thelmic lists the beginning shipments of Myo development kits for the "first half of 2014," with the consumer version shipping shortly after that. Both are priced at $149. Potential developers that don't want to wait around for Thelmic's wider distribution shipments can apply to join the Thelmic Alpha Developers, a group that will gain access to pre-production Myo hardware. While a cool concept doesn't promise future developer support for the hardware, it's pretty neat to imagine casting in-game spells with nothing but hand gestures. Besides, whatever amount of gesture functionality the Myo achieves can't possibly dip below the bar that Steel Battalion: Heavy Armor set on the Kinect, right? [Image: Thelmic Labs]
Watch out Kinect, AllSee does gesture control without a camera
What if you could turn the music down on your phone by just waving your hand? That's the idea behind AllSee, a new gadget under development by computer scientists at the University of Washington. Built by the same guys who created the gesture-recognition in the Galaxy Nexus, the tiny sensor works completely different than the feature in devices like the Galaxy S5 that require the use of the forward-facing camera. Instead, AllSee uses TV signals to not only help it recognize gestures, but also as exceptionally efficient source power. That means it doesn't need a battery to operate and can see your movements even when your phone is out of sight in your pocket -- pretty awesome.
Warning: MYO wristband does not give you superpowers
Another attempt at controlling your Mac and other digital devices by flailing your hands and arms around in awkward gestures is available for pre-order today. The MYO wristband (US$149) from Thalmic Labs won't be shipping until late 2013, and the company's marketing strategy appears to be relying on the childlike wish of being able to wave your hands and arms Harry Potter-like to have objects bow to your command. The technology is cool enough; MYO is an armband that measures electrical activity in your arm muscles and translates gestures and movements into corresponding actions on your digital device. The video below shows a number of examples of how this can be used -- one quite practical idea demonstrates a wheeled robotic vehicle being controlled with hand and arm gestures. But it's the marketing hype that's a bit over the top: "unleash your inner Jedi," or the comment from Thalmic Labs CEO Stephen Lake that the company is interested in "giving us superpowers." Thalmic Labs even uses the tried-and-true method of overhyping a product by resorting to a quote from Steve Wozniak. If you're a developer and this is hitting your main nerve, the MYO API is available today as well. Just don't expect me to get excited about MYO until I'm able to extend my middle finger at the screen to close browser tabs displaying over-the-top marketing statements.
Hisense jumps into 4K TVs with the XT880, promises Android 4.0 and a sane size
The current crop of 4K TVs from LG and Sony are large enough that some of us would need to knock out a wall to get them inside. Enter a surprise early challenger from Hisense: its upcoming XT880 line's 50-, 58- and 65-inch sizes deliver that 3,840 x 2,160 picture at dimensions built for mere mortal living rooms. We're also promised a full-fledged, 3D-capable smart TV based around Android 4.0 with WiFi internet access, a remote with voice commands and a removable camera for gesture control or Skype chats. Hisense yet hasn't committed to launch details for the XT880 line besides a presence on the CES show floor; however, it's safe to say that the smaller sizes will bring the price of Ultra HD down from the stratosphere.
Microsoft Research crafts wrist-worn device that tracks hand gestures in 3D space (video)
A team led by researchers at Microsoft's UK-based R&D lab has crafted a system that tracks the full 3D pose of a user's hand without the need for a pesky glove. Dubbed Digits, the Kinect-inspired rig latches onto a user's wrist and utilizes a diffuse infrared light, IR laser, camera and inertial measurement unit to track fingertips and just five key points of a hand. Leveraging a pair of mathematical models developed in-house after studying the mechanics of the human hand, the group uses the captured data to extrapolate the position of a user's paw. The team envisions the solution as a supplement to touch-based interfaces, a method for eyes-free control of mobile devices and as a gaming controller that could work in conjunction with Kinect or similar systems. In its current state, the device is composed of off-the-shelf parts and needs to be tethered to a laptop, but the ultimate goal is to create a mobile, self contained unit the size of a wrist watch. Hit the break to catch a video of the setup in action or tap the second source link below for more details in the group's academic paper.
Pioneer's latest Raku Navi GPS units take commands from hand gestures
An AR heads-up display wasn't the only navigation hardware Pioneer showed off at CEATEC 2012. The firm also took the opportunity to tear the wraps off a new line of gesture-controlled Raku Navi GPS units. With the infrared-powered Air Gesture feature, drivers can wave their hand in front of a device to pull up a menu with commands such as setting their home or a personal haunt as a destination or skipping to the next tune on a playlist. Once a hand is retracted, the menu will be replaced with the usual map interface. Though the solution isn't completely hands-free, horizontal hand waves can be assigned one of ten different functions. Japanese store shelves will be lined with two dashboard-embeddable units by mid-October, while four console-independent models will join them in early November. As of now, there's no word if the hardware will make the pilgrimage stateside.
Akimbo Kinect hack offers precise control with minimal effort (video)
We've seen Microsoft's Kinect used in countless ways, but 3Gear Systems means to better these predecessors with the beta release of its SDK, which turns all the subtleties of hand movement into actions. In addition to using two Kinect cameras for accuracy, the software compares hand poses against a pre-rendered database so gesture commands are executed with little lag. It offers complete control of a virtual 3D environment from the comfort of your natural desk position, so you won't have to worry about flail fatigue after long stints. A free public beta is available now until November 30th, at which point bigger companies will require a license, while individuals and small enterprises will continue to get complimentary access. We know what you're thinking -- it's just another Kinect hack -- but we suggest you reserve judgment til you've seen the demo below, showing examples of how the API could be used for CAD, medical, and of course, gaming applications.
Chrome experiment explores new types of navigation, degrees of embarrassment
What you're about to see, should you choose to click the source link below, is far from perfect. On the other hand, it's clearly had a lot of effort and expertise put into it -- not only by HTML5-savvy coders, but also by a troupe of performers from the Cirque du Soleil. It's called Movi.Kanti.Revo, which is a fancy way of saying Move.Sing.Dream, and it involves navigating through an ethereal and slightly laggy landscape using only swaying gestures, your singing voice (mournful sobbing sounds also worked for us) and a bunch of APIs that conveniently fail to work on FireFox, Safari or Internet Explorer. It's well-suited to those with a mic and webcam, preferably sitting in a open-plan and bully-ridden workplace, and if you don't like it there's always Bastion.
Woven's wearable platform for gaming, cool points and a whole lot more (video)
TshirtOS showed us one take on wearable gadgetry earlier this month, and now it's Woven's turn. This particular e-garment packs quite the selection of hardware, as you can see above -- a trio of LilyPad Arduino boards (and some custom ones), a Bluetooth module, 12 x 12 RGB LED "screen", speakers, bend sensors, a heart rate monitor, shake motors and a power pack. You'll need to accessorize, of course, with a smartphone for hardware harmony and to run companion apps. So what's it for, you ask? Well, the creators are touting it primarily as a "pervasive" gaming platform, and even seem to have a working first title in the form of SPOOKY (think gesture-based ghost-fighting). Other uses (which appear a little more conceptual) see Woven as a workout companion, TV remote, Wii controller, social network alerter or simply a fashion accessory. Check out the videos below to see it in action and imagine all the fun you could have in the five minutes before you're ushered into that padded room.
Qualcomm demos touch-free gesture control for tablets powered by Snapdragon (video)
Tablets are for touching -- that much is understood. But Qualcomm's making it so your fingers will be mostly optional, thanks to the Kinect-like powers of its Snapdragon CPU. To highlight this, the company's uploaded a couple of videos to its YouTube channel that showcase two practical use case scenarios for the gesture tech: gaming and cooking. Using the device's front-facing camera, users will one day soon be able to control onscreen avatars, page forward and back through recipes, setup profiles and even wake their slates all with simple hand or head movements. Alright, so tactile-free navigation of this sort isn't exactly new, but it does up open up the tablet category to a whole new world of innovation. Head past the break to peek the demos in action.
