gesturecontrol
Latest
Sony confirms PS4 gesture and voice control, HDMI capture for games (update)
Looking for more PlayStation 4 news? Here's a bit now that Sony's Tokyo Game Show keynote address is over. A couple of features we'd hoped to hear more about have been confirmed, and the first is that the PS4 camera will support both voice and gesture control. It's no surprise that the system will take full advantage of the add-on's dual cameras and four mics for people who want to wave at their TVs, but it's nice to have that confirmed. Second, in a move that will mostly benefit game reviewers and YouTube video walkthrough experts (thanks for your help on these GTA V missions, all of you), the PlayStation 4 will allow unencrypted HDMI output for games. On the PS3 it didn't, treating games the same as Blu-ray movies, so anyone capturing video in HD needed to use component cables. That's on top of the console's "Share" button that sends clips of gameplay straight to Ustream, Facebook or PSN. Check out our liveblog for everything else discussed tonight including the PS4's mobile apps, indie gaming and Vita TV. Update: Sony Worldwide Studios head Shuhei Yoshida tells us via Twitter that HDMI capture on PS4 won't be available at the console's launch this November, but "in the future."
Elon Musk shows off Iron Man-style rocket design with gestures and 3D printing (video)
In another confirmation that Elon Musk lives life differently from the rest of us, he's just posted a new SpaceX video that's straight out of a sci-fi movie. In it, he demonstrates designing parts for a rocket the company could use just with hand gestures using a Leap Motion controller. After that, we move to a 3D projection of the part, free standing glass projection just like Iron Man, and even an implementation with the Oculus Rift VR headset. While much of its appeal is watching a billionaire play with the latest tech toys, the video gives a peek at what's possible with technology that's actually available to a rapidly growing number of people. Inspiring stuff -- we'll see if we can finish the Hyperloop concept with a Kinect and an old Virtual Boy.
Hisense picks up Hillcrest Labs' gesture and motion control tech for TVs
Following LG and TCL, Hisense is now the latest TV manufacturer to adopt Hillcrest Labs' Freespace technology. According to the agreement, Hisense, the world's fifth largest smart TV brand (as of Q1 2013, according to NPD DisplaySearch), will be able to add in-air pointing, gesture control and motion control -- all via a remote control -- to its future smart TVs and set-top boxes. This also means TCL now faces a fellow Chinese competitor with the same set of Freespace features. While there's no time frame just yet, we've been told that Hisense will eventually sell these next-gen devices in the US and China later this year, so stay tuned.
Homebrew Kinect app steers Chromecast streams through gestures (update: source code)
Chromecast may deliver on promises of sending wire-free video to TVs, but it's not hands-free -- or at least, it wasn't. Leon Nicholls has unveiled a homemade Kinect app for the desktop that gives him gesture-based control of videos playing through Google's streaming stick. While there's just two commands at this point, Nicholls hopes to open-source the code in the near future; this isn't the end of the road. If you can't wait that long, though, there's a quick demonstration available after the break. Update: A few days later, Nicholls has posted the source code for his project; you'll need to whitelist your Chromecast for development to use it.
eyeSight software uses standard cameras to power 3D gesture controls (video)
Turning regular ol' devices into motion-activated wonders is all the rage these days, and a company called eyeSight is determined to stand out from the pack. The brains behind eyeSight claim to have developed a purely software-based solution for equipping PCs, TVs and mobile devices with 3D gesture controls using existing standard cameras. It sounds like a pretty sweet deal, but it all comes down to whether or not eyeSight can deliver on its potential. If it can, then it could be a promising sign that gesture-controlled technology is on its way to becoming more accessible for budget-conscious consumers, since a software setup would negate the need for costly hardware. Currently, the platform is limited to developer SDKs, but you can watch an eyeSight-powered Google Earth demo after the break.
PMD and Infineon to enable tiny integrated 3D depth cameras (hands-on)
After checking out SoftKinetic's embedded 3D depth camera earlier this week, our attention was brought to a similar offering coming from Germany's PMD Technologies and Infineon. In fact, we were lucky enough to be the first publication to check out their CamBoard Pico S, a smaller version of their CamBoard Pico 3D depth camera that was announced in March. Both reference designs are already available in low quantities for manufacturers and middleware developers to tinker with over USB 2.0, so the two companies had some samples up and running at their demo room just outside Computex. %Gallery-190502%
WiSee uses WiFi signals to detect gestures from anywhere in your house (video)
Have you always dreamed of controlling your TV by flailing in the next room? Researchers at the University of Washington have just the system for you: WiSee, a gesture-recognition interface that uses WiFi to control things like sound systems and temperature settings. Since WiFi signals are capable of passing through walls, WiSee can detect gestures made from neighboring rooms, breaking free from the line-of-sight method relied on by devices like Kinect and Leap Motion. Unlike those two, WiSee doesn't require an additional sensor; the software can theoretically be used with any WiFi-connected device and a router with multiple antennae to detect Doppler shifts created by movement. The prototype was tested in both an office environment and a two-bedroom apartment, and the team reported a 94% accuracy with a set of nine distinct gestures. If you watch the video, embedded after the break, you'll notice that each user performs an identifying motion prior to the control gesture. It's a trick the team picked up from studying Kinect's solution for distinguishing between specific individuals in crowded rooms. Intrigued? Head over to the source link to read the report in full.
SoftKinetic teases embedded 3D depth camera, coming to Intel devices next year (hands-on)
At Intel's Computex keynote earlier today, the chip maker teased that it expects embedded 3D depth cameras to arrive on devices in the second half of 2014. Luckily, we got an exclusive early taste of the technology shortly after the event, courtesy of SoftKinetic. This Belgian company not only licenses its close-range gesture tracking middleware to Intel, but it also manufactures time-of-flight 3D depth cameras -- including Creative's upcoming Senz3D -- in partnership with South Korea-based Namuga. Read on to see how we coped with this futuristic piece of kit, plus we have a video ready for your amusement. %Gallery-190272%
Mad Genius' Motion Capture System brings Sony's break-apart controller idea to life, and then some
Remember that break-apart DualShock 3 idea for motion control Sony had five years ago? A new company named Mad Genius Controllers has surfaced with a working prototype that shows such a contraption working in spades. The setup uses a splittable controller and a processing unit to enable seamless motion control and spacial tracking on any title and system. Because Mad Genius doesn't use any accelerometers or cameras like the current consoles, its creator notes that accuracy of up to 1/100th of an inch is possible. In a video demo with an Xbox 360 version of Skyrim and a modified Xbox gamepad, certain gestures and movements even automate menu selections like a macro. One instance shows the controller being split and held like bow and arrow, highlighting that both sides are tracked in relation to each other -- not to mention that the in-game character's weapon automatically changes without any menu-digging by the user. The current version is merely a wired proof-of-concept, but Mad Genius plans to eventually make it wireless and hit Kickstarter for funding. In the meantime, you can build up anticipation for yourself by checking out the nearly 10-minute long video demo after the break. All that's left is the inevitable Oculus Rift tie-in (like we've just done with this post).
Hands-on redux: Creative's Interactive Gesture Camera at IDF 2013 Beijing (video)
At IDF 2013 in Beijing, Intel is again making a big push for perceptual computing by way of voice recognition, gesture control, face recognition and more, and to complement its free SDK for these functions, Intel's been offering developers a Creative Interactive Gesture Camera for $149 on its website since November. For those who missed it last time, this time-of-flight depth camera is very much just a smaller cousin of Microsoft's Kinect sensor, but with the main difference being this one is designed for a closer proximity and can therefore also pick up the movement of each finger. We had a go on Creative's camera with some fun demos -- including a quick level of gesture-based Portal 2 made with Intel's SDK -- and found it to be surprisingly sensitive, but we have a feeling that it would've been more fun if the camera was paired up with a larger display. Intel said Creative will be commercially launching this kit at some point in the second half of this year, and eventually the same technology may even be embedded in monitors or laptops (remember Toshiba's laptops with Cell-based gesture control?). Until then, you can entertain yourselves with our new hands-on video after the break. %Gallery-185293%
Fruit Ninja meets real Ninja with CamBoard's Pico gesture camera (video)
You can play Fruit Ninja with your fingertips, you can play it with your eyes, so it's reasonable enough that hand waving should control it too. And while gesture-sensing technology is hardly new, Teutonic outfit pmdtechnologies has been teasing a miniaturized edition of its depth camera that's ripe for embedding into small consumer electronics devices. All we've got so far is a short video (after the break) outlining its potential, but that's enough to hope someone can go head-to-head with Microsoft in the space.
Microsoft Research brings mid-air multitouch to Kinect (video)
Shortly after the Kinect SDK first launched, it spawned a number of inspired efforts from researchers to make it do more than just track your body. Microsoft Research finally seems to be catching up to its own tech, as it just flaunted a recent project that allows fine-tuned gesture control, thanks to a newly developed talent for the motion sensing device to read whether your hand is open or closed. That let the team simulate multitouch-like capability on a PC as they air-painted basic images and manipulated Bing maps by varying their hand states. The hardware used doesn't appear to be stock, so whether such new capability entails a rumored new version of the Kinect that may or may not appear on a (rumored) future Xbox, we'll leave for you to decide.
Leap Motion Controller starts shipping May 13th, hits Best Buy on the 19th
If you were still thinking that the Leap Motion Controller was going to turn into vaporware, it looks like you were wrong. Just less than a year after the company first made waves with its tiny gesture recognizing box, a finished product is getting ready to ship. Those that pre-ordered should receive their shipping notices starting May 13th. If you weren't willing to commit to the device before hand, you'll still be able to snatch one up at Best Buy on May 19th for $80. Or, if you're so inclined, you can continue to use your mouse to play Cut the Rope on your desktop... your choice we suppose.
Myo senses your muscles, brings yet another way to control devices (video)
With visions of Minority Report, many a user's hoped to control gadgets by wildly waving at a Kinect like a symphony conductor. Now there's another way to make your friends laugh at you thanks to the Thalmic Labs' Myo armband, which senses motion and electrical activity in your muscles to let you control your computer or other device via Bluetooth 4.0. The company says its proprietary sensor can detect signals right down to individual fingers before you even move them, which -- coupled with an extremely sensitive 6-axis motion detector -- makes for a highly responsive experience. Feedback to the user is given through haptics in the device, which also packs an ARM processor and onboard Lithium-Ion batteries. Myo is now up for a limited pre-order with Thalmic saying you won't be charged until it ships near year's end, while developers can also grab the API. If you're willing to risk some ridicule to be first on the block to grab one, hit the source.
Warning: MYO wristband does not give you superpowers
Another attempt at controlling your Mac and other digital devices by flailing your hands and arms around in awkward gestures is available for pre-order today. The MYO wristband (US$149) from Thalmic Labs won't be shipping until late 2013, and the company's marketing strategy appears to be relying on the childlike wish of being able to wave your hands and arms Harry Potter-like to have objects bow to your command. The technology is cool enough; MYO is an armband that measures electrical activity in your arm muscles and translates gestures and movements into corresponding actions on your digital device. The video below shows a number of examples of how this can be used -- one quite practical idea demonstrates a wheeled robotic vehicle being controlled with hand and arm gestures. But it's the marketing hype that's a bit over the top: "unleash your inner Jedi," or the comment from Thalmic Labs CEO Stephen Lake that the company is interested in "giving us superpowers." Thalmic Labs even uses the tried-and-true method of overhyping a product by resorting to a quote from Steve Wozniak. If you're a developer and this is hitting your main nerve, the MYO API is available today as well. Just don't expect me to get excited about MYO until I'm able to extend my middle finger at the screen to close browser tabs displaying over-the-top marketing statements.
Leap Motion goes retail: motion controller to be sold exclusively at Best Buy
Ever since we first saw Leap Motion's hyper-accurate gesture control system in person, we've been waiting for the time when we can walk into a store and buy one. Sure, devs have been able to buy Leap controllers for some time and it won't be long before Leap's tech is baked into retail laptops, but now the general public's going to get the chance to grab the standalone controller, too. That's right, folks, this spring, the Leap Motion Controller will be available nationwide at any Best Buy store, with pre-orders starting in February. So, it won't be long before you can stroll on down to the nearest big blue box and pick one up -- assuming there's still one within strolling (or driving) distance.
Hyundai unveils HCD-14 Genesis concept: suicide doors, gesture and eye controls
At NAIAS 2013 Hyundai has given an indication of where its "premium vehicles" are headed with its HCD-14 Genesis concept. Sporting a sharp-edged style and suicide doors, the sedan gets even better inside, with a control layout that foregoes the traditional knobs and buttons. According to Hyundai (it wasn't demonstrated) it includes eye tracking and 3D hand gesture recognition accurate enough to control navigation, infotainment, audio, HVAC, and one's phone. The RWD vehicle packs a 5.0-liter Hyundai Tau V8 engine under the hood with optical recognition that verifies its driver before starting. Hyundai stated that there would be two vehicles on the way following this concept's design, with the second including even more of its advanced tech. Check out the full list in the press release after the break, as well as a good look at the car in our gallery.
A look around Haier's CES 2013 booth: HaiPads, plenty of panels and a wireless blender
Haier had a pretty formidable booth here at CES, so naturally, we had to swing by and cast our eyeballs over anything and everything there. A wall of TVs greeted us, which turned out to be the company's 2013 Roku-ready HDTVs and Android-packing smart models. Screens were everywhere, but there was also a table with some finger-friendly equipment like 9.7-, 7- and 5.3-inch HaiPads, as well as a Windows 8 laptop, touchscreen all-in-one and tab / laptop slider. The slider looked pretty nice, but all the aforementioned hardware was set up in Chinese, so we lost interest pretty quickly. A central hall booth wouldn't be the same without a 4K TV, but not to worry, Haier had a couple on display -- unfortunately, glare from all the other screens dotted around kind of dampened their impact. What we were most interested in was all the prototype technologies on show, but all the Haier reps were from the US sales department, so not a soul could talk about the demonstrations. The eye-controlled TV we saw at IFA last year was getting quite a lot of attention, while the mind-controlled set we've also seen before was almost certainly playing a looping video to give the illusion something was happening. There were also several gesture-controlled models, but one wasn't working and the other was hosting a very basic Kinect-type game. A ping-pong game played with a "Sensory Remote" was also up on one TV, but looked unresponsive and therefore, unfun. A multi-view demo using dual 3D specs did what it was supposed to, and a glasses-free 3D TV prototype showed nice depth as long as you were 12+ ft away (the camera can't really replicate the effect, but there's a quick video of it below anyway). The booth also had a household section which we thought was safe to ignore, until a "wireless blender" caught the eye. "It's just a blender with a battery in it, surely?" this editor asked. "No, there's an inductive coil built into to the underside of the counter," was the reply. Thus was our Haier experience at CES, and to revisit it through our eyes lens, check out the gallery below. Kevin Wong contributed to this report.
ASUS partners up with Leap Motion, PCs with 3D motion control to debut in 2013
Leap Motion's been working hard to get its 3D gesture control technology in the hands of developers -- 12,000 thus far -- since it was first revealed back in May of 2012. Today marks a big step towards getting it into the hands of consumers, as the company has announced its first OEM partner, ASUS. The Taiwanese firm plans to put the technology into new high-end notebooks and premium All-in-One PCs packing Intel's Haswell silicon. As a quick refresher for those unfamiliar with Leap, its tech has a 150-degree field of view that tracks individual hands and all 10 fingers at 290 frames per second to provide ultra precise motion controls. This news got you itchin' to ditch that old machine with its archaic touchpad or mouse interface in favor of a gesture-controlled ASUS? We can't tell you how much they'll cost, but ASUS promises the PCs will be available around the world later this year.
Hisense jumps into 4K TVs with the XT880, promises Android 4.0 and a sane size
The current crop of 4K TVs from LG and Sony are large enough that some of us would need to knock out a wall to get them inside. Enter a surprise early challenger from Hisense: its upcoming XT880 line's 50-, 58- and 65-inch sizes deliver that 3,840 x 2,160 picture at dimensions built for mere mortal living rooms. We're also promised a full-fledged, 3D-capable smart TV based around Android 4.0 with WiFi internet access, a remote with voice commands and a removable camera for gesture control or Skype chats. Hisense yet hasn't committed to launch details for the XT880 line besides a presence on the CES show floor; however, it's safe to say that the smaller sizes will bring the price of Ultra HD down from the stratosphere.
