DepthCamera
Latest
Hands-on redux: Creative's Interactive Gesture Camera at IDF 2013 Beijing (video)
At IDF 2013 in Beijing, Intel is again making a big push for perceptual computing by way of voice recognition, gesture control, face recognition and more, and to complement its free SDK for these functions, Intel's been offering developers a Creative Interactive Gesture Camera for $149 on its website since November. For those who missed it last time, this time-of-flight depth camera is very much just a smaller cousin of Microsoft's Kinect sensor, but with the main difference being this one is designed for a closer proximity and can therefore also pick up the movement of each finger. We had a go on Creative's camera with some fun demos -- including a quick level of gesture-based Portal 2 made with Intel's SDK -- and found it to be surprisingly sensitive, but we have a feeling that it would've been more fun if the camera was paired up with a larger display. Intel said Creative will be commercially launching this kit at some point in the second half of this year, and eventually the same technology may even be embedded in monitors or laptops (remember Toshiba's laptops with Cell-based gesture control?). Until then, you can entertain yourselves with our new hands-on video after the break. %Gallery-185293%
Fruit Ninja meets real Ninja with CamBoard's Pico gesture camera (video)
You can play Fruit Ninja with your fingertips, you can play it with your eyes, so it's reasonable enough that hand waving should control it too. And while gesture-sensing technology is hardly new, Teutonic outfit pmdtechnologies has been teasing a miniaturized edition of its depth camera that's ripe for embedding into small consumer electronics devices. All we've got so far is a short video (after the break) outlining its potential, but that's enough to hope someone can go head-to-head with Microsoft in the space.
Kinect for Windows SDK gets accelerometer and infrared input, reaches China and Windows 8 desktops
Microsoft had hinted that there were big things in store for its update to the Kinect for Windows SDK on October 8th. It wasn't bluffing; developers can now tap a much wider range of input than the usual frantic arm-waving. Gadgets that move the Kinect itself can use the accelerometer to register every tilt and jolt, while low-light fans can access the raw infrared sensor stream. The Redmond crew will even even let coders go beyond the usual boundaries, giving them access to depth information beyond 13 feet, fine-tuning the camera settings and tracking skeletal data from multiple sensors inside of one app. Just where we use the SDK has been expanded as well -- in addition to promised Chinese support, Kinect input is an option for Windows 8 desktop apps. Programmers who find regular hand control just too limiting can hit the source for the download link and check Microsoft's blog for grittier detail.
Microsoft patent applications take Kinect into mobile cameras, movie-making
Microsoft has never been shy about its ambitions for Kinect's depth sensing abilities. A pair of patent applications, however, show that its hopes and dreams are taking a more Hollywood turn. One patent has the depth camera going portable: a "mobile environment sensor" determines its trajectory through a room and generates a depth map as it goes, whether it's using a Kinect-style infrared sensor or stereoscopic cameras. If the visual mapping isn't enough, the would-be camera relies on a motion sensor like an accelerometer to better judge its position as it's jostled around. Microsoft doesn't want to suggest what kind of device (if any) might use the patent for its camera, but it's not ruling out anything from smartphones through to traditional PCs. The second patent filing uses the Kinect already in the house for that directorial debut you've always been putting off. Hand gestures control the movie editing, but the depth camera both generates a model of the environment and creates 3D props out of real objects. Motion capture, naturally, lets the humans in the scene pursue their own short-lived acting careers. We haven't seen any immediate signs that Microsoft is planning to use this or the mobile sensor patent filing in the real world, although both are closer to reality than some of the flights of fancy that pass by the USPTO -- the movie editor has all the hallmarks of a potential Dashboard update or Kinect Fun Labs project.
Researcher proposes Thumb on Hand gestures, no touchscreen necessary (video)
Would you be willing to wear an additional device in order to avoid interacting with another? That's the conundrum posed to us by Christian Loclair, a master's student at the Hasso Plattner Institute. His thesis, titled Thumb on Hand Interaction, proposes that users control their mobile equipment with simple hand gestures that are performed independently of their device's touchscreen. This level of freedom requires that users wear a depth camera on their chest, and builds upon prior research from the Hasso Plattner Institute that required use of both hands. Loclair proposes a diverse new set of gestures that users can perform with only one hand, where one's thumb acts as the primary navigation tool and one's palm serves as a trackpad. Another set of gestures is based on the interaction of one's thumb and index finger, which allows users to control sliders and the like. Perhaps once the research team determines how to implement this technology without making our lives more complex, we'll be able to sink our teeth into this one. In the meantime, you'll find a video demonstration after the break.
Invisible iPhone prototype puts the 'hand' back in 'handset' (video)
Not too long ago, the invisible iPhone was nothing more than satirical fodder for the Onion. Now, Patrick Baudisch and his team of researchers at the Hasso-Plattner Institute have moved closer to making it a reality, with a new interface that can essentially transfer an iPhone touchscreen to the palm of your hand. The device involves an Xbox-like depth camera, mounted on a tripod, that can register the movements of a person's finger across his or her palm. Special software then determines the actions these gestures would execute on a user's iPhone, before transmitting the commands to a physical phone, via WiFi radio. Unlike MIT's motion-based "sixth sense" interface, Baudisch's imaginary phone doesn't require users to learn a new dictionary of gestures, but relies solely on the muscle memory that so many smartphone users have developed. During their research, Baudisch and his colleagues found that iPhone owners could accurately determine the position of two-thirds of their apps on their palms, without even looking at their device. At the moment, the prototype still involves plenty of bulky equipment, but Baudisch hopes to eventually incorporate a smaller camera that users could wear more comfortably -- allowing them to answer their imaginary phones while doing the dishes and to spend hours chatting with their imaginary friends. Head past the break to see the prototype in action.
Microsoft's Kinect navigates the universe thanks to Windows SDK (video)
Microsoft's WorldWide Telescope -- a collaboration with NASA that explores high-resolution photos and 3D renders of the cosmos -- was already pretty cool, but Redmond upped the ante to incredible with the addition of a Kinect depth camera at MIX 11. Using a piece of software created with the company's upcoming Kinect SDK for Windows, Microsoft gave us a virtual tour of Earth and the surrounding stars, guided by a deep-voiced narrator holding the whole world in his hands. Of course, you'd already know that if you watched the video above, so what are you waiting for? Oh, and we've got more MIX video on the way, so stay tuned. Myriam Joire contributed to this report.
Kinect dives into anime cyberspace, dares you to catch cute robot tanks (video)
If your foremost dream is to jack into a dystopian cyberpunk reality where hackers play with human brains (and you also happen to love Japanese anime), you'd best book your flight to Tokyo right now -- a Shibuya department store has set up a basic cyberspace simulator straight out of Ghost in the Shell. That's the film Ghost in the Shell: S.A.C. Solid State Society, to be precise, which just got a stereoscopic 3D re-release in Japan this week, and in its honor creative services company Kayac set about constructing a high-quality Kinect hack. Microsoft's depth camera tracks the lean of your body, while the honeyed virtual reality is projected onto a pair of nearby walls, and it's your objective to slap the Tachikoma tank silly without falling over yourself. Get a peek at what it's like to play with in the video above.
Microsoft seeking to quadruple Kinect accuracy?
Hacked your Kinect recently? Then you probably know something most regular Xbox 360 gamers don't -- namely, that the Kinect's infrared camera is actually capable of higher resolution than the game console itself supports. Though Microsoft originally told us it ran at 320 x 240, you'll find both color and depth cameras display 640 x 480 images if you hook the peripheral up to a PC, and now an anonymous source tells Eurogamer that Microsoft wants to do the very same in the video game space. Reportedly, Redmond artificially limited the Kinect on console in order to leave room for other USB peripherals to run at the same time, but if the company can find a way around the limitation, it could issue a firmware update that could make the Kinect sensitive enough to detect individual finger motions and inevitably lead to gesture control. One of multiple ways Microsoft intends to make the world of Minority Report a reality, we're sure.
Intel research projects bring Legos to life, make groceries interactive
Kinect hacks aren't the only projects using depth cameras these days, Intel's Seattle research lab has also been working on a whole range of projects using what it describes "Kinect style" cameras, and it's now showing off some of the results. Among the most interesting are a pair of projects that combine a depth camera with a projector for some rather inventive augmented reality applications. One of those examples can effectively bring Legos to life (as pictured above), while the other adds a whole new degree of interactivity to everyday objects, namely groceries -- which could let you manage a grocery list using actual fruits and vegetables, for instance, or even warn when you've left a tub of ice cream sitting on the counter too long. That's just scratching the surface, though -- the group has also devised a system that can map a room just by walking around with a depth camera, which can then of course be navigated using the very same depth camera and a pair of 3D goggles. Head on past the break for a couple of videos, and hit up the source link below for the rest.
Kinect data massaged into retro-futuristic 'Box Cloud,' iPad tilts its way into the action
We're sorry if you're like, so over Kinect hacks, but with a million tinkerers just getting warmed up on the thing, we recommend you just get comfortable and try to enjoy it. A new processing app by Chris Rojas takes the distance data and renders objects in neon cubes, with the size of the cube based on the object's distance from the sensor. Sure, it won't cure world hunger, but it looks pretty sweet. Of course, that wasn't good enough, so Chris hooked his app up to TouchOSC on the iPad, which gives him sliders to define and adjust different "planes of interest," along with the accelerometer input of the iPad to control zoom and pan of the virtual camera. Just don't get too close to that sensor, Chris, or the MCP might decide to digitize you entirely! Check out the original, iPad-less Box Cloud video after the break.
Kinect does hacker's bidding, but not for fortune or fame (update: more video)
Yes, Microsoft's Kinect has already been cracked, as you'll see on video after the break -- the motion-sensing depth camera now nods its head on command and displays real-time accelerometer data on one lucky hacker's PC. We tracked down the son-of-a-gun who did it -- as it happens, the same NUI Group member who hacked the PlayStation Eye in 2008 -- and found to our disappointment that he doesn't necessarily intend to unleash his new exploit on the world. The $2,000 prize Adafruit is presently offering for open-source Kinect drivers isn't his aim, though he does have big personal plans for the device, as he hopes to integrate it into his company's commercial visualization suite CL Studio Live. It seems that work is progressing fast, as he's already gotten video streams from both cameras to output to his computer, and he plans to upload a far more convincing video soon. Here's hoping he has a change of heart about sharing his rapid accomplishments. Update: Second video after the break! [Thanks to everyone who sent this in]
