KinectHack
Latest
Microsoft HoloDesk: when you need to juggle something that isn't there (video)
If you'd thought that OmniTouch and PocketTouch were the end of Microsoft Research's natural user interface projects, think again. It's now released a video of the HoloDesk, a tool that lets you manipulate virtual 3D objects with your bare hands. Looking through a transparent display, the objects react nearly instantly, rolling from a sheet of real paper into a real cup and falling into shadow if you block the virtual light-source. The Cambridge lab that developed the tool sees uses in remote working, collaboration or device prototyping. If you hadn't guessed, there's a hacked Kinect at the heart of HoloDesk's DNA, which makes us wonder how long it'll be before we can use it to play Halo.
The Gadget Show builds an FPS simulator that shoots back (video)
Racing simulators are ten a penny, but the closest an FPS player will get to an immersive experience is buying some branded peripherals. Armed with a pre-release level of Battlefield 3, The Gadget Show enlisted a team of design experts to transform a Birmingham studio into an FPS simulator costing £500,000 ($650,000). A four by nine meter video dome surrounds the player as they stand on an omni-directional treadmill that lets you walk wherever you want to go. Ten infra-red motion tracking cameras and a sensor on your gun enables the picture to follow where you point it and a Kinect hack controls your jumping and crouching. The fun doesn't stop there -- 12 paintball markers mean that every time you get shot in the game, you'll feel it. The show airs in the UK on October 24th at 8:00pm, Channel 5. We've got a behind the scenes gallery below (supplied by those lovely people from the show) as well as PR and a trailer after the break. %Gallery-136970%
Kinect hack lets you manage your bank account with gestures, will occupy your living room (video)
You know all those convoluted gestures and hate-infused fist pumps you make every time you look at your bank account? Well, you can now put them to good use, thanks to a new Kinect hack from Lithuania-based Etronika. The company's software, which made its debut at last week's CTIA E&A event, effectively brings motion-controlled banking directly to your living room. All you have to do is stand in front of your display, clap your hands to choose an icon, or wave your hand back and forth to navigate across the app's carousel menu. This means you can pay your bills, check your balance and return to fetal position without even touching a sharp object. "A lot of banking software apps are filled with boring crap," Etronika CEO Kestutis Gardziulis explained with refreshing candor. "With our software, you could be on the couch at home, having a beer, all while dealing with your bank account and kicking back." Beer, banking and body language -- sounds scandalous! Head past the break to watch a demo video, starring Pam Beesly's doppelgänger.
ASIMO mimics your every move, edges closer towards Single White Robot territory (video)
Hey, look Engadgeteers! It's another Kinect hack -- except this one uses a real deal robot. Honda ushered ASIMO out to the crowds at IEEE's 2011 International Conference on Intelligent Robots and Systems to show off its newly acquired pop and lock skills. Alright, so the silicon-gutted fella can't krump with the best of'em yet, but he can probably do the locomotion -- it all depends on your dance repertoire. After toiling away in their mad scientist lairs, the researchers behind the bot have managed to devise a means of mimicking human movement that translates mapped points on a user's upper body into real-time, robot-replicated motion. The devious among you are likely imagining left-of-center uses for the tech, but let us deflate that mischievous balloon; there'll be no instances of "stop hitting yourself ASIMO" here, as engineers have built-in collision and stability safeguards. The so-lifelike-it's-Uncanny advancements don't end there either, since ASIMO also contains a database of text-inspired gestures -- giving our future robot friend a means of physically expressing his cold, "I hate you so much right now" robo-tone. Other than finding himself at home in Italy, these innovations are sure to put ASIMO on the other end of our remote-controlled behest. Click on past the break to see this automated mime drop it like it's hot.
Kinect / Arduino hack makes stuffed monkey dance for your amusement
Just when you thought that people had squeezed the last drop of creativity out of Microsoft's Kinect, something like this comes along. It's a stuffed monkey with a robotic skeleton that can mimic the movements of the person standing in front of it. "Monkey Business" is an art installation of sorts created by Jan M. Sieber and Ralph Kistler. It uses a camera sensor from a Kinect, an Arduino mircocontroller, and 10 servomotors. The smirking robo-monkey, meanwhile, is suspended from the wall, giving it a full range of movement. The resulting video is pretty darn delightful.
Microsoft's KinectFusion research project offers real-time 3D reconstruction, wild AR possibilities
It's a little shocking to think about the impact that Microsoft's Kinect camera has had on the gaming industry at large, let alone the 3D modeling industry. Here at SIGGRAPH 2011, we attended a KinectFusion research talk hosted by Microsoft, where a fascinating new look at real-time 3D reconstruction was detailed. To better appreciate what's happening here, we'd actually encourage you to hop back and have a gander at our hands-on with PrimeSense's raw motion sensing hardware from GDC 2010 -- for those who've forgotten, that very hardware was finally outed as the guts behind what consumers simply know as "Kinect." The breakthrough wasn't in how it allowed gamers to control common software titles sans a joystick -- the breakthrough was the price. The Kinect took 3D sensing to the mainstream, and moreover, allowed researchers to pick up a commodity product and go absolutely nuts. Turns out, that's precisely what a smattering of highly intelligent blokes in the UK have done, and they've built a new method for reconstructing 3D scenes (read: real-life) in real-time by using a simple Xbox 360 peripheral. The actual technobabble ran deep -- not shocking given the academic nature of the conference -- but the demos shown were nothing short of jaw-dropping. There's no question that this methodology could be used to spark the next generation of gaming interaction and augmented reality, taking a user's surroundings and making it a live part of the experience. Moreover, game design could be significantly impacted, with live scenes able to be acted out and stored in real-time rather than having to build something frame by frame within an application. According to the presenter, the tech that's been created here can "extract surface geometry in real-time," right down to the millimeter level. Of course, the Kinect's camera and abilities are relatively limited when it comes to resolution; you won't be building 1080p scenes with a $150 camera, but as CPUs and GPUs become more powerful, there's nothing stopping this from scaling with the future. Have a peek at the links below if you're interested in diving deeper -- don't be shocked if you can't find the exit, though. %Gallery-130263%
Archaeologists eschewing traditional whip / leather jacket combo for Kinect controllers
The latest must-have piece of technology in the archaeological world? The Kinect. Students from the University of California, San Diego are taking Microsoft's much-hacked peripheral on an archeological dig in Jordan, using the device to help create 3D scans of the site on the cheap. The hack pulls data captured by the Kinect's camera and infrared scanner, turning the information into avatars that can be plugged into virtual worlds. The hack's creator is hoping that it might some day be able to capture information as complex as a buildings or neighborhoods. The first, decidedly less ambitious application is being referred to as "ArKinect," because what's a cool hack without a cool name?
Kinect app promises you'll wear flowery skirts, and you'll like it (video)
Don't be shy now: which of you doesn't love raiding your mother's closet and trying on her paisley dresses and velour tracksuits? That's more or less the idea behind Virtual Dressing Room, a Kinect program that taps into the clandestine thrill of sneaking into other people's boudoirs. Unlike some other shopping hacks we've seen, the app goes beyond just pilling on 2D pieces, but uses 3D models so that the items mold to your limbs, with the shadows and creases in the virtual fabric changing as you preen for the camera. That all comes courtesy of a special physics engine, while the app itself was written in C# along with Microsoft's XNA tools. Arbuzz, the group that dreamed this up, says the project's still a work in progress, though we can see this, too, being used to relieve those of who are allergic to shopping malls. Until then, you'll just have to settle for watching some other guy work a knee-length skirt.
Quadrocopters reined in by Kinect leash, we feel safer already
It seems like the folks over at the Flying Machine Arena are finally starting to catch on -- those quadrocopters are going to kill us all. Thankfully, after teaching them to juggle and tap out some tunes, the researchers came to their senses and put the flying machines on a Kinect-controlled leash. Instead of flitting about autonomously, the four-rotored nightmares are directed by a puppeteer waving his hands. Movement is controlled by the right hand, while raising the left one tells the copter to do a little flip for its master's amusement, and a commanding clap makes it sit down like a good little pup. Best of all, if you don't give it any arm-waving instruction it just hovers and waits until you tell it otherwise. On further consideration, maybe we haven't been creating our own murderers, but a new man's best friend -- after all, they don't eat much and can't chew up your remotes. Check out the video after the break.
Kinect / iPad hack should help you get Obi-Wan's attention (video)
You know the old story, right? You come into possession of plans for the Empire's moon-sized space station, and now they've come to capture you. What to do? Well, if you've got access to a Kinect, an iPad, and the String SDK, you're in luck. The folks at LAAN Labs demonstrated a nifty little hack that can turn 3D data recorded using the Xbox 360 peripheral into a Princess Leia-esque augmented reality image playable on the Apple tablet. Check the video below -- unless you're a scruffy-looking nerf herder, that is.
Kinect Graffiti creates neon tags with the wave of a hand (video)
Are you tired of Kinect hacks yet? We didn't think so -- good thing too 'cause we're not done bringing 'em to you. The latest one to hit our tips box comes from designer Jean-Christophe Naour (Innoiz Interactive), a 3D light-painting program he calls Kinect Graffiti. While calling the results "graffiti" might be a little misleading (Naour isn't exactly bombing virtual walls) it does whip up some nice streaky neon images that can capture the act of tagging, if not the final product. We won't waste any more of your time with our rambling -- a picture is worth a thousand words, and the video after the break is composed of over 4,000 of those. Don't miss the flood of photos at the more coverage link either.
Newest Kinect hack: a grocery cart that loyally follows disabled shoppers (video)
Microsoft's Kinect is the gift that keeps on giving for hackers, spawning everything from glasses-free teleconferencing to Tesla coil manipulation to uh, well, Android dance parties. But Luis de Matos's wi-Go project is one of the most socially conscious we've seen: it adds a laptop and (despite its name) a Kinect to a shopping cart, enabling the cart to follow a wheelchair user. Improving on the B.O.S.S. bot we saw a half-decade ago, the wi-Go could allow anyone -- including the disabled or elderly -- to shop independently, regardless of physical capability. De Matos doesn't offer many technical details, but see the video above for a before-and-after demonstration.
Kinect hack turns your living room into a crazy one-man laser techno dance party (video)
We've seen it aid surgery, help make smarter robots, and even do some gaming stuff, but honestly, what good is a controller if it can't fuel your crazy techno dance parties? Vimeo user Matt "Namethemachine" Davis posted a video showing a new hack for the peripheral, using its camera-based motion detection, combined with Ableton Live, DMX protocol, and more clever hackery to create a one-man electro-laser light show. It's easy to see this getting a bit out of control real fast in a room packed with overexcited club goers, but if you're looking to recreate the communal experience for you and your cat in your one bedroom apartment, this may be just the ticket.
Researchers hack Kinect for glasses-free 3D teleconferencing (video)
Since the dawn of Kinect hacking, we've seen cameras strung together (or rotated) to create 3D, video game-like environments, while others have tweaked it for headtracking. Others, still, have used it for teleconferencing (albeit, the flat, two-dimensional variety). Now, a team of researchers have gone and thrown it all together to achieve 3D video chats, and if we do say so, the result is greater than a sum of its parts. The group, based out of UNC-Chapel Hill, uses 3D mapping (and at least four Kinects) to render the video, and then employs headtracking on the receiving end so that people tuning in will actually see the live video in 3D, even without wearing 3D glasses. The result: a tableau that follows you as you move your head and spin around restlessly in your desk chair waiting for the meeting to end. That's mighty impressive, but we can't help but wonder: do you really want to see your colleagues in such lifelike detail? Have a gander at the video and decide for yourself.
Visualized: Androidify avatar dance party (video)
Have your YouTube dance videos been lacking something? Can't quite put your finger on it? How 'bout another, more Android-y you to add some diversity to your One, Two Step? The folks who brought you the Androidify app have apparently enlisted a friend, his Android avatar, and a Kinect to bring you the above video. Not too shabby, but we'd be even more intrigued if he was rocking a black leotard and busting out Mexican Breakfast, Beyonce-style. Check out the not-so-Fosse video after the break. [Thanks, John]
Hacked Kinect duo teams up with HD projector to make 360 Snowglobe display (video)
Flatscreen displays? Decidedly old hat; students from Queens University have a better idea: snowglobes. Hacking together a 3D HD projector, two Kinect sensors, and a hemispherical mirror mounted inside of an acrylic sphere, "Project Snowglobe" has created a pseudo holographic display -- presenting a 360-degree view of a digital object. The all-angles display is compelling, but it's strictly a single-user affair; the object isn't actually projected in 3D -- it instead follows the movements of a lone Earthling, rotating and shifting position, in sync with the viewer. The display standard of the future? Maybe not, but pretty darn cool, all the same. Hit up the video after the break to check it out.
Kinect hack enables psychedelic acupressure, far-out graphics (video)
We've seen the Kinect do some pretty wild stuff, but this "Kinected Massage" thing might just take the cake. Jason Stephens, massage therapist and grad student, has employed the ever-expanding power of Microsoft's Kinect in combination with a video projector to create "flow fields" that follow his hands on a client's body while he performs a massage. Stephens describes the process as a "technologically mediated healing modality," and while we're not sure that the Kinect actually contributes much to the relaxation process, it does make for some pretty trippy graphics. Hop on past the break and expand your mind, man.
Augmented reality Tetris game uses Kinect hack, Wiimote, smooth jazz (video)
What does it take for a gaming classic to survive in a world ruled by titles like Portal 2 and Homefront? A Kinect hack, a Wiimote, and some electronic elbow grease, apparently. Trinity College student Keysosaurus -- as he's know to his YouTube pals -- has used a bit of C#, XNA, and OpenNI coding to play 3D augmented reality Tetris using Kinect body controls and a Wiimote. The Kinect gestures do most of the work, rotating the board, zooming the camera in and out, and moving the pieces into place, while the Nintendo controller is used to rotate. Video's after the break, but beware, the familiar strains of "Korobeiniki" have been replaced by smooth guitar jazz, so turn the volume up at your own risk.
Kinect hack turns tourists into 3D souvenirs (video)
As souvenirs go, a miniature replica of yourself -- striking a pose of your choosing on Barcelona's La Rambla street -- is a far sight more original than a bullfights-and-senoritas snow globe. This past January, the hilariously titled BlablabLAB enlisted three Kinects and a RapMan 3.1 to snap passersby and render them into personalized tchotchkes, in a project called Be Your Own Souvenir. Subjects stood atop a small platform, mimicking the human statues on La Rambla, as the Kinects captured their likeness in full 360-degree glory. The resulting images were then processed as a mesh reconstruction, saved as a G-code file, and then fed through a 3D printer -- and voila, out popped the tiny statuettes. If you're a fan of flashy editing and Kinect-based street experiments, check out the video after the break.
Man steers R/C car with his hands, not to mention an HTML5-based web app (video)
With the right Arduino board, an R/C race car, a couple paperclips and the MacGyver spirit, we imagine most anyone can hack together a creative remote control these days... but how many can open-source an HTML5 web app that'll do the deed from any tablet, phone or PC? Gaurav Manek crafted just such a thing, and he'll demonstrate it for you on an Apple iPad in the video immediately above. What's more, he's also got a Kinect hack that uses Microsoft depth camera (with Code Laboratories' NUI SDK) to control the very same with the wave of a well-placed hand -- we're already envisioning fisticuffs should he and a lab partner try for some head-to-head racing action. That said, you don't need to wait for an illustrious creator to have all the fun. Why not download his source code at our links below and give it a go yourself?
