KinectHack
Latest
Kinect quadrocopter gets a new mission: 3D mapping (video)
In the future, our flying robot overlords won't just navigate terrain autonomously, they'll also report back to base with detailed 3D maps of everything they've seen -- or at least that's what this homebuilt UAV does in a video released this week. In a nutshell, MIT's combined its room-mapping Roomba with the Kinect quadrocopter radar developed at UC Berkeley, resulting in a flying contraption sure to be the envy of topographers everywhere. We're not sure that the world's robot incumbents will be too happy, though -- perhaps MIT should invest in some laser protection next.
Kinect dives into anime cyberspace, dares you to catch cute robot tanks (video)
If your foremost dream is to jack into a dystopian cyberpunk reality where hackers play with human brains (and you also happen to love Japanese anime), you'd best book your flight to Tokyo right now -- a Shibuya department store has set up a basic cyberspace simulator straight out of Ghost in the Shell. That's the film Ghost in the Shell: S.A.C. Solid State Society, to be precise, which just got a stereoscopic 3D re-release in Japan this week, and in its honor creative services company Kayac set about constructing a high-quality Kinect hack. Microsoft's depth camera tracks the lean of your body, while the honeyed virtual reality is projected onto a pair of nearby walls, and it's your objective to slap the Tachikoma tank silly without falling over yourself. Get a peek at what it's like to play with in the video above.
Kinect meets a Pufferfish display, produces wonderfully creepy all-seeing eye (video)
As Kinect hacks go, this one's not going to bowl you over with its technical complexity, but the effect of what it does is quite dramatic. One of Microsoft's sensor-rich, camera-laden Xbox accessories has been repurposed to communicate with a Pufferfish spherical projection display -- via the magic of WPF and openni -- with its motion tracking algorithms serving to control the image on the giant ball. Naturally, the first thing the tweakers behind this mod thought up was a Tolkien-inspired eye that follows people around the room. Sadly, the single Kinect box isn't enough to provide 360-degree coverage, but it's probably just a matter of time until they splice an array of them together and creep us out completely. Video after the break. Update: You asked for the eye of Sauron and now you've got it. Second video added after the break.
Kinect hacked to control Tesla coils from a safe distance (video)
Just how does one come up with the bright idea to control Tesla coils with a Microsoft Kinect? In a pub, of course.
Kinect hacked for home automation, does your mood lighting for you (video)
Microsoft's Kinect has become quite the hacking hotbed -- the fields of medicine, music, and even shadow puppeteering have all benefitted from the peripheral's incredible versatility. And now, to the delight of home automation nerds everywhere, an enterprising young hacker has rigged a Kinect to automate the lighting in his home. By positioning the camera bar in a corner to track his movements, connecting it to the automation controller, and coding on / off commands, he's able to control the lights throughout his geektastic domicile. The automation logic then turns on the lights when entering the room, localizes them according to location, and turns them off upon leaving. One less thing to worry about -- here's hoping a method for spotting our perpetually misplaced keys is in version 2.0. Vid's after the break.
Kinect hack turns Arduino-controlled delta robot into aggressive claw crane (video)
Candy crane, teddy picker, claw machine, whatever you call it, this arcade mainstay was robbing children of their golden tokens long before we slid into our first pair of Hammer pants, but despite the changing face of the plush offerings within, the crane game's remained mostly the same. Now a team of students at the Bartlett School of Architecture have produced a Kinect hack that could change the way you drop that claw. The rather temperamental delta robot enlists the ever-hackable peripheral in combination with Processing and Arduino to mimic the movements of a user's arm. As you can tell by the video below, the delta hasn't quite figured out the subtleties of human gestures, but the robot's creators say they intend to implement "several autonomous behaviors" once all the kinks are worked out. Frankly, we'd pay our weight in tokens to see the crane game bite back at an unsuspecting whippersnapper. Video after the break.
Fabricate Yourself Kinect hack turns you into a 3D puzzle piece
We've been whittling our likeness into bars of soap for decades, but lucky for us someone's come up with a far easier way to render our flawless good looks in miniature. Following in a long line of inventive Kinect hacks, the folks at Interactive Fabrication have produced a program called Fabricate Yourself that enlists the machine to capture images of users and convert them into 3D printable files. The hack, which was presented at Tangible, Embedded and Embodied Interaction Conference in January, results in tiny 3D models that resemble Han Solo trapped in carbonite and sport jigsaw edges that can be used to make a grid of small, but accurate renderings. Fabricate Yourself is still in its infancy, and the resulting models are relatively short on detail, but we're no less excited by the possibilities -- just think of all the things we could monogram in the time it takes to produce one soapy statuette. Video after the jump.
Microsoft to release Kinect for Windows SDK this spring
Looks like we're not the only ones enjoying all those Kinect hacks being dreamed up and implemented by hardworking enthusiasts the world o'er. That's right: it was rumored early this year, and now it's been confirmed -- Microsoft will be releasing the Kinect for Windows SDK. According to Microsoft, "It will be available this spring as a free download, and will give academic researchers and enthusiasts access to key pieces of the Kinect system-such as the audio technology, system application programming interfaces and direct control of the Kinect sensor itself." Commercial licensing details will be made available at some point thereafter. [Thanks to everyone who sent this in]
Kinect hack turns controlling the TV into light aerobic exercise (video)
Why idly click away at the remote control when you can stop what you're doing, stand up in front of the television, and gesticulate wildly for the same effect? Because it's cool, that's why! Our man Harishankar recently uploaded a YouTube video of himself doing just that, and it's a pretty sweet deal: his Kinect is connected to a Mac mini, which uses OpenNI to detect his skeleton, read certain gestures (punch up to increase volume, punch right or left to change channels, etc.) and send the info to a USB-UIRT box. The latter device, which many of you might have used in your own HTPC projects, connects to your computer's USB port and lets it receive and transmit IR signals. In this case, the computer is sending the gesture controls to the TV. Practical? Maybe not for most of us, but lots of fun nonetheless. Hit the source link to try it for yourself, but not before you peep the video of the thing in action after the break.
Kinect hack gets a Wiimote assist, stomps all over Dead Space 2
It's not the first time that a Kinect hack has incorporated a Wiimote, but this demonstration from YouTube user Kick755 is certainly one of the more impressive examples to date -- even if it's still not quite ready to fully replace a controller. As with similar hacks, this one relies on the FAAST emulator for the Kinect end of the equation and GlovePIE for the Wiimote, but it has one notable feature that the others lack: the ability to quite literally stomp on your enemies in Dead Space 2. See for yourself after the break.
Wii Remote Plus joins Kinect and Vuzix shades for 2011's weirdest VR shooter yet (video)
The natural evolution to Nao_u's impressive Kinect- and Vuzix-infused already impressive virtual reality simulator? Guns, of course. A Wii Remote Plus has been added to his project, joining Microsoft's sensor and VR920 LCD glasses for a VR shooting game that involves, well, lobbing paintballs out of a P90 rifle towards flying disembodied anime characters. Make no mistake, it's a great technical demo chock full of aesthetic eccentricities. Full details via the developer's diary, video after the break.
Kinect meets Minecraft, animates a giant statue in your honor (video)
This isn't the first time Kinect and Minecraft have crossed paths -- scavenge the 'nets and you'll find plenty of user interface examples. What Nathan Viniconis has done, however, is different. What you're looking at above is rendered instantly by way of using what the Kinect sees and constructing an in-world monument in real time. Not only that, but the project has now evolved into a sort of stop motion animation. It's pretty impressive, even for those who have little to no idea what Minecraft is. All the nitty gritty details are available on the project page. The video, of course, is after the break.
Kinect combos Street Fighter IV, fires single-fisted boomsticks at the FPS crowd (video)
Oh sure, we've seen the Kinect assist a hadouken or two, but that wasn't the same: here, the YouTube user who brought us Call of Duty via Wiimote, Nunchuk and Kinect is throwing fireballs and taking names in the real game. Demize2010 manipulated the FAAST emulator to recognize a variety of virtual martial arts gestures, including the infamous dragon uppercut and whirlwind kick -- giving him everything he needs for a flowchart victory with only his bare hands. Meanwhile, one Bill Maxwell has taken the Kinect and made it recognize his fist, the better to control first-person shooter games with requiring an Wiimote intermediary. He's developed a "high-speed kinematic tracker" called MaxFPS that monitors his hand's position in real time, allowing him to move, turn, jump, and reload with quick swipes of his paw. How do you shoot? Why, by punching those baddies' lights out, of course. See it on video after the break.
University of Washington students hack Kinect to aid in robotic surgery
We're sure that a time will come when we're slightly less amazed by Kinect hacks but, right now, we're still just seeing one more impressive than the last -- and we're certainly OK with that. This latest comes to us from a group of students at the University of Washington, who had the bright idea to pair Microsoft's device with some of the robotic surgery projects currently being developed by the university's BioRobotics Lab. That combo isn't quite the sentient, Kinect-enhanced robo-surgeon you may have feared, though. The students are actually using Kinect to provide force-feedback to the actual, human surgeons controlling the robotic equipment -- something that would have been a $50,000 proposition without Kinect. As you might expect, however, the Kinect-based system isn't quite ready to be used for actual surgery as it is -- while it gets the job done as a proof of concept, the students note that the sensors will need to be scaled down, and the resolution improved in order to be deemed suitable for surgical use.
Kinect support for Windows in the works, SDK release this summer?
WinRumors, citing anonymous sources, reports that the official software developers kit (SDK) for Kinect is currently in the works and will be released in beta some time in the next few months. Apparently, support for the device will become a part of Microsoft's XNA Game Studio and also be integrated into Windows 8 in a big way. These details come hot on the heels of CEO Steve Ballmer's statement at CES that the good folks in Redmond would eventually support the device's use on computers, but he set no timetable for the SDKs release. We can't confirm the story, but given the level of detail in the report and the author's confidence in the info, we won't be surprised if Microsoft gives all you Kinect hackers something to cheer about very soon.
Kinect + projector = augmented reality fireballs (video)
We've seen fancy augmented reality projection before, but we've rarely been able to take it home -- now, it seems Microsoft's hack-friendly Kinect can bring the same trick to the consumer realm. Elliot Woods took the idea that Kinect can map a three-dimensional space and twisted it to his own devious ends -- that is, throwing traditional Street Fighter fireball blasts, complete with the sound effect. What's impressive here, though, isn't the size of his hadouken, but rather the light it's made of -- each is a virtual dynamic light source casting light on the room's real objects to create virtual shadows on the surfaces that stick out. Sounds lovely, but if you can't wrap your head around all that, you'll find all the hot fireball action you need in the video after the break at roughly the five minute mark.
Magic Mirror Kinect hack puts an x-ray spin on augmented reality
That's right -- not even CES can stop the endless wave of Kinect hacks. The latest, and one of the more impressive to date, is the so-called "Magic Mirror" developed by Tobias Blum from the Technical University of Munich, which bridges augmented reality with x-ray vision (of sorts). Of course, the "of sorts" is that it doesn't actually peer through your body to reveal your skeleton (yet), but instead maps a random skeleton from a CT scan onto your frame to create a real-time freakout. As with most Kinect hacks, this one is best seen on video -- check it out after the break.
Researchers use Kinect to play WoW
Microsoft's Kinect motion addon for the Xbox 360 has been a huge success, not only in the retail world but in the hacker community as well. We've seen some awesome mods for the Kinect in the past few months of its release -- and finally, we've combined the Kinect world with WoW. The USC Institute for Creative Technologies has released a program called FAAST (Flexible Action and Articulated Skeleton Toolkit) that allows the Kinect to be used as a controller for off-the-shelf games. Check out the video of Kinect being used to control a World of Warcraft character. The software emulator acts as a layer over the keyboard, reading movement as key presses. Personally, I love that the depth sensors of the Kinect can be used to move backwards and forwards by leaning forward and back. So awesome.
Free Kinect keyboard emulator lets you WoW while AFK (video)
World of Warcraft is a lot of things to a lot of people, a whole lot of people, but it's never been much of an immersive gameplay experience -- casting Plague Strike doesn't seem all that unholy when it's triggered by frantically tapping a key on a keyboard. Moving an arm would be at least a bit more involving, and with the Flexible Action and Articulated Toolkit, or FAAST, from the USC Institute for Creative Technologies, that's just what you can do. It's basically a software layer over your Kinect, built over OpenNI, that recognizes a skeleton and enables about 20 different motions to be mapped to key presses. This means you can lean forward to walk, raise your right arm to perform an action, and then sit down to take a breather after all that exertion. It's currently versioned .03, so don't expect miracles, but it is available for free at the other end of the source link. It's also demonstrated below, but don't tarry too long: guild meeting starts in five. [Thanks, Tommy]
OpenVizsla USB sniffer meets its funding goal, and then some
It's not iPad nano watch money -- seriously, what is? -- but with hours to go before the final bell, USB sniffer OpenVizsla has exceeded its initial funding goal by more than 400 percent. That's over $70,000 as of this writing, with about 510 backers including Stephen Fry, who was pretty vocal about his support (that must help). If you'll recall, the project -- from iPhone dev team and Twiizers virtuosos pytey and bushing -- aims to make a cheap USB analyzer that can help decode proprietary devices, the popular anecdote being it's the same concept used in the Kinect hack how-to. It's not too late to pledge, of course, and doing so will get you some special goodies. Need more convincing? We're gonna embed Alma the dog's video debut after the break.
