KinectHack
Latest
Seattle Symphony uses Kinect to conduct robotic instruments
Microsoft might have scaled back its ambitions for Kinect, but creative modders and developers are still finding ways to put the peripheral to good use. Conductor Ludovic Morlot used the device to control three "kinetic" instruments -- a robotic grand piano, 24-reedhorn sculpture and custom concert chimes -- as part of an intimate Seattle Symphony performance on May 1st. During the 22-minute composition, Morlot could start, stop and control the volume of the instruments with gestures. Making a fist in different places let him select the unusual instruments, while waving the other hand up and down would change the amplification. The system was devised by Trimpin, a kinectic sculptor, sound artist and musician, and will remain in the Benaroya Hall so that visitors can try it for themselves. Microsoft seems to have given up on its second-gen Kinect, but mods like this one are a reminder of its untapped potential. Between this concert, a weird musical sandbox and a Nine Inch Nails festival tour, it seems to have a small future in the music industry.
Making music in a Kinect-powered sandbox (video)
Tucked away under a tent at Expand 2014 was perhaps the coolest exhibition on the show floor: Sand Noise Device, a literal interactive sandbox experience. No, this isn't a new Grand Theft Auto; it's powered by hacked gaming tech, though, including an Xbox 360 Kinect sensor and a PlayStation Eye camera. Watching it in action immediately brought memories of Xbox 360 classic Geometry Wars to mind, actually. A ring radiates out from a center origin point, and when it hits the glowing, multicolored pucks (that are tracked for position by the PS Eye), a series of particles start shooting outward.
'Fantasia: Music Evolved' and its origins in the Kinect-hacking scene
The developers at Harmonix aren't afraid to hit the reset button if something isn't working correctly. Chances are, strumming a plastic Stratocaster changed quite a bit before you ever even started playing "Creep" by Radiohead in Rock Band. Same goes for stepping to the beat of Lady Gaga's "Poker Face" in Dance Central, too. That willingness to start from square one time and again? Well, it's carried through to the developer's latest Kinect title, Fantasia: Music Evolved, out now for Xbox 360 and Xbox One, as well. The team's aim, seemingly regardless of project, is for whatever you're doing in one of their titles to seem perfectly obvious and natural.
It costs $50 to plug an Xbox One Kinect into your PC
What's stopping you from creating the first killer Kinect 2.0 hack? Well, now that Microsoft's released the do-all sensor's SDK to the public for free you don't have many more excuses. The software development kit is available without any fees and what's more, you can now put any finished apps up for sale on the Windows Store as well. Just like that! To help developers along even further, Redmond is releasing an adapter that makes the Xbox One Kinect play nicely with a Windows 8 PC. Meaning, they won't have to use a hack to create a hack (or buy a redundant Windows Kinect). The $50 USB 3.0 dongle not only brings price parity between the two previously separate cameras, but it's another instance of Microsoft reversing a previous hardline policy to better suit its customers too. Now, get out there and get cracking -- the hardware giant already has a head start on you. Update: Developer Ubi Interactive, known for large-screen gesture control installations, has posted a trio of brief, new videos demoing some fresh uses for the Kinect 2.0. We've embedded them below.
Akimbo Kinect hack offers precise control with minimal effort (video)
We've seen Microsoft's Kinect used in countless ways, but 3Gear Systems means to better these predecessors with the beta release of its SDK, which turns all the subtleties of hand movement into actions. In addition to using two Kinect cameras for accuracy, the software compares hand poses against a pre-rendered database so gesture commands are executed with little lag. It offers complete control of a virtual 3D environment from the comfort of your natural desk position, so you won't have to worry about flail fatigue after long stints. A free public beta is available now until November 30th, at which point bigger companies will require a license, while individuals and small enterprises will continue to get complimentary access. We know what you're thinking -- it's just another Kinect hack -- but we suggest you reserve judgment til you've seen the demo below, showing examples of how the API could be used for CAD, medical, and of course, gaming applications.
MIT's real-time indoor mapping system uses Kinect, lasers to aid rescue workers
We've seen the Kinect put to use to help you find your groceries, but the sensor's image processing capabilities have some more safety-minded applications as well. The fine minds at MIT combined the Kinect with a laser range finder and a laptop to create a real-time mapping rig for firefighters and other rescue workers. The prototype, called SLAM (for Simultaneous Localization and Mapping) received funding from the US Air Force and the Office of Naval Research, and it stands out among other indoor mapping systems for its focus on human (rather than robot) use and its ability to produce maps without the aid of any outside information, thanks to an on-board processor.
Google Street View goes retro with unofficial ASCII treatment
Nostalgia is a powerful force. It's driven some to search Google through a Bulletin Board System-like interface or, in the case of programmer Peter Nitsch, it's compelled him to graft ASCII art onto the physical world. Simply plug an address into his project's website and you'll be able to pan through an ASCII facsimile of a real-world Street View vista. Leveraging WebGL and Javascript, the system samples the search giant's images and generates text art using the appropriate characters and hues. Nitsch's fondness for retro visualizations don't end there, however, he also created a system that superimposes a gaggle of characters in the wake of a physical paintbrush using a Kinect and a projector. Built as a plugin for the openFrameworks toolkit, the code relies on a GPU for the real-time image conversion and is freely available for tinkering. Hit the source link below to see the modified Street View in action or head past the break for a video of the ASCII painting. For some of the technical nitty-gritty, tap the more coverage link.
Moving trash can catches your waste, annoys Larry Bird (video)
Just when you thought developments in trash can technology hadn't moved too far since the trusted b-ball backboard accessory, a Japanese genius comes along to raise the bar. Modder FRP has created the Smart Trashbox, a moving can which uses a Kinect to track airborne garbage and make sure you'll never miss another three. Impressively, it appears he designed and built every piece of the puzzle himself, from the motorized wheel base right down to the PCB. We dread to think how much coding this took, given that the Kinect monitors the entire room, calculates trash trajectory and sends the can interception orders. Apparently the accuracy stats don't demand MVP awards just yet, but check out the highlight reel (and more details of the project) after the break.
Keio University's Kinect-based Haptic VR system lets you roll your own face flat (video)
A research team at Keio University has built a fun haptic virtual reality system that enables you to manipulate pictures with a rolling pin. A vertically mounted Kinect takes a 3D image that is then displayed on the projection surface. Using the rolling pin, the image can be rolled over and flattened as if it was dough -- with a series of motor cranks inside the implement to replicate the necessary feedback so you can feel what it'd be like to iron out your own face. It's been designed as a modern-day update to the penny-squashing machines you found in theme parks, except with slightly more grotesqueness. You can watch the face-mashing in glorious color after the break.
Scientists train Kinect to follow your tongue wagging
We've seen Microsoft's diverse little Xbox motion controller go on to do a heck of a lot more than the company ever indeed, but up to now, it hasn't really done much to capture the majesty that is the human tongue. Thankfully, a team of researchers at the University of Electro-Communications in Japan are working to right that wrong, developing a system that can detect tongue movements, using the relative positions of a user's eyes and nose. The feature has been demoed with an Asteroids-like shooting game -- stick out your tongue to fire and move it left or right to adjust your aim. The whole thing has some practical applications beyond just making people looking goofy on video -- scientists see it as a way to train the tongue for folks with speech and swallowing disorders, one that doesn't require an unhygienic tongue attachment. Don't worry, you don't have to attach anything to your mouth to watch the video after the break, either.
Microsoft TechForum unveils three research projects (video)
TechForum is a Microsoft-sponsored shindig where the company can get together, party, and then show off its latest and greatest research projects. First up we've got a transparent interactive 3D display which builds on technology from Cambridge University's HoloDesk project. Next is Holoflector, a "magic mirror" that overlays LCD projections onto your reflection. Both of these two projects rely heavily upon Kinect as more projects find the potential in the little sensor. Finally there's Illumishare, a pair of overhead projectors / cameras that share a desktop space with a colleague when you need to look at the same thing. After the break you can see all three concepts in action and you can learn a little more about each at our source links.[Thanks, Lokitoth]
HTML5-based Depthcam puts a fresh spin on Kinect hacks
It's not the first time we've seen HTML5 used in conjunction with a Kinect hack, but George MacKerron's so-called Depthcam takes things to some interesting new levels. It's a live webcam that you can interact with in your web browser (Chrome only, for now). As you might expect, the ability to explore is a bit limited, but you are able to pan and zoom around the scene -- which is certainly impressive enough on its on. You can try it our yourself a the source link below (resources permitting), or get an idea of what it's like in the video after the break.
Kinect and Windows Phone combine to create holographic game engine (video)
If your life is anything like ours, it's in sore need of more pseudo-holographic helicopters. Fortunately, YouTube user programming4fun has come up with a solution, using Microsoft's Kinect beta SDK and a Windows Phone handset. The system, pictured above, basically consists of a Kinect and a 3D engine; the former tracks the position of a viewer and automatically adjusts the image projected by the latter, creating the illusion of a 3D landscape. In this case, that landscape happened to feature a holographic helicopter, which could be controlled using a phone's accelerometer and a Windows Phone 7 app (apparently called HoloController). Watch it in action, after the break.
Agile Route's Shopper Tracker brings Kinect hacks, Google Analytics to the grocery aisle (video)
The Shopper Tracker is one of those devices that does exactly what its name suggests -- and so much more. Developed by Argentina's Agile Route, this Kinect hack uses an array of heat sensors and 3D spatial recognition software to track a consumer's movements and behavior within any brick and mortar retail outlet. These data can then be used by a store owner to find out which shelves and items are appealing to customers, effectively adding a Google Analytics-like dimension to their product displays. The system is also capable of tracking multiple people at once, and can even provide feedback on which products consumers actually pull from the shelves. According to the company, this type of analysis can result in obvious strategic benefits for merchants, while reminding the rest of us that we're totally predictable. Check it out in action, after the break.
SandyStation interactive sandbox uses Kinect to make topography much more interesting (video)
If you're not really into using your Kinect experiment to launch your new startup or give your next presentation, let us offer another entertaining option. Two students at the University of West Bohemia in Pilsen have created an interactive sandbox using Kinect, a projector, a computer and, of course, a box chock full of sand. The Xbox motion / depth detector is installed about two feet above the sand pit to measure each area that is carved out. Using a unique detection program, the topographical information is then transmitted to a data projector that renders an image in the sandpit -- the image being a color based on the height or depth of what has been created. The devs have built out a few different projections. Hills that are constructed by the user are assigned a shade of green based on height, while troughs are given blue hues according to depth. What's that? You built a hill and dug out the center? The projector sees that as a volcano, complete with spewing lava. If you're tired of SimCity and want to actually get your hands dirty, take a peak at the video just past the break. [Thanks, Mark]
Turn your Kinect hack into a startup with Microsoft's Accelerator program
Wanna turn your Kinect hack into, um, money? Microsoft can help you out, now that it's teamed up with TechStars to launch the Kinect Accelerator -- a program designed to turn Kinect-based ideas into real world startups. To participate, innovators must first apply to the Accelerator before the January 25th deadline. Ten applicants will then be accepted to a three-month incubation program, and rewarded with $20,000 in seed money. To participate, however, you'd have to relocate to Seattle for the duration of the program, scheduled to kick off this Spring. Plus, if you manage to bring your company to market, you'll have to set aside a six percent common stock stake for TechStars, which is both funding and spearheading the initiative. For more details on how to apply, hit up the source link below.
My Keepon: Kinect-ing hackers and goths through the art of dance (video)
If rhythm is a dancer, then My Keepon is a goth. The adorable, Snowman-like (yellow snow, in this case) bot just recently received a wallet-friendly retail debut, so join us in the not-surprised-to-see-this-get-a-Kinect-hack (by way of Arduino) camp. Granted, the lil' guy's moves may be stilted, but he's clearly not the star of this YouTube show. We were more impressed with his gesture-cuing Gepetto's discotheque living room get down. So, do you think you can dance to industrial music and mod this $35 holiday hot toy? Then clearly you need to hit up the source for all the necessary coding bits. But first, be sure to take a gander at the industrial grind after the break.
Kinect BeatWheel hack makes you do the windmill
Running out of avant garde ways of making music? Then perhaps this BeatWheel hack for Kinect, made at a recent Music Hackday in Boston, will give you some fresh ideas. Music samples are separated into eight segments, which encircle the user like a clockface. You then control which part plays by waving your hands around like a severely caffeinated Bernstein. Check out the shadowy BeatWheel demo after the break.
Kinect hack makes presentation slides work around you (video)
What's the scariest thing about presentations? Getting the perfect angle. You know, the point on stage where you can wave at your slides without blocking the projector bulb or your audience's view. Thankfully, Haruki Maeda from Meiji University is gonna show your text and graphics who's the boss. He's knocked up presentation software that can sense where you stand and orders the text into the visible space around you. Transitions are handled with gestures and you can even pinch-to-zoom live on stage. If you'd guessed there was some Kinect magic at the heart of it, well, thanks for reading the title. The modest Mr. Maeda says all it took was some C#, the Kinect SDK and an Excel spreadsheet to get this beauty working. You don't even need to do that if you're curious yourself -- just go and watch the video we've got after the break.
How The Gadget Show built its FPS simulator (video)
Remember The Gadget Show's FPS simulator that we showed you last week? Armed with naught but a pre-release level of Battlefield 3 and £500,000 ($650,000), it transformed a Birmingham studio into the sort of game room only multi-billionaires can dream of (as long as the dreams involved getting shot back, the sim comes packing paintball markers). The episode, which shows how this slice of gaming greatness came to be, has just finished airing here in the UK, where streaming and catch-up services aren't available to those outside the country. Fortunately for you lot, our friends at the show have uploaded the feature for you to watch in all its glory after the break.
