kinect-hack
Latest
MarionetteBot is a frightening fusion of Kinect and mannequin
Japan has found new heights (depths?) of creepiness today with the United Arrow Marionettebot, a custom Kinect hack pairing Microsoft's motion-tracking camera with display mannequins.The mannequins of United Arrow's clothing store mimic the poses and movements of passersby. It's billed as a marketing effort in the video above, despite being the stuff of nightmares.
Akimbo Kinect hack offers precise control with minimal effort (video)
We've seen Microsoft's Kinect used in countless ways, but 3Gear Systems means to better these predecessors with the beta release of its SDK, which turns all the subtleties of hand movement into actions. In addition to using two Kinect cameras for accuracy, the software compares hand poses against a pre-rendered database so gesture commands are executed with little lag. It offers complete control of a virtual 3D environment from the comfort of your natural desk position, so you won't have to worry about flail fatigue after long stints. A free public beta is available now until November 30th, at which point bigger companies will require a license, while individuals and small enterprises will continue to get complimentary access. We know what you're thinking -- it's just another Kinect hack -- but we suggest you reserve judgment til you've seen the demo below, showing examples of how the API could be used for CAD, medical, and of course, gaming applications.
MIT's real-time indoor mapping system uses Kinect, lasers to aid rescue workers
We've seen the Kinect put to use to help you find your groceries, but the sensor's image processing capabilities have some more safety-minded applications as well. The fine minds at MIT combined the Kinect with a laser range finder and a laptop to create a real-time mapping rig for firefighters and other rescue workers. The prototype, called SLAM (for Simultaneous Localization and Mapping) received funding from the US Air Force and the Office of Naval Research, and it stands out among other indoor mapping systems for its focus on human (rather than robot) use and its ability to produce maps without the aid of any outside information, thanks to an on-board processor.
Google Street View goes retro with unofficial ASCII treatment
Nostalgia is a powerful force. It's driven some to search Google through a Bulletin Board System-like interface or, in the case of programmer Peter Nitsch, it's compelled him to graft ASCII art onto the physical world. Simply plug an address into his project's website and you'll be able to pan through an ASCII facsimile of a real-world Street View vista. Leveraging WebGL and Javascript, the system samples the search giant's images and generates text art using the appropriate characters and hues. Nitsch's fondness for retro visualizations don't end there, however, he also created a system that superimposes a gaggle of characters in the wake of a physical paintbrush using a Kinect and a projector. Built as a plugin for the openFrameworks toolkit, the code relies on a GPU for the real-time image conversion and is freely available for tinkering. Hit the source link below to see the modified Street View in action or head past the break for a video of the ASCII painting. For some of the technical nitty-gritty, tap the more coverage link.
Moving trash can catches your waste, annoys Larry Bird (video)
Just when you thought developments in trash can technology hadn't moved too far since the trusted b-ball backboard accessory, a Japanese genius comes along to raise the bar. Modder FRP has created the Smart Trashbox, a moving can which uses a Kinect to track airborne garbage and make sure you'll never miss another three. Impressively, it appears he designed and built every piece of the puzzle himself, from the motorized wheel base right down to the PCB. We dread to think how much coding this took, given that the Kinect monitors the entire room, calculates trash trajectory and sends the can interception orders. Apparently the accuracy stats don't demand MVP awards just yet, but check out the highlight reel (and more details of the project) after the break.
Keio University's Kinect-based Haptic VR system lets you roll your own face flat (video)
A research team at Keio University has built a fun haptic virtual reality system that enables you to manipulate pictures with a rolling pin. A vertically mounted Kinect takes a 3D image that is then displayed on the projection surface. Using the rolling pin, the image can be rolled over and flattened as if it was dough -- with a series of motor cranks inside the implement to replicate the necessary feedback so you can feel what it'd be like to iron out your own face. It's been designed as a modern-day update to the penny-squashing machines you found in theme parks, except with slightly more grotesqueness. You can watch the face-mashing in glorious color after the break.
Scientists train Kinect to follow your tongue wagging
We've seen Microsoft's diverse little Xbox motion controller go on to do a heck of a lot more than the company ever indeed, but up to now, it hasn't really done much to capture the majesty that is the human tongue. Thankfully, a team of researchers at the University of Electro-Communications in Japan are working to right that wrong, developing a system that can detect tongue movements, using the relative positions of a user's eyes and nose. The feature has been demoed with an Asteroids-like shooting game -- stick out your tongue to fire and move it left or right to adjust your aim. The whole thing has some practical applications beyond just making people looking goofy on video -- scientists see it as a way to train the tongue for folks with speech and swallowing disorders, one that doesn't require an unhygienic tongue attachment. Don't worry, you don't have to attach anything to your mouth to watch the video after the break, either.
Microsoft TechForum unveils three research projects (video)
TechForum is a Microsoft-sponsored shindig where the company can get together, party, and then show off its latest and greatest research projects. First up we've got a transparent interactive 3D display which builds on technology from Cambridge University's HoloDesk project. Next is Holoflector, a "magic mirror" that overlays LCD projections onto your reflection. Both of these two projects rely heavily upon Kinect as more projects find the potential in the little sensor. Finally there's Illumishare, a pair of overhead projectors / cameras that share a desktop space with a colleague when you need to look at the same thing. After the break you can see all three concepts in action and you can learn a little more about each at our source links.[Thanks, Lokitoth]
HTML5-based Depthcam puts a fresh spin on Kinect hacks
It's not the first time we've seen HTML5 used in conjunction with a Kinect hack, but George MacKerron's so-called Depthcam takes things to some interesting new levels. It's a live webcam that you can interact with in your web browser (Chrome only, for now). As you might expect, the ability to explore is a bit limited, but you are able to pan and zoom around the scene -- which is certainly impressive enough on its on. You can try it our yourself a the source link below (resources permitting), or get an idea of what it's like in the video after the break.
Kinect and Windows Phone combine to create holographic game engine (video)
If your life is anything like ours, it's in sore need of more pseudo-holographic helicopters. Fortunately, YouTube user programming4fun has come up with a solution, using Microsoft's Kinect beta SDK and a Windows Phone handset. The system, pictured above, basically consists of a Kinect and a 3D engine; the former tracks the position of a viewer and automatically adjusts the image projected by the latter, creating the illusion of a 3D landscape. In this case, that landscape happened to feature a holographic helicopter, which could be controlled using a phone's accelerometer and a Windows Phone 7 app (apparently called HoloController). Watch it in action, after the break.
Agile Route's Shopper Tracker brings Kinect hacks, Google Analytics to the grocery aisle (video)
The Shopper Tracker is one of those devices that does exactly what its name suggests -- and so much more. Developed by Argentina's Agile Route, this Kinect hack uses an array of heat sensors and 3D spatial recognition software to track a consumer's movements and behavior within any brick and mortar retail outlet. These data can then be used by a store owner to find out which shelves and items are appealing to customers, effectively adding a Google Analytics-like dimension to their product displays. The system is also capable of tracking multiple people at once, and can even provide feedback on which products consumers actually pull from the shelves. According to the company, this type of analysis can result in obvious strategic benefits for merchants, while reminding the rest of us that we're totally predictable. Check it out in action, after the break.
SandyStation interactive sandbox uses Kinect to make topography much more interesting (video)
If you're not really into using your Kinect experiment to launch your new startup or give your next presentation, let us offer another entertaining option. Two students at the University of West Bohemia in Pilsen have created an interactive sandbox using Kinect, a projector, a computer and, of course, a box chock full of sand. The Xbox motion / depth detector is installed about two feet above the sand pit to measure each area that is carved out. Using a unique detection program, the topographical information is then transmitted to a data projector that renders an image in the sandpit -- the image being a color based on the height or depth of what has been created. The devs have built out a few different projections. Hills that are constructed by the user are assigned a shade of green based on height, while troughs are given blue hues according to depth. What's that? You built a hill and dug out the center? The projector sees that as a volcano, complete with spewing lava. If you're tired of SimCity and want to actually get your hands dirty, take a peak at the video just past the break. [Thanks, Mark]
Turn your Kinect hack into a startup with Microsoft's Accelerator program
Wanna turn your Kinect hack into, um, money? Microsoft can help you out, now that it's teamed up with TechStars to launch the Kinect Accelerator -- a program designed to turn Kinect-based ideas into real world startups. To participate, innovators must first apply to the Accelerator before the January 25th deadline. Ten applicants will then be accepted to a three-month incubation program, and rewarded with $20,000 in seed money. To participate, however, you'd have to relocate to Seattle for the duration of the program, scheduled to kick off this Spring. Plus, if you manage to bring your company to market, you'll have to set aside a six percent common stock stake for TechStars, which is both funding and spearheading the initiative. For more details on how to apply, hit up the source link below.
My Keepon: Kinect-ing hackers and goths through the art of dance (video)
If rhythm is a dancer, then My Keepon is a goth. The adorable, Snowman-like (yellow snow, in this case) bot just recently received a wallet-friendly retail debut, so join us in the not-surprised-to-see-this-get-a-Kinect-hack (by way of Arduino) camp. Granted, the lil' guy's moves may be stilted, but he's clearly not the star of this YouTube show. We were more impressed with his gesture-cuing Gepetto's discotheque living room get down. So, do you think you can dance to industrial music and mod this $35 holiday hot toy? Then clearly you need to hit up the source for all the necessary coding bits. But first, be sure to take a gander at the industrial grind after the break.
Kinect BeatWheel hack makes you do the windmill
Running out of avant garde ways of making music? Then perhaps this BeatWheel hack for Kinect, made at a recent Music Hackday in Boston, will give you some fresh ideas. Music samples are separated into eight segments, which encircle the user like a clockface. You then control which part plays by waving your hands around like a severely caffeinated Bernstein. Check out the shadowy BeatWheel demo after the break.
Kinect hack makes presentation slides work around you (video)
What's the scariest thing about presentations? Getting the perfect angle. You know, the point on stage where you can wave at your slides without blocking the projector bulb or your audience's view. Thankfully, Haruki Maeda from Meiji University is gonna show your text and graphics who's the boss. He's knocked up presentation software that can sense where you stand and orders the text into the visible space around you. Transitions are handled with gestures and you can even pinch-to-zoom live on stage. If you'd guessed there was some Kinect magic at the heart of it, well, thanks for reading the title. The modest Mr. Maeda says all it took was some C#, the Kinect SDK and an Excel spreadsheet to get this beauty working. You don't even need to do that if you're curious yourself -- just go and watch the video we've got after the break.
How The Gadget Show built its FPS simulator (video)
Remember The Gadget Show's FPS simulator that we showed you last week? Armed with naught but a pre-release level of Battlefield 3 and £500,000 ($650,000), it transformed a Birmingham studio into the sort of game room only multi-billionaires can dream of (as long as the dreams involved getting shot back, the sim comes packing paintball markers). The episode, which shows how this slice of gaming greatness came to be, has just finished airing here in the UK, where streaming and catch-up services aren't available to those outside the country. Fortunately for you lot, our friends at the show have uploaded the feature for you to watch in all its glory after the break.
Microsoft HoloDesk: when you need to juggle something that isn't there (video)
If you'd thought that OmniTouch and PocketTouch were the end of Microsoft Research's natural user interface projects, think again. It's now released a video of the HoloDesk, a tool that lets you manipulate virtual 3D objects with your bare hands. Looking through a transparent display, the objects react nearly instantly, rolling from a sheet of real paper into a real cup and falling into shadow if you block the virtual light-source. The Cambridge lab that developed the tool sees uses in remote working, collaboration or device prototyping. If you hadn't guessed, there's a hacked Kinect at the heart of HoloDesk's DNA, which makes us wonder how long it'll be before we can use it to play Halo.
The Gadget Show builds an FPS simulator that shoots back (video)
Racing simulators are ten a penny, but the closest an FPS player will get to an immersive experience is buying some branded peripherals. Armed with a pre-release level of Battlefield 3, The Gadget Show enlisted a team of design experts to transform a Birmingham studio into an FPS simulator costing £500,000 ($650,000). A four by nine meter video dome surrounds the player as they stand on an omni-directional treadmill that lets you walk wherever you want to go. Ten infra-red motion tracking cameras and a sensor on your gun enables the picture to follow where you point it and a Kinect hack controls your jumping and crouching. The fun doesn't stop there -- 12 paintball markers mean that every time you get shot in the game, you'll feel it. The show airs in the UK on October 24th at 8:00pm, Channel 5. We've got a behind the scenes gallery below (supplied by those lovely people from the show) as well as PR and a trailer after the break. %Gallery-136970%
Kinect hack lets you manage your bank account with gestures, will occupy your living room (video)
You know all those convoluted gestures and hate-infused fist pumps you make every time you look at your bank account? Well, you can now put them to good use, thanks to a new Kinect hack from Lithuania-based Etronika. The company's software, which made its debut at last week's CTIA E&A event, effectively brings motion-controlled banking directly to your living room. All you have to do is stand in front of your display, clap your hands to choose an icon, or wave your hand back and forth to navigate across the app's carousel menu. This means you can pay your bills, check your balance and return to fetal position without even touching a sharp object. "A lot of banking software apps are filled with boring crap," Etronika CEO Kestutis Gardziulis explained with refreshing candor. "With our software, you could be on the couch at home, having a beer, all while dealing with your bank account and kicking back." Beer, banking and body language -- sounds scandalous! Head past the break to watch a demo video, starring Pam Beesly's doppelgänger.
