microsoftkinect
Latest
'Untrained Eyes' explores how computers perceive you
If you search for "man" on Google, most of the image results you'll get are of white males looking confidently at the camera. "Woman," meanwhile, brings up pictures of women that appear to have been taken from a male gaze -- and yes, you guessed it, they're also predominately white. That lack of inclusion in machine learning is what "Untrained Eyes," an interactive art installation, aims to shed light on. The project, created by conceptual artist Glenn Kaino and actor/activist Jesse Williams, comes in the form of a sculpture that uses five mirrors and a Kinect to get its point across. Stand in front of it, wave and, within seconds, you'll be presented with an image that will "match" your appearance.
Kinect: Seven years of strange experiments
Kinect is dead. The writing has been on the wall for years, at least since Microsoft de-bundled the motion-tracking system from the Xbox One in 2014, knocking $100 off the price tag and making the system more competitive with the PlayStation 4. The Kinect debuted in 2010 with the Xbox 360, and it had a good run, overall: Microsoft sold roughly 35 million devices in total. However, across its iterations and upgrades, the Kinect never quite found its market -- the one application that would turn the hardware into an essential piece of home technology. It wasn't a conversational, connected, voice-activated system like Google Home or Amazon Alexa, and game developers lost interest in the device as virtual and mixed reality rose to the fore. The Kinect was a product out of time.
Kinect is pretty great at scanning dino bones
When your fancy high-tech tools aren't suited for the job, it's time to call the tinkers. The Field Museum of Natural History had a certain famous Tyrannosaurus rex skull they wanted examined with 3D imaging systems, but their dental scanners couldn't fit around the dinosaur's massive jaw. They contacted MIT Media Lab's Camera Culture group, which scanned the whole five-foot fossil with a $150 makeshift setup featuring a Microsoft Kinect.
MIT mods a Kinect camera to take reflection-free photos
Photos taken through glass, say of the skyscrapers surrounding the one you're in, are often ruined by glare. That's why MIT Media Lab's Camera Culture Group is researching for ways to make a camera that can shoot clear photos through windows. The team developed a system that beams light onto whatever you want to shoot and measures the arrival times and the intensity of light reflected by objects, including glass. They used an ultrafast streak camera for the system's earlier iterations. But for this particular project, they used and modified a device with a depth sensor that's easy to find and buy: a Kinect camera.
New coloring technique creates perfect spots on 3D-printed cat
Hydrographic printing looks like a magic trick. You print a pattern on a see-through film, place that sheet on a tub of water and spray it with a chemical potion. When you immerse a bland 3D object in the tub, it bonds with the film and comes back out covered in chosen colors. This technique is hugely popular for transferring patterns on simple surfaces. But, the system lacks precision. Complex textures that are now common with 3D printers, stretch the film, and sometimes even tear it. The final pattern is often distorted. According to Wired, a group of researchers from Zheijiang University and Columbia University have devised a quirky dip-kit that adds computational capabilities to conventional hydrographics.
Microsoft built a life-size interactive cube powered by Kinect
Third-party developers have grown very fond of building neat stuff with the Kinect, so it's no surprise that Microsoft itself would create projects using this technology. Enter the Cube, a five-sided, Kinect-powered box which can interact with people around it -- the company describes it as a "canvas for a new kind of creative expression" and a "technological sculpture that's a venue for new types of interactive art." You can dance, or make other random body gestures, in front of it and the Cube will project that image onto one of its panels, in a rather colorful way, no less; think of it as what you would see on a game like Just Dance, but minus the layer of flashy outfits. Microsoft's Cube isn't all about the Kinect, however. Inside, there are also five computers and five projectors which, paired alongside a total of four new Kinects, are what make the magic possible. You can watch the Cube in action after the break.
Live from Expand: Microsoft's Bob Heddle (video)
From gaming peripheral to PC input device, Microsoft's Kinect is changing the way we interact with our machines. We'll be speaking to Bob Heddle, director, Kinect for Windows at Microsoft about the device's broadening functionality. We'll also be taking a look at the state of the Kinect for Windows Software Development Kit. March 16, 2013 7:00 PM EDT For a full list of Expand sessions, be sure to check out our event hub.
SuperPop Project develops game for children with motor skills impairments, aided by Microsoft's Kinect (video)
The tools available to therapists tasked with helping children with motor skills impairments improve their range of motion are definitely helpful. But the Human-Automation Systems Lab at Georgia Tech is looking to make said tools even better (specifically for those with cerebral palsy) with the SuperPop Project. With the use of a Kinect and display -- two items that may already be in many homes -- what children will see as a game is actually helping to build upper-arm motor function. The setup is fully customizable on the back end, which allows the therapist to tailor sessions to each patient and to his or her individual progress. During the course of play, the software tracks the coordinates of the user's joints, collecting loads of data for analyzing progression / regression and the like during the course of the rehabilitation. Head on past the break for a quick look at the setup in action.
Hands-on with the first SmartGlass app, Dance Central 3's Party Time DJ
Since getting outed just head of Microsoft's big reveal, Xbox 360's SmartGlass has been under wraps. When Xbox Live VP Marc Whitten officially introduced SmartGlass soon after at E3 2012, we learned a teensy bit more -- tablets and smartphones (Android, Windows Phone 8, and iOS, even) would get second-screen functionality via an upcoming free application -- and got some hands-on time with it. That application has yet to launch, but Dance Central 3's SmartGlass functionality is already here. Well, almost here -- the game becomes publicly available tomorrow, and the app won't launch for a few weeks still -- but we got our hands on Dance Central 3's SmartGlass companion app a bit early at a New York City review event last week. Being the first SmartGlass application to launch has its advantages, such as setting the bar. By no means is Dance Central 3's SmartGlass application a thorough, necessary accompaniment (for a game that already requires Kinect, that's probably a good choice), but it does add some neat side fun for friends waiting in the wings to get their respective grooves on. "Party Time DJ" allows friends -- employing their iOS, Droid, or WP8 tablet/smartphone, via the Xbox SmartGlass app -- to queue up the next song in the game's neverending "Party Time" mode, or create a playlist. They can also queue downloadable tracks to the Xbox 360 (which thankfully requires approval on the 360 prior to purchase), or swap difficulty settings. Sadly, though the opportunity for real-time griefing presents itself rather clearly here, developer Harmonix chose not to allow song-swapping or difficulty changes mid-song. "Because it would kill them," Harmonix rep Nick Chester told us.%Gallery-168336%
Kinect for Windows SDK gets accelerometer and infrared input, reaches China and Windows 8 desktops
Microsoft had hinted that there were big things in store for its update to the Kinect for Windows SDK on October 8th. It wasn't bluffing; developers can now tap a much wider range of input than the usual frantic arm-waving. Gadgets that move the Kinect itself can use the accelerometer to register every tilt and jolt, while low-light fans can access the raw infrared sensor stream. The Redmond crew will even even let coders go beyond the usual boundaries, giving them access to depth information beyond 13 feet, fine-tuning the camera settings and tracking skeletal data from multiple sensors inside of one app. Just where we use the SDK has been expanded as well -- in addition to promised Chinese support, Kinect input is an option for Windows 8 desktop apps. Programmers who find regular hand control just too limiting can hit the source for the download link and check Microsoft's blog for grittier detail.
Akimbo Kinect hack offers precise control with minimal effort (video)
We've seen Microsoft's Kinect used in countless ways, but 3Gear Systems means to better these predecessors with the beta release of its SDK, which turns all the subtleties of hand movement into actions. In addition to using two Kinect cameras for accuracy, the software compares hand poses against a pre-rendered database so gesture commands are executed with little lag. It offers complete control of a virtual 3D environment from the comfort of your natural desk position, so you won't have to worry about flail fatigue after long stints. A free public beta is available now until November 30th, at which point bigger companies will require a license, while individuals and small enterprises will continue to get complimentary access. We know what you're thinking -- it's just another Kinect hack -- but we suggest you reserve judgment til you've seen the demo below, showing examples of how the API could be used for CAD, medical, and of course, gaming applications.
MIT's real-time indoor mapping system uses Kinect, lasers to aid rescue workers
We've seen the Kinect put to use to help you find your groceries, but the sensor's image processing capabilities have some more safety-minded applications as well. The fine minds at MIT combined the Kinect with a laser range finder and a laptop to create a real-time mapping rig for firefighters and other rescue workers. The prototype, called SLAM (for Simultaneous Localization and Mapping) received funding from the US Air Force and the Office of Naval Research, and it stands out among other indoor mapping systems for its focus on human (rather than robot) use and its ability to produce maps without the aid of any outside information, thanks to an on-board processor.
Microsoft permanently lowering Kinect price in the US to $110, slightly reducing it in other parts of the world
Well, it certainly looks like the news of that Xbox Essentials Pack isn't the only thing coming out of Redmond today. As the communicative Major Nelson unequivocally notes, Microsoft's officially dropping down the price of its "You Are the Controller" Xbox 360 add-on in the US to a mere 110 bucks. Additionally, he's also said there's a "permanently reduced" pricing scheme coming to other countries in North America, Latin America and the Asia Pacific regions (save for Japan) where the company's Kinect is available for purchase; meanwhile, folks in the Middle East, Europe and Africa seem to be out of luck for now, since there are no price-slashing plans for the time being.
Microsoft patent applications take Kinect into mobile cameras, movie-making
Microsoft has never been shy about its ambitions for Kinect's depth sensing abilities. A pair of patent applications, however, show that its hopes and dreams are taking a more Hollywood turn. One patent has the depth camera going portable: a "mobile environment sensor" determines its trajectory through a room and generates a depth map as it goes, whether it's using a Kinect-style infrared sensor or stereoscopic cameras. If the visual mapping isn't enough, the would-be camera relies on a motion sensor like an accelerometer to better judge its position as it's jostled around. Microsoft doesn't want to suggest what kind of device (if any) might use the patent for its camera, but it's not ruling out anything from smartphones through to traditional PCs. The second patent filing uses the Kinect already in the house for that directorial debut you've always been putting off. Hand gestures control the movie editing, but the depth camera both generates a model of the environment and creates 3D props out of real objects. Motion capture, naturally, lets the humans in the scene pursue their own short-lived acting careers. We haven't seen any immediate signs that Microsoft is planning to use this or the mobile sensor patent filing in the real world, although both are closer to reality than some of the flights of fancy that pass by the USPTO -- the movie editor has all the hallmarks of a potential Dashboard update or Kinect Fun Labs project.
Kinect Toolbox update turns hand gestures into mouse input, physical contact into distant memory
Using Microsoft's Kinect to replace a mouse is often considered the Holy Grail of developers; there have been hacks and other tricks to get it working well before Kinect for Windows was even an option. A lead Technical Evangelist for Microsoft in France, David Catuhe, has just provided a less makeshift approach. The 1.2 update to his Kinect Toolbox side project introduces hooks to control the mouse outright, including 'magnetic' control to draw the mouse from its original position. To help keep the newly fashioned input (among other gestures) under control, Catuhe has also taken advantage of the SDK 1.5 release to check that the would-be hand-waver is sitting and staring at the Kinect before accepting any input. The open-source Windows software is available to grab for experimentation today, so if you think hands-free belongs as much on the PC desktop as in a car, you now have a ready-made way to make the dream a reality... at least, until you have to type.
Second Story uses Kinect for augmented shopping, tells us how much that doggie is in the window (video)
Second Story isn't content to leave window shoppers guessing at whether or not they can afford that dress or buy it in mauve. A new project at the creative studio uses the combination of a Kinect for Windows sensor with a Planar LookThru transparent LCD enclosure to provide an augmented reality overlay for whatever passers-by see inside the box. The Microsoft peripheral's face detection keeps the perspective accurate and (hopefully) entrances would-be customers. Coming from an outlet that specializes in bringing this sort of work to corporate clients, the potential for retail use is more than a little obvious, but not exclusive: the creators imagine it also applying to art galleries, museums and anywhere else that some context would come in handy. If it becomes a practical reality, we're looking forward to Second Story's project dissuading us from the occasional impulse luxury purchase.
Moving trash can catches your waste, annoys Larry Bird (video)
Just when you thought developments in trash can technology hadn't moved too far since the trusted b-ball backboard accessory, a Japanese genius comes along to raise the bar. Modder FRP has created the Smart Trashbox, a moving can which uses a Kinect to track airborne garbage and make sure you'll never miss another three. Impressively, it appears he designed and built every piece of the puzzle himself, from the motorized wheel base right down to the PCB. We dread to think how much coding this took, given that the Kinect monitors the entire room, calculates trash trajectory and sends the can interception orders. Apparently the accuracy stats don't demand MVP awards just yet, but check out the highlight reel (and more details of the project) after the break.
Mars Rover game hits Xbox Live, tasks you with safely landing the Curiosity with Kinect
NASA has already made it clear that the Curiosity's touchdown on Mars is a nerve-wracking experience, what with the seven minutes of radio silence, zero margin of error and all. To drive that point home, the organization partnered with Microsoft to offer Xbox Live players the experience of controlling the nerve-wracking descent. Starting Monday, you'll be able to download the free Mars Rover Landing, NASA's first Xbox Live game. The title uses the Kinect motion controller to simulate the many phases of landing, including dropping the heat shield and deploying the supersonic parachute, with players' movements controlling the speed and direction of the craft as it approaches the Red Planet. You'll get three scores -- one for each of the landing process -- not to mention some newfound appreciation for what employees at the Jet Propulsion Laboratory will be going through on August 5th.
Winscape virtual window makes the leap to Kinect in 4K-capable, 6-screen glory (video)
RationalCraft brought its surreal Winscape virtual window to market when the Wii was virtually the only game in town for affordable motion tracking. Microsoft's Kinect has certainly changed the rules of the game since then, so it's almost natural that a fourth-generation Winscape has just launched to make use of the much more sophisticated sensor. For a start, there's no need to dress like Flavor Flav anymore: the camera can recognize anyone, even passers-by, without an oversized necklace. The larger-than-life footage used to generate the window effect has been given its own bump, too, and the app can now handle 4K video as long as the Mac underneath (sorry, Windows folks) is powerful enough to drive it. For those who truly want to be disconnected from reality, there's even six-display support provided it's all hooked up to a Mac Pro and a pair of three-output Radeon HD 5770 video cards. RationalCraft's software is free to try out now, although the requirement for at least two big TVs, a Kinect controller and a fast Mac should say all there is to know about the practical cost of pretending the Golden Gate Bridge is visible from inside a living room in Cleveland.
Ben Heck makes Super Glove mod for Kinect, takes strain out of gestures (video)
Sick of trying to control your 360 using Kinect, semaphore and advanced flailing? Modgod Ben Heck, deciding he wanted to be more Minority Report and less lunatic, has been working on Power Glove 2.0 to improve the console's navigation experience. The prototype glove is tricked out with Arduino, an accelerometer, a gyroscope and some fingertip buttons. With the addition of IR and a little coding magic, the 360's interface can be controlled via subtle gestures, with increased functionality / style points also apparent. Check out the latest episode of The Ben Heck Show after the break for a detailed walkthrough of the project and a demo of the glove in action.
