PrimeSense talks full-body motion control at GDC, gives us a video demonstration
By Darren Murph 
posted March 11th 2010 2:02AM
posted March 11th 2010 2:02AM
It's important to remember that PrimeSense isn't in the business of creating hardware, but today we were shown a reference design that looks an awful lot like an enlarged webcam. The device is completely USB powered, and while the unit shown in the images and video here was obviously a standalone device, we were told that it would be possible to integrate the solution into displays and the like in the future. They also mentioned that the depth location -- which enables it to map out a room and detect your entire body -- was done on-chip, with only the associated middleware taxing the CPU. Still, they've had success running this on Atom-level processors, so there's certainly no big horsepower hang-up preventing it from hitting up a variety of markets.
More after the break...
Speaking of applications, PrimeSense wasn't able to talk specifics about partnerships (aside from that CyberLink integration announced at CES), but they did say that they're targetting a few areas in particular: home control, boardrooms, presenters and gaming -- and that's just to name a few. In the demo hosted up just past the break, you'll notice that the solution recognizes extremely subtle hand movements, and once it locks on to a user, it won't be bothered with other hand motions from other members in the party until you make the gesture to renounce control; from there, another person can gain control by simply pushing their arm in the direction of the sensor. We even walked in front of the sensor while a user was controlling the screen, and it never lost connection or had any issues with our interfering. The reference box also had a pair of speakers (up to six are supported), and we were told that developers could customize software to recognize sound inputs as well as body movements if they wanted.
One of the most obvious uses here would be to manage one's television; channel changing with hand movements would make quite a few couch potatoes happy, and we could definitely see programs such as Windows Media Center taking advantage of hand swipes as a way to navigate through titles. There's also the traveling salesperson, who could probably wow a few clients by being able to navigate through a presentation by simply moving his or her hands. In theory, at least, this could definitely be used in console or PC gaming (again, think EyeToy if you're having a hard time imagining), but given the amount of possibilities here, we get the feeling that replacing the tried-and-true controller is the least of PrimeSense's worries. Have a peek at the video below to get an idea of how this would work in a living room setting, and feel free to let your imagination run wild soon after. We sure did.
I think this just looks cooler in the movies, or maybe we just need more ambient lighting and a spaceship
Umm... no mention of the similarities to natal?
@doboy Indeed. A comparison to Natal would have been more apt than one to the PS3 Eye. This appears to be using IR time-of-flight, which is the same as what Natal uses.
@doboy I as thinking the exactly same thing. At least with the camera shape.
Is Engadget getting money from Sony these days?
@doboy
That is the absolute first thing I though of when I saw the image.
I can't believe that they didn't mention Natal? The thing looks almost exactly like the Natal "eye" thing.
@nrp
I believe Natal uses dual IR cameras that work as a range finder (building a 3d image with software) and not time of flight. I'm not sure about this device however. Seeing as both cameras on this appear to have different size lenses my best guess is that it is time of flight with a visible light camera making it closer to PlayStation Eye rather than Natal.
I found their site and it seems it uses a time of flight IR camera and a visual light camera for color as I guessed.
http://www.primesense.com/category/product_technology
Natal doesn't do color and instead mimics your movement on a 3d avatar. This is like PlayStation Eye but with an added dimension.
@blakeem Not quite. Natal uses IR time-of-flight for depth along with a visible light camera for color.
@doboy
Scolling down this page, I stopped because I thought it was an article on Natal from the pictures. Definitely a huge likeness to Natal, and it uses the same technology...
@nrp
We are both wrong it seems, Natal is an "amplitude modulated continuous wave".
http://www.newscientist.com/commenting/browse?id=mg20527426.800&page=2
"Our IR does not pulse and it is not based on a TOF system (which usually pulses). Our light source is constant much like you would expect a projection system to work in a conference room."
@doboy
Well, I posted the comment not expecting comparisons about the technological foundations of each technology. I was hoping for Engadget to make some comparisons given their experience with both Natal and now of Primesense.
@blakeem
From what I've read I believe they use structured IR light, not modulated:
http://en.wikipedia.org/wiki/3D_scanner#Structured_light
@grahamj
Confirmed: http://www.primesense.com/category/reference_design
Light Coding = Structured Light
@AlexSanchez
Honestly, get a life dude...
I don't know....they're putting cameras into everything, laptops, cellphones, and now TV's....anyone else feel a weird lack of privacy? I always think someone is spying on me through my laptops webcam.
*glances at his webcam with paranoia*
But honestly if it could easily read your gestures, so you aren't waving your arms around like an idiot just to change the channel, it might be cool.
@SNESimon its rediculous! i smell a lawsuit in 3...2..1.
Cue two siblings gesturing wildly at the TV to change different channels in 3... 2... 1...
@tonicboy
Yeah, this will work oh so well when I'm trying to watch a movie with kids playing in the family room. "No, you changed the channel - throw your brother the other way now!"
@tonicboy This so needs a Youtube video. It should start with one person using gestures to change channels, then another person, then both trying at the same time, and finally it should then turn into a Jackie-Chan-style kung-fu fight, perhaps with some Matrix bullet-time effects.
So this is one of the vendors Microsoft is using in Natal: http://blogs.ft.com/techblog/2009/09/microsofts-natal-secrets-revealed/
Why didn't you ask?
@seanGadget
Honestly ? He's Right .. :)
@seanGadget
Honestly, get a sense of humor dude...
this is some seriously tight technology.
@Seryous
Um, its the same thing, just different software. The article posted by Game_Ender states that MS is using PrimeSense hardware.
@Esteban Jobs
darnit! that was supposed to be a reply to AlienSix
Natal Vs PrimeSense...GO!!!
@AlienSix
Um, its the same thing, just different software. The article posted by Game_Ender states that MS is using PrimeSense hardware.
@AlienSix its the exact same thing
@Delta
I agree..
if this could actually work on any camera i'm sold and i think someone should design a presentation application for this. imagine doing a presentation with just your laptop and the camera it came with and doing open and close hand gestures to navigate around the presentation. then put some face recognition software in there so that your head ends up in the middle of the whole presentation. that would be freakin AWESOME!!
Might just be me... but this seems to actually be more work/labor than using a television remote? wtfmate?
Uh... Project Natal???
And it sounds like they were purposefully over-technical to make you think they were doing something new or different or special. They just do the same as Natal.
And I remember Microsoft saying a long time ago that they want to use Natal in areas other than Xbox... nothing to see here. Move along.
Hollywood called. They want their navigation sounds back.
That was a really crap film...
What's WALL E doing in these pictures?
Oh Snap! Microsoft
This seems weak compared to Natal, but well, we may see this PS4 ^^
@smover 'inside the PS4' I mean, oops.
When that guy asked for the name of the movie my only thought was: voice control! Then a lame keyboard pops up on screen. I guess voice recognition isn't so popular anymore (although OneVoice is really great). Maybe next year it'll come back when motion control gets old ;-)
Although I wonder, why can't we have a mix of those technologies, why is it every year only one or the other? Maybe Natal will change that.
This IS the same as Natal. The company behind this worked on Natal. I surprised there was no mention of this in the article...
Okay second video, is that girl using a remote or just texting? I swear I see her thumbs moving...
Sexin' while Pr0n watching will never be the same.
What happens when you try to get it on in front of the tv?
and your mother Skypes in..
I accidentally in front of my mother.
"I'm sooooooo sorry baby! please! I didn't mean to! You accepted the call when you swung your hand to beat me!"
"Mom! Mom! I can explain!"
Mother has a heart attack...
Serves you right for having kinky crazy sex =P
Even though this is basically the same tech as Natal it is exciting due to the fact that, from what I can tell, its doing all of this natively. Not everyone owns a 360 right (unfortunately for them). I wonder if microsoft ever thought about having skype for use with the 360, talk about exciting.
...So this isn't Project Natal?
I mean, the room in the video looked EXACTLY like the one in the Natal intro video, as does the camera, and the gesture control mechanism.
Am I just slow, or is my confusion justified?
does anyone know when is this product coming out????
Love the N64 "Perfect Dark" sound effects on that 2nd video!