Project Natal video hands-on, impressions, and further details
by Joshua Topolsky 
posted Jun 3rd 2009 at 1:03PM
The first thing to note is that Microsoft is very protective of the actual technology right now, so they weren't letting us film or photograph any of the box itself, though what they had was an extremely rough version of what the device will look like (not at all like the press shot above). It consisted of a small, black box aimed out into the room -- about the size of a Roku Player -- with sensors along the front. It almost looked a bit like a mid-size (between pico and full size) projector.
The first demo that we played was a 3D breakout game, where the player is trying to bat a red ball (or in the case of this version, sometimes 10 red balls) toward a line of bricks at the end of a long (virtual) space. The body tracking is truly impressive -- according to Kudo, it's picking up 48 joint points on the human body. As soon as we stepped into line in front of the box, the avatar immediately took on our stance and movements. And we mean really took them on -- little gestures with our arms, the posture we had, front and back movements -- it tracked with complete accuracy. We did notice a bit of stutter during some finer movements, but overall the effect was impressive (and more than a little eerie).
The second demo was actually just a hack of Burnout Paradise, and in some ways was more interesting than the ball swatting. Kudo and his team retrofitted the racing game to take advantage of the Natal, implementing a virtual wheel for steering, and a foot forward or back as the gas pedal. The effect was nothing short of amazing -- the first time we stepped in to play it was immediately natural (save for the part about having to imagine a wheel in your hands). Sure, we wrecked the hell out of a few cars, but it was striking how easy it was to pick up the feel for it. Kudo insinuated that it would be easy for developers to incorporate this tech into pre-existing games, and we have to say, the possibilities are exciting.
After our meeting, we actually had a chance to speak with another source who was able to show us the software guts behind the Natal, so that we could understand the method by which tracking is done. The box uses two sensors for input: a video camera, and an infrared camera (that light you see in the press photo is either power, or some part of the IR setup). The infrared data is used to gauge depth and the video camera movement, but it's the software Microsoft has developed which is really doing the magic. We were shown an example of the raw output of the system, which melds the two sources and then breaks them down into a wireframe of objects, a heatmap (for depth), and a point-map (which is akin to one of those hand imprint needle toys). The software merges all of this together to create a picture of movement in the room, allowing for some pretty crazy detail of what is going on. We watched a chair being dragged into the middle of the playing field, and the software was able to continue to track the human movement, as well as that person sitting down -- it didn't break a sweat. The accuracy is far better than you would imagine it could be; it's very impressive stuff.
Obviously, Microsoft is still working out kinks and perfecting this thing, but what we saw at our demo (and super-secret demo) was mighty convincing. The demo that Sony showed of its new motion controller was interesting, but the fact that Natal is forgoing physical controls of any kind sets your mind reeling. For the other two competitors in this space, Natal could make a very, very strong rival. Ultimately it's up to developers to find truly compelling ways of using this stuff -- though they'd be fools to waste an opportunity like this.
Reader Comments (Page 1 of 7)
l Squid l @ Jun 3rd 2009 1:06PM
looks cool, but idk if i would actually buy it when it comes out.
styrofoam09 @ Jun 3rd 2009 1:09PM
exactly. no one is going to buy this nonsense. it's a cool technology with no REAL practical gaming use
mr nimblewick @ Jun 3rd 2009 1:11PM
People would love it if it were built into the next xbox.
Templarian @ Jun 3rd 2009 1:12PM
Navigating the xbox, and leaning around corners in shooters are the only real effective uses I can see.
Lets give them sometime this thing still needs a bit of work probably, and I'm sure developers will think of ways to integrate it.
Justin @ Jun 3rd 2009 1:15PM
@Styrofoam
You mean like the Wii?
Giles @ Jun 3rd 2009 1:18PM
@Styrofoam09
Yes, because as we all know, the Wii has failed miserably. And Sony isn't jumping on the bandwagon either.
Harkonian @ Jun 3rd 2009 1:25PM
If I don't have to look at the douchy MS guy wearing the Prada sunglasses while inside, I'll buy it.
Paul @ Jun 3rd 2009 1:25PM
The fact that the Wii has sold more than the PS3 and 360 combined (despite having previous gen hardware/graphics and a real-world price that has long been a bit higher than the 360) might clue you in to the fact that this type of natural interface might actually be wanted. Get your ass of the couch and exercise your brains instead of your thumbs for a while and perhaps you'll clue into the potential for this for so many types of games. No, it won't replace the controller, but I guarantee you it'll be one hell of a supplemental input device and will form the basis for a whole new category of games in Xbox land.
Brad @ Jun 3rd 2009 1:32PM
This product isn't targeted at the loner sitting on a couch playing Halo3 for hours on end and shit-talking over the headset. It's meant to be an interactive experience. They are trying to out-Wii the Wii, making a subset of their games approachable and even downright fun for people who don't play videogames normally. Sure, it won't replace the controller for most games, but I can see a whole series of XBLA titles made with Natal in mind coming out.
paulbenjamin @ Jun 3rd 2009 1:33PM
I own a Wii and I could definately say that having this functionality, especially with two young kids, would push me over the top to buying a 360.
maty @ Jun 3rd 2009 1:33PM
My favourite quote of the video:
"It makes no sense to your brain" :)
DirtyVegas @ Jun 3rd 2009 1:35PM
I know I would buy it. Since it can recognize fingers, you don't need buttons. I'm sure a gesture will suffice to point, and a click to shoot.
Or even program the game to recognize some gun you have. It'll be awesome!
PS : Don't use live ammo.
garrenteed @ Jun 3rd 2009 1:36PM
screw evolutionary, try revolutionary.
ash @ Jun 3rd 2009 1:39PM
I'd buy it before the next GTA comes out so I can participate in the next Hot Coffee easter egg...
...if it involves the business from Lost and Damned... *shudder*
Topmounter @ Jun 3rd 2009 1:42PM
It's nice to see that these guys are doing things that will help innovate game-play rather than relying upon eye-candy rewards for mindless button-mashing to sell their systems.
xcrunk @ Jun 3rd 2009 1:45PM
Reason #1 this will FAIL; It's an add-on.
Sorry, but until this thing comes packed-in, as a part of the system, it's just a crappy add-on that developers won't bother publishing for because the installed numbers aren't there, so why bother sinking development costs into something you won't make your money back on.
So dream away, buy it for the 5 games it will be good for, then never use it again. Just like the Wii Fit, soon Motion Plus, and Sony's Motion Sensor.
Gimmicky fucking add-ons. Epic FAILS on every system known to man.
ALBGunner04 @ Jun 3rd 2009 1:47PM
@Giles:
"@Styrofoam09
Yes, because as we all know, the Wii has failed miserably. And Sony isn't jumping on the bandwagon either."
Actually, Sony was one of the first to incorporate this "kind" of technology. The PS2 had the EyeToy, and although nowhere near as advanced as Natal, Sony was actually the first company to come out with such a device for a game console.
Natal looks good though. I also want to see what Sony will do with their motion controller. Seems like the next consoles will be all about motion sensing.
ALBGunner04 @ Jun 3rd 2009 1:52PM
@xcrunk:
Relax man, when these things come out, they won't be incorporated to the system as much as you think. They look like tests for the next-gen consoles, which will most likely fully incorporate this technology. The time is coming where the big three announce their next consoles. Probably next year or the year after most likely.
xcrunk @ Jun 3rd 2009 1:57PM
Sorry techo-brothers, but I think this is worse than you think...
Microsoft KILLS the modern day videogame controller. Controllers ARE DEAD. You heard it here first.
Controllers are BAD, and they're a barrier to the mass market.
So F YOU hardcore gamer with your stupid plastic controllers, in between us and a boatload of ca$h.
Goodbye start and select buttons, sniff....sniff...
lmalave2 @ Jun 3rd 2009 2:06PM
Oh, right, because the Wii Fit can't sell any games.
Umm...the Wii Fit is going to end up being the best selling game of all time, and by a longshot.
I think Microsoft will obviously bundle the controller with some compelling games, and it will generate enough buzz to sell well. I also think the Natal will come bundled with the XBox itself, if not in the Arcade version then definitely in the other versions.
Remember, Nintendo managed to sell massive numbers of Wiis in the first 2 years through buzz alone. If Microsoft puts out something that captures the public's imagination like the Wii did, they won't be able to make these fast enough.
Eric B @ Jun 3rd 2009 2:02PM
@ Harkonian
Learn your sunglass brands those look a lot more like Gucci's then they do Prada's
BURN!!! haha
Mark @ Jun 3rd 2009 2:03PM
"Sorry techo-brothers, but I think this is worse than you think...
Microsoft KILLS the modern day videogame controller. Controllers ARE DEAD. You heard it here first.
Controllers are BAD, and they're a barrier to the mass market.
So F YOU hardcore gamer with your stupid plastic controllers, in between us and a boatload of ca$h.
Goodbye start and select buttons, sniff....sniff..."
Exactly, good bye all those barriers to actual immersion into games. When you have something like this you don't need controllers or buttons, everything you can do with it is far more natural than those. Need to pull a trigger in a game? Instead of pressing "b" you pull an actual trigger.
Pgdn3 @ Jun 3rd 2009 2:12PM
@xcrunk
yea cause guitar hero controllers were just just gimmicky add-ons that didn't catch on.
If they are good games EVERYONE get them.
same thing happened when ddr was popular.
Aaron @ Jun 3rd 2009 2:30PM
@Mark - exactly, or reach for a 'grenade' at your side and throw it! only thing i'm concerned about is movement.... am i seriously going to have to run in place to move forward? Hopefully not... may still need some buttons (or just a nunchuk-esq device) or something. But still, can't WAIT to see what developers will do with this!
mac @ Jun 3rd 2009 3:07PM
yeh but where's the wand - oh yeh, next generation.
this is nowhere near as groundbreaking for gaming as sony's new announcement. merely a project to tide over consumers til their next gen console with wand.
SeNiLe911 @ Jun 3rd 2009 3:30PM
I could see this changing the way we use our entertainment center.
The entertainment center is in standby mode, you walk into the room and it comes to life with Natal greeting you. With no controller or remote you can control everything with a swipe of my hand or the use of voice commands to watch TV, play a movie, play a game, video conference, social network, surf the net, you name it, I see the entertainment center doing it all with no remote or controller one day. That doesn't mean we won't have some type of peripheral to work with it as Sony showed with there motion controller but everything will be more simpler with less remotes and controllers. Very cool stuff but could be a few years before we see Natal in the living room and a few more before it takes over the whole house. It's endless where this could go.
mirakutea @ Jun 3rd 2009 3:45PM
The idea to use games without a controller is golden, it is here to stay even if microsoft somehow fails, someone else will run with it.
ET @ Jun 3rd 2009 4:04PM
With Natal, all you need is to give it the middle finger at your next red ring of death.
Steve @ Jun 3rd 2009 7:07PM
To all those saying they can't see how this would really enhance gaming - think RTS.
No mouse, no fuss, just a gesture controlled map, a pointer that can be projected on to the screen where you're, uh, pointing and, oh yes, voice commands. This could potentially deliver a multi-tasking RTS game that'd let you manipulate the map and issue build orders at the same time. At the very least it could offer a very cool experience when playing that sort of game.
Other examples - interacting with characters in games like Fallout 3, puzzle solving in games like Bioshock, limited head tracking in racing games when using cockpit view (limited as the screen can't move with your head so it needs to be just a relatively small movement) and of course the possibility of actually putting a 'performance' into Rock Band for the whole band.
MetallicAfan @ Jun 3rd 2009 7:35PM
I'm a Sony fan, and i think this is great! I can think of a few games that can use this - an FPS for instance. Pretend to hold a gun and shoot by pretending to click (although will it really be THAT precise)! I wonder how you world move, though.... Another easy one to do is a Star wars game. I mean, think about it, SUPER PRECISE light saber movements. I don't think this might be good for sports games though (even though most people would think it would be good just cause its motion)...
DiGiC @ Jun 3rd 2009 8:42PM
I want one but use a wheelchair, I wonder if I'd be able to control the legs in fighting games. (I'm being serious btw)
Dude looks baked, must've been one hell of a party after the M$ party.
ED @ Jun 3rd 2009 11:02PM
@Templarian
"Navigating the xbox, and leaning around corners in shooters are the only real effective uses I can see."
Only leaning around corners in shooters? haven't you heard of ducking? I don't think you're being creative enough.
Girish @ Jun 4th 2009 3:22AM
Yup, this is the kind of stuff that will make me switch from PS3 to Xbox
Jon Doe. @ Jun 6th 2009 1:42AM
xcrunk,
you know the difference between an addon that fails and one the succeeds? Price, fun factor, and just how revolutionary it is. You are using an outdated rule of thumb where most other addons have been relegated to trash. Look at the 32X, Atari Jaguar's toilet seat, the DD64 (Which never did make it state side.), the PS2 hard drive.
All these and many more were minor addons that did not revolutionize how you interacted with your system in any meaningful way. Natal does this with a tech that, by all accounts, is OUTSTANDING. And keep in mind that you do not need to have games to use this. the GUI in the 360 can be manipulated with this device. Assuming this thing isn't grossly expensive MS will have a damn hard time keeping these things in stock this Christmas assuming its launched by then.
Raptor007 @ Jun 15th 2009 8:29PM
@xcrunk: Hardcore gamers use a keyboard and mouse for shooters, HOTAS stick/throttle for flight sims, etc. Hardcore gamers will not miss gamepads.
Amrosorma @ Jun 3rd 2009 1:08PM
"...but the fact that Natal is forgoing physical controls of any kind sets your mind reeling."
Yeah, but I'd much rather have a couple basic physical controls too.
Eric H @ Jun 3rd 2009 1:26PM
What says you can't?
mrD @ Jun 3rd 2009 1:28PM
But you do....its called the xbox 360 controller or (if it happened)keyboard and mouse,i think everyone included the who wants next gen controls group will be happy,it has both :)
Paul @ Jun 3rd 2009 1:34PM
Nothing is going to prevent developers from also using input from other devices. You could certainly still be holding and using any kind of controller. That's the beauty. This is simply a way of building in a whole new realm of awareness into a game. Your hands/fingers/thumbs are still free to do/hold whatever the heck you need. Imagine a Metal Gear type game where crouching/hiding/jumping/dodging/ducking are all based on your physical movements, but you still get a light gun. Close one eye and you go into scope mode. Etc. Etc. Etc. I wouldn't necessarily want to play an entire MGS single player campaign this way, but it would be awesome for some multi-player fun.
lmalave2 @ Jun 3rd 2009 1:34PM
There's no reason Natal can't also work with controls, For example, instead of just using your fists for a driving game as in the Burnout Paradise example described above, you could actually hold up the XBox controller like a wheel. Also I predict that for shooting games some sort of gun peripheral will be used.
Even though Microsoft is emphasizing the "controller free" aspect of Natal, I think only some avatar-based casual games will truly be controller-free. For more core games like first-person shooters and RPGs I think you'll still have to use peripherals like guns and sword handles. For an FPS, for example, I could see a game using head tracking and maybe leaning forward and back for movement (if the camera is indeed as precise as described above), and then using some sort of very basic gun peripheral for pointing.
Kevin Gass @ Jun 3rd 2009 1:36PM
Just because Microsoft demo'd it as a Controller free device doesn't mean it will be. We know the device knows everything it sees. Whos to say that holding the xbox controller can't become a Bowling Ball, or a Stick become I light-saber? I can't wait to see the possibilities from this. One thing I hate about the Wii is that the thing has Sooooo many controllers, at E3 last year Nintendo said they weren't coming out with any more because they had run outta ideas. Then this year I saw the new pulse reader thing....I was like umm Aprils 1st was a while back guys....
Market Data @ Jun 3rd 2009 2:10PM
Possibilities are infinite. Old limited concept of "gaming" is over.
Add this to Rockband or Guitar Hero and get extra points for how much you dance, or whether or not you play behind your head/back.
Take a fitness class or kung-fu class that recognizes if you're performing the activity correctly. (add a heartrate monitor).
Better yet combine this with a virtual-reality style headset and do whatever you want. Make a virtual SIMS game and sell a 100million Xboxes to girls.
kellogs908 @ Jun 3rd 2009 3:11PM
I don't know because I think this can only mean one thing
Air Guitar Hero
Puggs @ Jun 3rd 2009 3:03PM
To be able to control the system (not just games) with motions is great. Reminds me of Minority Report!
I use my xbox 360 as a media center 50% of the time and a game machine 50% of the time. I would buy this if it would allow me to leave the remote or controller alone!
VictorNYC @ Jun 3rd 2009 3:47PM
@ Amrosorma
with Natal if you want a controller all you have to do is pick up any object since it is working off your body. If holding a stick helps you get into the game more then you could just do that.
mugupo @ Jun 3rd 2009 1:11PM
Is a nice technology, Microsoft just basically test this for 360 out to see if they wanted add this into their next gen.
Taylor. Yes, Taylor. @ Jun 3rd 2009 2:31PM
@Jon If microsoft wants this technology, they will put their full weight behind it to succeed, which means *money*. They will give financial incentives to developers to bring out the installed base, in much the same way that Google gave away 100 million dollars to developers to promote android.
Business isn't some mysterious thing where people make something and hope it succeeds - you promote what you make and create strong partnerships and incentives, because that's how business works. And trust me, Microsoft will do that because they have clearly put a LOT of time into this, they sure as hell won't just let it fail.
-Taylor
Jonathan @ Jun 3rd 2009 1:13PM
return of the red pants!
Pat @ Jun 3rd 2009 1:46PM
best comment
Alvarez @ Jun 3rd 2009 3:01PM
The Red Pants have finally met their match...The Tetris Shirt!