DIY head-tracker takes Wiimote hacking to dizzying new heights

DIY virtuoso Johnny Chung Lee has already more than proven himself with his Wiimote whiteboard and finger-tracking hacks (to say nothing of the famous $14 steadycam), but he now looks to have vaulted himself into a whole new league with his latest project, which uses a Wiimote for a full-on VR head-tracking system. As with his other recent hacks, the Wiimote and a sensor bar substitute swap their usual positions, with a pair of IR-equipped safety glasses stylishly getting the job done in this case. Toss in some custom-made software (available at the link below) and you've got a setup that's sure to make anyone's jaw drop. Whatever you do, be sure to hit up the video after the break (and watch 'till the end), as the image above certainly doesn't do it justice.

[Via Hack a Day]

[mike @ Feb 15th 2008 5:18AM]

First of all, its not HAKCING wtf?
hes not hacking into anything.

what hes doing is THINKING WAAAY OUTSIDE THE DAMN BOX !!!!!!

which is friggin sweet, the games that out kids play are going to blow some minds!

second, hes speaking of minority report because in the movie Tom just uses his hand to control a huge computer screen that displays information on future Crimes.
he just moves his hands to grab new folders. pictures, videos. all he is doing is waving his hands around, and that motion performs so many tasks.
Virtually replacing a Mouse all together

[digiboy @ Feb 29th 2008 2:03PM]

Looks like Sony's stealing Johnny's brilliant idea. http://www.next-gen.biz/index.php?option=com_content&task=view&id=9342&Itemid=2. Hope Johnny gets a cut from Sony's headtracking software sales. ;)

[upin @ Mar 26th 2008 4:51PM]

@skulldriveshaft

I got my 20$ dongle from Walmart to work. Then I found a dongle that you get with My Mii manager, witch I think, works better then the one I bought from the Walmart store. My Mii Manager, I bought from Walmart too. Only available online store.

I could not get the desktopvr to work on vista, or on my wifes xp, and I know nothing about c# or C++ programing.

[Eric Blatt @ Jul 12th 2008 4:46PM]

Just finished setting everything up and I am completely floored. I am amazed! Great Work Mr. Lee!

[funbus @ Feb 25th 2009 7:10PM]

DIY virtuoso Johnny Chung Lee and this is dope... this is first time i've seen this post.

[xxx8sxe @ Dec 21st 2007 5:55PM]

And now, get sued by Mr. Crews

[skulldriveshaft @ Dec 22nd 2007 2:30AM]

What you talking about? Minority Report again?

We're just contributing to the shortage of Wii Remotes :]

And of course Blu Soleil is getting rich because their adapter is the one most referenced for Wii Remote connectivity :]

[mcheddadi @ Dec 21st 2007 5:57PM]

this is EPIC

[Jevanzz @ Dec 21st 2007 6:25PM]

THIS IS SPARTA!

[Deoki @ Dec 23rd 2007 7:42PM]

THE CAKE IS A LIE!!!
THE CAKE IS A LIE!!!
THE CAKE I... oh, wrong thread!

[Rich White @ Dec 21st 2007 5:59PM]

Gotta love these hacks, still waiting for the Mac Wiimote Whiteboard App ! .. Please Johnny ! *LOL*

[ahelk09 @ Dec 21st 2007 5:59PM]

This is ingenious.

[VasR @ Dec 21st 2007 6:00PM]

Great job Johnny. Once again... you never cease to amaze.

[Randavance @ Dec 21st 2007 6:01PM]

Johnny Lee is my hero. I'm leading my school computers club through trying out the whiteboard idea, and this one gives me whole new ideas. He's really unleashed the potential of the Wii mote

[hitjim @ Dec 21st 2007 6:03PM]

that is amazing. what a resourceful guy.

[paul34 @ Dec 21st 2007 6:03PM]

Jesus, this is incredible

[whatishalo? @ Dec 21st 2007 6:04PM]

crazee...was waiting for those targets to come off the screen 3D...

[Randavance @ Dec 22nd 2007 1:53AM]

targets may be one thing, but think of the potential.

If you ever watched the .hack series it was about an MMORPG that the main interface was a controller and a VR goggles. Just think if this was paired with some wearable video glasses people use for ipods with the IR LEDs on the side. You could control where you were looking completely naturally and really immerse yourself in the game.

[tiuk @ Dec 21st 2007 6:06PM]

Johnny is the freaking man.

[ryan @ Dec 21st 2007 6:07PM]

That's awsome. I made this paper dragon that follows you around like that when you close one eye...but this, this takes actual skill! (not to mention it might actually be useful.)

[William @ Dec 21st 2007 6:08PM]

Wow.

[mushrooshi @ Dec 21st 2007 6:08PM]

Trippy.

[CarpeD1em500 @ Dec 21st 2007 6:09PM]

wow...just....wow

I am so excited for the next ten years of my life...

[absurdio @ Dec 22nd 2007 1:31AM]

Yeah. I'll say. For the millionth time in my life: The future is going to be effing awesome.

[Neeko @ Dec 21st 2007 6:10PM]

This could revolutionize gaming. Now if only MS could pay attention. Also could be a reason to buy a wii if i could even find one.

[MMalecky @ Dec 21st 2007 11:31PM]

Don't bother buying one!

All you need to buy is the Wiimote and the glasses with IR LEDs.
And of course, a computer with bluetooth.


For all those not aware, he is running this software on his PC, not on the Wii.
He simply is using the television as an external monitor.

[Ricardo @ Dec 21st 2007 6:10PM]

Nintendo seriously needs to hire that guy.

[pquistgard @ Dec 21st 2007 6:17PM]

absolutely...although he's released it now and it's easy to copy...still, he has the credit
...Patents anyone?

[pquistgard @ Dec 21st 2007 6:14PM]

Wow this might get me into gaming...

As I'm writing this I haven't even seen the whole video yet

That guy's a champ

[Andy @ Dec 21st 2007 6:15PM]

This is incredible.

[Reader @ Dec 21st 2007 6:17PM]

That's so cool, would love to play an FPS like that.

[ethana2 @ Jan 25th 2008 6:19PM]

From your avatar, I judge that that game would be the BEST GAME EVER.

[kelly @ Mar 16th 2008 8:31AM]

Ohhhh the possibilities! I want to see this in the next installment of call of duty!

[tony @ Dec 21st 2007 6:20PM]

immense. that's an incredible little piece of software... if only i could get my wii to stay connected to my macbook in windows. anyone able to tell me why it always disconnects once it goes out of discoverable (flashing blue lights) mode?

[Yoursolace @ Dec 21st 2007 6:49PM]

I am completely in awe. That was amazing, this guy is the best.

I hope someone pays him a lot of money for this stuff, this is amazing!
Someone should hire him while they can!!!

[rumblerjon @ Dec 21st 2007 6:34PM]

now to make those sunglasses into 3d goggles

[Wwhat @ Dec 22nd 2007 4:11PM]

If the display tracks your head then you already have superior 3D, without the headache..

[Seroth @ Dec 21st 2007 6:40PM]

I really hope Nintendo jumps on this idea. MUCH better than their plastic Wiimote holder known as the "Zapper." They'd just need to pack in some IR glasses, Wiimote stand, and an extra Wiimote with a game and it'd be awesome as hell.

[hugoliva @ Dec 21st 2007 6:41PM]

I wanna have your children!!!

[Bombaclaat @ Dec 21st 2007 6:42PM]

Call of duty 4 with head tracking! OMG!

[Neeko @ Dec 22nd 2007 9:12AM]

YES YES YES. Thats exactly what i was thinging. Bring that technology into a game like that and i will spend years playing it over and over again.

[Bombaclaat @ Dec 22nd 2007 4:49PM]

although, I probably would suck even more. lol.

[Ian @ Dec 21st 2007 6:42PM]

You're not exaggerating when you say it's jaw-dropping! The whiteboard, finger-tracking, and especially the head-tracking are beyond way-cool!

[Michael @ Dec 21st 2007 6:52PM]

Title should read "DIY head-tracker takes Wiimote hacking to dizzying new depths." Makes more sense, doesn't it?

[Case @ Dec 21st 2007 7:00PM]

NaturalPoint already makes an optical (Infrared) head tracker called TrackIR. It's in some pretty big sims and games like FSX, Armed Assault, DiRT, and a bunch of others. Even been around before the Wii ;)

[Phi Nguyen @ Dec 21st 2007 8:55PM]

Yeah, but the problem with that computer peripheral is that most games that support it assume that you are sitting in a computer chair and they don't account much at all for z-axis movement. From what I have read about TrackIR, the games that use it tack it on and just use it to change in-car game cameras and first/third person cameras similar to what a mouse/right-analog-stick would typically do in a traditional game. This actually affects the whole image rendering displayed on the screen. Awesome. Just can't imagine how tricky it would be to implement two wii remote/IR sensor bar combos to use this in a FPS shooter. Just the triangulation on both sides would be mind boggling.

[mushyho @ Dec 21st 2007 7:12PM]

but can it play DOOM....in 3D?


(yea im gonna get flamed arent i....)

[james sylvester @ Dec 21st 2007 7:15PM]

thats friggin amazing. ea or someone should give him a job.

[Hailfire753 @ Dec 21st 2007 7:34PM]

EPIC! INSANE! CRAZY! You, Mr.Lee, are AMAZING!

[mike @ Dec 21st 2007 7:58PM]

He's actually already got a pretty good job...

http://www.cs.cmu.edu/~johnny/

So, the real lesson, kids, is...
Don't be a fool,
stay in school!

- Mike
I have to agree he is the man though.. this stuff is awesome!