DeepNote Guitar Hero bot 'watches' the game, rocks you within an inch of your life
We've seen a lot of Guitar Hero bots in our time, but we're pretty certain that Mechanized Rock's take on shredding automatons is something special. The system -- dubbed DeepNote -- actually watches the on-screen action with "eyes" that it uses to analyze notes, which the bot then plays in real-time. Using photodiodes aimed at the screen, the components pick up changes in light within eight nanoseconds, then convert that information to brazen, parent-shocking, full-throttle rock n' roll. As you well know, pictures say a thousand words (and video is prone to run-on sentences), so watch DeepNote in action in the clip after the break.



















Bah, missing too many notes. :P
STAR POWER FULL
That proves very little. He's unable to make much more than a 50 note streak before failing. No star power use yet, no use of the whammy bar either. It's a simple bot, falls with all the other Guitar Hero bots if you ask me.
I bet it plays better than any of you.
Are you guys watching the same video? Cause I saw only 2 notes missed in the "Notes hit" section at the end (out of 1300 or so). Maybe you should have a second look. Also they had a 640 note streak near the end.
Pretty impressive if you ask me.
Are you insane? There was a 640 note streak.
What do you mean, no use of star power? The bot uses it during the solo in CoP.
I've heard three so far, and it even fired off one note before the guitar notes started coming.
Those aren't all missed notes.
It's overstrumming. Yeah, it's annoying, but they're not all misses, they're extra strums because the photodiode is registering a note when it shouldn't be. Since the characters use such wildly varying fretboards, that's going to be a hard hill to conquer. Still a very impressive bot. :D
Watch the video and reword your comments, IDIOT FAIL
Hey, Deepnote is actually doing really well. The video posted here is very old. Here is the most recent video http://youtube.com/watch?v=vyK1uX14LwY
Also, here is the ustream, http://www.ustream.tv/channel/deepnote-guitar-hero-bot
A robot should get 100% every time. 640 note streak is nothing to that video of that guy playing Through the Fire and Flames and getting 100%, 2000+ streak FTW.
Still, that's cool.
It's still pretty cool. (This is probably a double post)
Impressive.
pretty cool, although i'm not sure if this has any practical usefulness.
thats what the terrorists want you to think.
i hate my life
go an hero
i love my life
All your cries for help are keeping me from my Guitar Hero news. Have some compassion for the next man.
I could melt its face off on xbl.
Very cool none the less!
I like the music more...
(Sorry, I didn't intend a reply.)
I love the play on The Hitchhiker's Guide supercomputer with DeepNote (instead of DeepThought). Very well played (pun intended).
I'm pretty sure its more about Deep Blue the supercomputer.
http://www.thebestpageintheuniverse.net/c.cgi?u=puns
Deep Note is the name of THX's audio logo, a distinctive synthesized crescendo sound.
Call me when it gets arms and uses a standard controller.
it does use a standard controller, go look the pictures on the website.
A robot that can detect colors and send signals accordingly?
THIS IS INCREDIBLE!
lol yeah i know..
i actually halfway made this exact thing in the beginning of September.. cept it was only 1 note and strummed (sad face).. then i ran out of money and time because in college and never finished it
i still have it in a box somewhere.. ill sell it to someone w/ a square 23 inch samsung LCD TV (only one it will fit on lol)
took me about 2 weeks to get it up and running. the problem w/ them getting inaccurate hits is from restrumming notes, i had the same problem.. its coz of the pattern on the guitar under the notes + the white horizontal lines making a big enough change to make the bot to strum. and also from the lightening bolt that comes down when you get starpower
Sadly it doesn't even have to recognize colors since there are 5 photo resistors set up, so all it really has to do is detect light or not. A much more impressive feat would be pointing a video camera at the screen and using it as an "eye" to locate and press the notes in the way a human brain would. This could actually be a reasonable research project, analysis of the effect of "muscle memory", effects of the rhythm (if sound were to be included in the apparatus), and response time could all be examined. So from a computer and cognitive science perspective there are good projects to be done here that could advance the field, this just isn't it ;).
but can it play Crysis?
seriously. that would be impressive.
Can you play Crysis ?
Seriously, that would be impressive.
when they release it for mac, or i install windows, i'll let ya know ;)
I can play crysis
My computer doesn't suck, but it's also not super powerful
Awesome, though the real test is if it can do Through the Fire and Flames on expert with hyperspead on. Then I'll be amazed.
Just to be sure, you know that hyperspeed doesn't actually make playing GH harder, right?
All it does is change the speed at which the notes fly by. It doesn't actually make the song faster.
Some people (myself included, Hyperspeed on 2) actually prefer hyperspeed on because it makes big note runs easier to read.
I don't think it would matter for this robot, though.
I'm one of the creators, and it has done that...with 99% accuracy. There is a video of it the same youtube profile.
I am also one of the creators and while Jeremy wasn't here yesterday it got 100% on TTFAF in practice mode on expert.
I like the PurePwnage GH cheating solution better, but they started out like DeepNote though.
This is terrible. No wonder I keep getting beat. I knew there was a reason.
I find it funny that it can get the solos 100%, but it can't the simple parts 100%.
Other than that this is pretty neat. I had the idea a whil agao but never got around to doing it. It looks like they beat me :)
Some people would do anything for gamer points...
i would love to see one that could play the buttons just so i could hear that nostalgic plastic clicking noise.
When the day of robot apocalypse comes, humanity will quake in fear before the might of a machine that can press five colorful buttons really, really fast!
No seriously... that's quite impressive. It seems that going into Star Power doesn't affect the accuracy of the photo sensors, which is pretty cool. On that note... how does the bot activate Star Power as seen in the vid?
This is a much older video so we were activating star power for it. The newer version of the bot has a built in auto-starpower function which can be turned on or off with a switch mounted onto the front of the guitar. Auto-whammy can be controlled the same way.
>pictures say a thousand words (and video is prone to run-on sentences)
Love it! Engadget's writers are the sharpest around, and little gems like this bring a smile to my face.
I'm just amazed that the grammar and spelling are correct this time... Most posts have all kinds of errors in them.
Hey, Deepnote is actually doing really well. The video posted here is very old. Here is the most recent video http://youtube.com/watch?v=vyK1uX14LwY
Also, here is the ustream, http://www.ustream.tv/channel/deepnote-guitar-hero-bot
great, now do IIDX.
That's my type of Electrical Engineering Senior Project.
FYI the bot FCed TTFAF on expert in practice mode today. It was on Ustream.
NERDS!!!!!!!!!!!!!!!!!!!!!
I'm going to speak for the team and say thank you for the compliment. It's healthy to use brain power to solve problems, even if they seem impractical in the long run, it's an exercise for the mind in terms of problem solving, building, increasing efficiency, and smoothing out a picture that comes wrinkled.
Uh oh. Robot invasion.
That was so shitty. They used cadnium sulphite photoresistors. Big deal. It's already been done before.
Actually, you're completely wrong. We used photodiodes which have a much faster response time over their photoresistor brethren. There are zero photoresistors attached to our robot. It's clearly stated on our website MechanizedRock.com on the "How It Works" page (http://mechanizedrock.com/how-it-works/). The initial post ALSO clearly states that they are not photoresistors, clearly you read the short paragraph explaining our device. I thank you for responding without any sense whatsoever.