We've seen an orchestra's worth of robotic musicians, but we've yet to see one that integrates this perfectly into a piece without any human intervention. Shimon -- a robotic marimba player created by Georgia Tech's Guy Hoffman (formerly of MIT), Gil Weinberg (the director of the Georgia Tech Center for Music Technology) and Roberto Aimi of Alium Labs -- recently made its stage debut by sensing the music from a piano and reacting accordingly in order to provide complementary percussion. Unlike many alternatives, there's absolutely no delay here. Instead, it analyzes the classification of chords, estimates the human's tempo and attempts to extract features from the human's melodic phrases and styles. What you're left with a robot musician that goes beyond call-and-response and actually meshes with the Earthling's playing throughout. The full performance is posted after the break, and make sure to leave a donation as you exit through the doors on the left.
I think, DCheat, you missed my sarcasm. It's clearly interfacing on some levels with the iMac, and was probably programmed on the aforementioned platform.
Guess I shoulda made my sarcasm more obvious. I just assumed most people would have watched the video and seen the Apple logo all fifteen times it was showed...not a Mac fanboy, but I've had two and thought they were just as lovely as the custom PC I'm writing this from.
Apparently some people don't get it unless you mark off all your remarks with html tags
Sorry to be cynical, but I wonder how creative/random the program actually is.
It could just complete chords in the same key and , but later in the video some "autonomy" is noticable. Impressive even if the timing's off. Version 2.0 will read the expression on player #1's face and hand motions to determine timing.
But then that would be unfair if the competition is a human. Maybe the computer would only be allowed to look 20% of the time. Or maybe there are algorithms to determine the more organic components of music based on timbre, rhythm, etc.
Still, impressive. Maybe one day I'll pick a robot over Esbjorn Svensson Trio for jazz. Well, I hope not.
Sounds horrible, no ? Tech isn't everything. But, as for every new thing, first versions are bad. Ihope this won't be right for music or arts in general... I think you guys at engadget are a little too enthusiastics with this robot... It's no improvisation, the chords are written, only the rythm is adapted live.
Now that we've thrown 'em off the trail, use the form below to get in touch with the people at Engadget. Please fill in all of the required fields because they're required.
posted Apr 26th 2009 5:09PM
That is amazing!
Very very cool, great job robot and humans!
/want one
A little off in a few places...but extremely cool. Its kinda sad that you can computerize improv now. :\
A computer will never replace the finesse of a human's touch
That's what she said!
Pwned, pwned pwned!
Who will compose our smooth jazz?!
Wow! Seriously, wow!
It doesn't seem to be able to vary impact or volume to mesh better with the piano, though, unfortunately. Maybe they're still working on that.
bet its a PC
:)
I bet that's why there's iMacs in the background...
it doesnt make a difference, its about the software...
@ultimatepwnage:
I think you missed the fact that the difference in their argument is, in fact, the software. Thereby making your comment a contradiction to itself.
No qualms, just found it kinda interesting.
I think, DCheat, you missed my sarcasm.
It's clearly interfacing on some levels with the iMac, and was probably programmed on the aforementioned platform.
Guess I shoulda made my sarcasm more obvious. I just assumed most people would have watched the video and seen the Apple logo all fifteen times it was showed...not a Mac fanboy, but I've had two and thought they were just as lovely as the custom PC I'm writing this from.
Apparently some people don't get it unless you mark off all your remarks with html tags
Sorry to be cynical, but I wonder how creative/random the program actually is.
It could just complete chords in the same key and , but later in the video some "autonomy" is noticable. Impressive even if the timing's off. Version 2.0 will read the expression on player #1's face and hand motions to determine timing.
But then that would be unfair if the competition is a human. Maybe the computer would only be allowed to look 20% of the time. Or maybe there are algorithms to determine the more organic components of music based on timbre, rhythm, etc.
Still, impressive. Maybe one day I'll pick a robot over Esbjorn Svensson Trio for jazz. Well, I hope not.
In order to be a man, you need to
(1) puff out your chest
(2) say "Tax Exemption"
(3) acquire a taste for freeform jazz.
I've got the first 2 down, will this help with the last one?
The performance harmony is obviously recorded. The timing is off in many parts... Not exactly impressive on any front.
It may be cool, but it's a far cry from terminators taking over the world...
True...
I doubt terminators will take over the world with marimbas and jazz anyhow.
It would be amazing if they did.
I'll be impressed when I can see this in real life:
http://www.youtube.com/watch?v=JLfBafp03qc
Sounds horrible, no ? Tech isn't everything. But, as for every new thing, first versions are bad. Ihope this won't be right for music or arts in general... I think you guys at engadget are a little too enthusiastics with this robot... It's no improvisation, the chords are written, only the rythm is adapted live.
Pretty cool, but that dude looks like he's going to throw up.