Lip-reading software can identify multiple languages, has big plans for Jupiter
By Paul Miller 
posted April 25th 2009 12:38PM
posted April 25th 2009 12:38PM
Some scientists at the University of East Anglia in England, with aims only for the betterment of humanity, we're sure, have developed lip-reading software that can not only pick up words based on mouth shapes, but can even figure out what language you're speaking -- always a handy thing when understanding speech, we've found. Languages it can identify include English, French, German, Arabic, Mandarin, Cantonese, Italian, Polish, and Russian, and recognition is based on telltale "articulators" of tongue, jaw and lip movement. The software statistically analyzed the face movements of bilingual and trilingual speakers to draw out the specific defining characteristics, and could by used by the deaf, military and police organizations, or by on-board ship computers that fear for their safety and the integrity of the mission.[Via CNET]
this is the FIRST software that can identify lip reading i think
I see what you did there. +1 for getting away with it...so far.
But on topic, guess this mean no more cursing at security cams in the metro.
Yeah, they can arrest you for... oh wait, we have the First Amendment.
(Unless you live in another country)
Besides, why would you curse at cameras in the metro anyways?
when the ticket machine BSODs
F*** Y**
You readin that!
AHAHAH
She had bad surgery, I can still see the stitches.
That picture gives me the creeps
And that's exactly why I'm adblocking it.
You would go all the way to go into the Preferences just to Adblock a picture that you are likely to never see again?
Try this: http://xltronic.com/nostalgia/aphextwin.nu/v4/visuals/covers/i_care_because_you_do.jpg
Fantastic CD, but... the cover is a little off.
Alex, apparently you've never right-clicked an image.
Damn, that picture is pretty freaky
Why so serious? >=)
Feel sorry about that woman. And I thought I had the worst job in the world.
I think so, btw its the SECOND article I read about this lip reading thing.
No, I think the one YOU are thinking about FAILED
WELL, you could be right. that other site had way too many flash game ads i'd already PLAYED on... and won an ipod.
SHUT UP
Oh wait...
;-)
"I can't hear you Dave...is every thing alright?"
My wife says you have a block in your toilet...
LOL.
Do you want to buy some pegs?
we're doomed
Not if we all learn to mime. Then the machines can never find out our plans if we don't write them down...
It looks like they're trying to suck her brain out or something...
Once this gets in the hands of the man, the only people who will have any real freedoms will be the mimes...the most persecuted race on the planet. How ironic is that?
hahahahh +1
Hooray! We're eight years late, but between this and the new government program providing subsidies on giant red LEDs, we're all set now!
Hurrah for UEA! I'm a Language, Linguistics and Translation student there, so this is pretty interesting for me, although we had nothing to do with the Computing Sciences guys developing this. Still, could definitely be useful in terms of translating live video and stuff, which is what we're all about in LLT...
I got a Computer Science degree at UEA 4 years ago - they've been working on this sort of stuff for years. The last major project they did like this was a sign language thing for the post office
Are we talking about the lips above the waist?
What are you, twelve?
She needs some pimple ointment!
How does it deal with ventriloquists?
And suddenly, unisex burqas become all the rage.
No need, I bet it doesn't work when people have beards, so all fundamentalists are covered already.
Dave, although you took thorough precautions in the pod against my hearing you, I could see your lips move.
This reminds me of Mission Impossible 3.....
Take it from someone who has tested at 93% lip-reading accurancy to tell you that this software would at very best be able to recognize 50-70% of lipreading.
I'm surprised that there is no mention whatsoever as to the accurancy of the software, but rather the touting of how well it can identify different languages. It would take several linguistics and speech masters in each and every language to really clearly identify reasonable algorithms for each language to ensure that this program even works with moderate accurancy.
accurancy?
accurancy?
Double post?
Bummers are deaf.
Never a week goes by without another reference to 2001: A Space Odyssey.
It's pretty fitting. We are after all quite good at imagining the future in Sci-Fi books, and then really building it a few decades later. Handheld computers, GPS etc.
P.S. Did you know that the US Army actively researched sci-fi books for interesting ideas a few years back? It's a pretty smart when you consider that the satellite and other interesting concepts were first imagined by sci-fi authors (see Arthur C Clarke).
That's not surprising really, the core of creativity is imagination. If nobody imagines it, it won't get created, as the idea simply does not exist. Imagination and curiosity is what drives human knowledge forward. The old 'What if?'. Which reminds of that really good Honda advert, but I digress.
I wonder how they would translate beat boxing...
Or Bobby McFerrin! "Hello, Mister Skeedily-bop-di-boo-ba-dap-nnt-bo-ba-na-na-na, would you like to view your balance?"
open the pod bay doors please
Nice reference to Sarah Connor Chronicles.
Hopefully this can be brought to personal tech to one day replace
keyboards for text entry. Even if its only in limited application,
it'd be nice to just 'mouth off'' at your laptop or PDA.