Detection algorithms to enable sign language on-the-go

Sure, texting has taken the entire world by storm and is likely to remain the next best option to actually speaking to someone for quite some time, but for those who feel that keying in paragraphs of information takes a bit too much time, they're looking for alternatives. Designed to assist the mute and deaf (or those who just love the limelight) who rely on cellphones, the MobileASL video compression project seeks to enable sign language over video telephony, even on less-than-speedy data networks. Developed at the University of Washington, the specialized skin detection algorithms are able to key in on critical moving parts (read: hands and fingers) and utilize the limited bandwidth to broadcast the most important vectors first. The ASL encoders are compatible with the H.264 / AVC compression standard, and while it wasn't directly stated just how viable this option was for those stuck on a 1xRTT connection, you can hit the read link to get in on the user studies if you're down with signing.

[Via Slashdot]

[Aaron @ Feb 14th 2007 3:00PM]

Now, instead of blindly looking at your phone, you can stop whatever is going to hit you in the face. Isn't technology amazing?

[andy @ Feb 14th 2007 3:59PM]

Storage is cheap and BW isn't. Why whouldn't you store the motions in the phone, broadcast a code corresponding to the motion to the recipient, and then have the recipient's phone convert the motion into a little icon (or words).

That would save a lot of BW.

I don't really see the point at all though. I guess if you're deaf and talking to someone who is blind (so they can't text but could sign if they knew how) then it would be very helpful to you. Any other combination of handicaps could just text or talk.

[Chris Owens @ Feb 14th 2007 7:19PM]

Are you effing kidding me? It's 2007 and people still call deaf people "mute?"

[Mike @ Feb 14th 2007 11:16PM]

The problem with this is that so much of ASL is dependent on facial expression to convey meaning. Also, many native signers sign very, very quickly.

They must be using an impressive compression technique to be able to capture fast motion signers and not lose video integrity. Some of the success of this also depends on how good the camera/recieving displays are.

[Angela @ Feb 18th 2007 3:15PM]

HELLO! I believe the term "mute" still means "incapable of speaking." And, sign language is commonly used amoung individuals with speech disorders, etc. This is a population of people who are all too commonly forgotten. So, relax! The author of the article was educated enough to acknowledge this group as well as the deaf community could benefit from this technology.