Smart Device Translates American Sign Language To English
Language
Reading Level
Listen to Article
American Sign Language (ASL), has been one of the primary means of communication for the deaf in the United States and many parts of Canada since the 1800s. It is estimated that between 500,000 to 2 million people use the language on a regular basis.
But popular as it is, there are millions of people with normal hearing that do not understand the language. And while most deaf Americans learn to speak with the help of speech therapy, many find it easier to communicate through sign language. Now a team of researchers at the Texas A&M University has created wearable technology that will make it easy for ASL and non-ASL users to converse.
The smart device is the brainchild of a team led by Biomedical Engineering Associate Professor Roozbeh Jafari. It uses two separate sensors to translate intricate ASL gestures into simple English. The first that is fitted with an accelerometer and gyroscope keeps track of the significant movements - the user's hand and arm as he/she tries to communicate.
The second sensor helps distinguish the smaller movements that follow, the larger ones. Called an electromyographic sensor (sEMG), it can recognize various hand and finger movements based on muscle activity. The two sensors working in tandem help provide an accurate interpretation of the gesture.
For example, when an ASL user is gesturing the words “please” or “sorry," the first sensor will pick up the hand drawing circles to the chest, while the second will ascertain if the fist is open ("please") or closed ("sorry").
Once the device that is worn on the user's right wrist has captured the gesture, it transmits the appropriate signals to a laptop via Bluetooth. A complicated algorithm translates them into English and displays the word on the computer screen.
Jafari, who unveiled the prototype at the Institute of Electrical and Electronics Engineers (IEEE) 12th Annual Body Sensor Networks Conference this past June, says there is still some work to be done before the technology can be used in the real world.
For one, it currently recognizes just 40 primary ESL signs, which means that it has thousands more to learn. Also, the smart device only translates one word at a time making ordinary conversations painfully slow.
The research team also realizes that not all communication takes place around a laptop. They hope to eliminate the need for one by incorporating a computer into the wearable. The computer will then send the translation to a smart device, allowing two people "speaking" different languages to have a coherent conversation.
Additionally, each device has to be custom programmed, which means that the individual has to "train" the wearable by repeating every ASL sign a few times. This is a time-consuming process and can only get worse as the translator's vocabulary expands. Jafari hopes to reduce the learning time or eliminate this requirement altogether in the product's next release. Despite the numerous challenges the researcher is not worried. After all, it took his two graduate students just a few weeks to come up with the first impressive prototype.
The Texas team is not the only one working on making conversation between ASL and non-ASL users easier. MotionSavvy has a product that uses a smart device camera to translate gestures into speech. In China, researchers have created a motion sensing device that translates Chinese Sign Language into both spoken and written words. With so many brilliant minds focused on finding a solution, communication difficulties experienced by ASL users may soon be a thing of the past!
Resources: engineering.tamu.edu, smithsonianmag.com
Cite Article
Learn Keywords in this Article
359 Comments
- karatehedgehog4over 2 yearsI'm learning asl cuz I wanna talk to deaf people so they feel included
- summer_beachover 2 yearsThis is so cool!
- lovepeace1over 2 yearsThat would help so many people!
- deafgirlhistoryover 2 yearsI think that could help me, (I`m Deaf) with my hearing realtives!!!
- techfashion0315over 2 yearsOh wow! That would be cool if it would help you.
- deafgirlhistoryover 2 yearsYep! I know! It was just so cool!😎😎😎
- techfashion0315over 2 yearsYeah, I have actually gotten better. I can spell my name and my sister's name!
- deafgirlhistoryover 2 yearsYay! I was so excited for you to learn ASL!!
- techfashion0315over 2 yearsI am too!
- deafgirlhistoryover 2 yearsASL is so cool language that I ever speak of! I think that you`ll enjoy this language!
- techfashion0315over 2 yearsThanks, I think so too. It is a little tricky but once I get it down, I will be bilingual!
- deafgirlhistoryover 2 yearsI`ll help ya!!
- masteremilycoolover 2 yearsAt my school we have lots of deaf and hard of hearing so I know a bit of sign language
- techfashion0315over 2 yearsOh, my gosh! My sister and I are learning ASL because a girl at her work is deaf. This is so cool!
- deafgirlhistoryover 2 yearsHey thanks everyone!! I`m Deaf and I already know ASL but it really hard for me to talk to other hearing people, if you want to talk with Deaf people write it down using paper or your phone. AHHHHH why it always so hard for me???????
- foxes2011jrmover 3 yearsThis is cool and I am learning it !!!!!!!! 😜
- renegade5over 4 yearsCool big help for deaf people
- Sally about 5 yearsgreat way to help those who need it!