You are here: Home » PTI Stories » International » News
Business Standard

Device that translates sign language into text for deaf

Press Trust of India  |  Washington 

Researchers have developed a novel computer system that enables deaf people to translate gestures used in sign language into text.

Using the new technology, people who are deaf or hard of hearing can simply type words and sentences using a keyboard and read those typed to them, researchers said.

Researchers Microsoft Asia and the Institute of Computing Technology at the Chinese Academy of Sciences in this latest effort turned to Microsoft's Kinect device.

They showcased the software that has been developed for the Kinect that successfully translates American Sign Language (ASL) into text, Phys.Org reported.

The system operates in two modes: The first, called simply Translation Mode, translates physical hand or body movements into text or speech.

The second, called Communication Mode, allows a person speaking in ASL to communicate with someone else who is communicating in typed English.

The system uses an Avatar to translate text coming from someone typing text on a keyboard, then converts their response to text and sends it back to the other person.

The demonstration by researchers showed that the system is capable of translating sentences, not just words, a significant step forward.

The researchers stressed that their system is still a work in progress but hope to eventually create a system that is fully functional and reasonably inexpensive.

Researchers said that would mean a Kinect based communication system that operates entirely with hand gestures and spoken words - all in real time. Also, it would allow for conversion to other sign language dialects as well.

Dear Reader,


Business Standard has always strived hard to provide up-to-date information and commentary on developments that are of interest to you and have wider political and economic implications for the country and the world. Your encouragement and constant feedback on how to improve our offering have only made our resolve and commitment to these ideals stronger. Even during these difficult times arising out of Covid-19, we continue to remain committed to keeping you informed and updated with credible news, authoritative views and incisive commentary on topical issues of relevance.
We, however, have a request.

As we battle the economic impact of the pandemic, we need your support even more, so that we can continue to offer you more quality content. Our subscription model has seen an encouraging response from many of you, who have subscribed to our online content. More subscription to our online content can only help us achieve the goals of offering you even better and more relevant content. We believe in free, fair and credible journalism. Your support through more subscriptions can help us practise the journalism to which we are committed.

Support quality journalism and subscribe to Business Standard.

Digital Editor

First Published: Sun, July 21 2013. 16:35 IST
RECOMMENDED FOR YOU