IIIT-H students develop web plugin to translate text into Indian Sign Language
Students at IIIT-Hyderabad have developed a browser plugin that translates online text into Indian Sign Language using computer vision and an avatar. The tool aims to improve web accessibility for the hearing impaired by functioning efficiently without requiring heavy AI hardware.
Why it matters
This innovation addresses a significant accessibility gap in digital content, providing a cost-effective and scalable solution for inclusive web design.
The Indian Sign Language (ISL) uses gestures to represent complex words and sentences and has its own grammar and word order. People with hearing impairments find it a challenge to read content online. To address this gap, Masthan Sharif Shaik and Mohammed Raza, third-year BTech. students from the Center for Visual Information Technology (CVIT), IIIT-Hyderabad, under the supervision of Prof. C.V. Jawahar and Prof. Vinay Namboodiri (University of Bath, U.K.), developed a cost-effective plugin that can be added to any website. The plugin can run inside a browser in real time, without any real hardware or an AI model running on a server. “Websites today support captions, screen readers, and high-contrast modes, but almost none of them can show content in sign language.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in