AI research company Talksign has launched Talksign-1, a foundational model designed for real-time sign language translation. This new technology, developed by the Nigeria and UK-based firm, aims to bridge the communication divide for the Deaf and hard-of-hearing community. The platform offers bidirectional conversion, translating American Sign Language (ASL) to speech and text, and vice versa, directly within a web browser.
Addressing a Global Accessibility Challenge
According to the World Health Organisation, over 430 million people worldwide are deaf, with 70 million using sign language as their primary communication method. Despite these numbers, most digital platforms and public services are not designed for sign language users. This gap creates significant barriers to education, employment, and full participation in society for the Deaf community.
The Technology Behind Real-Time Translation
Talksign-1 utilizes a standard webcam to capture a user's movements, processing them through 3D landmark extraction on the user's device to ensure privacy. The AI model, a transformer-enhanced CNN, then analyzes these spatiotemporal patterns to identify signs from its vocabulary. This system achieves translation in under 100 milliseconds with a reported 84.7% accuracy on isolated signs.
The model was trained on the extensive WLASL2000 dataset, which contains a large collection of ASL signs. Currently, the system recognizes a focused vocabulary of 250 common signs, enabling basic conversational interactions. The entire platform is designed to be scalable, running efficiently on a single cloud instance orchestrated with Docker Compose.
A Founder's Personal Mission
The company's mission is deeply rooted in the personal experiences of co-founder Edidiong Ekong. Growing up in Nigeria with three deaf friends, he learned ASL at a young age to connect with them. This formative experience inspired him to address the communication barriers he witnessed firsthand, eventually leading to the creation of Talksign.
Responsible Development and Future Ambitions
Talksign emphasizes that its technology is designed to augment, not replace, professional human interpreters. The company acknowledges current limitations, including the lack of support for continuous sentence-level signing and a restricted vocabulary. Users are advised against relying on it solely in critical medical, legal, or safety situations without human oversight.
Development was conducted in close partnership with Deaf educators, native ASL signers, and accessibility advocates to ensure the tool is respectful and effective. Looking ahead, the company plans to significantly expand the model's vocabulary and capabilities. Future versions aim to include continuous sentence recognition, fingerspelling, and support for other languages like British and French Sign Language.
The launch of Talksign-1 represents a significant step forward in leveraging AI for greater inclusivity and accessibility. By providing a tool for real-time communication, Talksign is helping to dismantle long-standing barriers for the Deaf community. The company's commitment to collaborative development and future enhancements signals a promising future for sign language technology.