Article
Version 1
This version is not peer-reviewed
Signsability: Enhancing Communication Through Sign Language App
Version 1
: Received: 1 August 2024 / Approved: 2 August 2024 / Online: 2 August 2024 (03:48:39 CEST)
How to cite: Ezra, D.; Mastitz, S.; Rabaev, I. Signsability: Enhancing Communication Through Sign Language App. Preprints 2024, 2024080125. https://doi.org/10.20944/preprints202408.0125.v1 Ezra, D.; Mastitz, S.; Rabaev, I. Signsability: Enhancing Communication Through Sign Language App. Preprints 2024, 2024080125. https://doi.org/10.20944/preprints202408.0125.v1
Abstract
The integration of sign language recognition systems into digital platforms has the potential to bridge communication gaps between the deaf community and the broader population. This paper introduces an advanced Israeli Sign Language (ISL) recognition system designed to interpret dynamic motion gestures, addressing a critical need for more sophisticated and fluid communication tools. Unlike conventional systems that focus solely on static signs, our approach incorporates both Deep Learning and Computer Vision techniques to analyze and translate dynamic gestures captured in real-time video. We provide a comprehensive account of our preprocessing pipeline, detailing every stage from video collection to the extraction of landmarks using MediaPipe, including the mathematical equations used for preprocessing these landmarks and the final recognition process. The dataset utilized for training our model is unique in its comprehensiveness and is publicly accessible, enhancing the reproducibility and expansion of future research. The deployment of our model on a publicly accessible website allows users to engage with ISL interactively, facilitating both learning and practice. We discuss the development process, the challenges overcome, and the anticipated societal impact of our system in promoting greater inclusivity and understanding.
Keywords
Sign Language Recognition; Deep Learning; Computer Vision; MediaPipe; Video Processing; ISL Dataset; Web App
Subject
Computer Science and Mathematics, Computer Vision and Graphics
Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Comments (0)
We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.
Leave a public commentSend a private comment to the author(s)
* All users must log in before leaving a comment
