International Journal on Science and Technology

E-ISSN: 2229-7677     Impact Factor: 9.88

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 16 Issue 2 April-June 2025 Submit your research before last 3 days of June to publish your research paper in the issue of April-June.

Sign language recognition based on deep learning with neural network

Author(s) Yarramsetty Sandeep, Dr Shanti S
Country India
Abstract Sign language serves as a prevalent means of communication for individuals with hearing and/or speech impairments. AI-driven automatic systems for sign language identification are highly sought after as they can diminish obstacles between individuals and enhance Human-Computer- Interaction (HCI) for the impaired community. The automatic identification of sign language remains a complex challenge due to the intricate structure of sign language in conveying messages. Isolated signs, which refer to individual gestures executed through hand movements, play a crucial role in this process. Over the past decade, research has advanced the automatic identification of isolated sign language from videos by utilizing machine learning techniques. Beginning with a thorough examination of current recognition methods, particularly focusing on available public datasets, the study puts forth an enhanced convolution-based hybrid Inception architecture aimed at increasing the recognition precision
of isolated signs. The primary contributions are the enhancement of InceptionV4 through optimized back-propagation across uniform connections. Furthermore, an ensemble learning framework incorporating various Convolution Neural Networks has also been introduced and
leveraged to further boost the recognition accuracy and resilience of isolated sign language recognition systems. The efficacy of the proposed learning methods has been validated on a benchmark dataset consisting of isolated sign language gestures. The experimental findings illustrate that the proposed ensemble model surpasses sign identification performance, achieving a higher recognition accuracy (98. 46%) and enhanced robustness.
Keywords Convolutional neural network, categorization, deep learning, featureextraction, lip-reading, long short-term memory, sign language.
Field Computer > Artificial Intelligence / Simulation / Virtual Reality
Published In Volume 16, Issue 2, April-June 2025
Published On 2025-05-16
DOI https://doi.org/10.71097/IJSAT.v16.i2.5048
Short DOI https://doi.org/g9kc56

Share this