Deep Learning Based Sinhala Sign Language Recognition

Abstract

Deaf individuals in Sri Lanka rely primarily on Sinhala Sign Language (SSL) for communication due to hearing impairments. However, effective communication between the Deaf and hearing populations remains challenging due to the limited knowledge of SSL among hearing individuals. This research aims to address this gap by developing an SSL gesture recognition system using computer vision and deep learning techniques. Specifically, the study compares the performance of 3D Convolutional Neural Networks (3D-CNNs) and a hybrid 2D Convolutional Neural Network with Long Short-Term Memory (2D-CNN+LSTM) for classifying short-duration spatiotemporal SSL gestures. Additionally, the research emphasizes reducing computational complexity to ensure efficient operation of the system on low-end devices. These contributions advance the accessibility and practical usability of gesture recognition systems for the Sinhala Sign Language.