Research Publications
Permanent URI for this communityhttps://rda.sliit.lk/handle/123456789/4194
This main community comprises five sub-communities, each representing the academic contribution made by SLIIT-affiliated personnel.
Browse
2 results
Search Results
Item Embargo Interactive Sign Language Learning System with Multimodal Emotion and Interaction Recognition Analysis(Institute of Electrical and Electronics Engineers Inc., 2026-05-21) Rupasinghe S.N; Lakshman P.A.D.K; Dilumina K.S.; Mahoshadhi K.M.; Siriwardana, S.E.R; Weerathunga IChild-centric intelligent applications increasingly require adaptive mechanisms to understand emotional engagement and provide inclusive learning experiences. However, existing systems often rely on single-modal emotion recognition or non-interactive learning approaches, limiting reliability and accessibility. This paper presents a twocomponent intelligent framework that addresses these challenges through a multimodal emotion and interaction analysis module that fuses facial emotion recognition and hand movement intensity, and a gamified sign language learning and progress-tracking module designed for deaf and mute children. The first component employs an EfficientNet-B0-based facial emotion recognition model trained on FER2013 and fine-tuned using CK+, achieving 96.9% validation accuracy, combined with motion-based hand interaction analysis to generate stable session-level engagement insights. The second component introduces a camera-assisted, game-based sign language learning environment with a landmark-based DNN gesture validation model achieving 97% validation accuracy, along with a parent-oriented progress dashboard. Experimental results demonstrate improved robustness in engagement detection and effective learning support through gamification. The proposed system highlights the novelty of integrating multimodal behavioral analysis with accessible, child-friendly learning mechanisms suitable for real-time environments.Publication Embargo Elderly Care Home Robot using Emotion Recognition, Voice Recognition and Medicine Scheduling(IEEE, 2022-12-26) Kularatne, B.M.U.S.; Basnayake, B.M.J.N.; Sathmini, P.D.L.A.M.; Sewwandi, G.V.U; Rajapaksha, S; De Silva, DThe robotic concept is used for several tasks to easier human day-to-day tasks. There are various recreational studies have been done on the elderly people’s care system. In this study, the system can identify the elderly people’s emotional status using thermal image processing that eliminates the halo effect issue in thermal images using a single discriminator Cycle-GAN model, serving medicine to elderly people by moving towards the elderly person while avoiding obstacles using point to point algorithm and obstacle avoidance and identify the semantic analysis by using web ontology based language. The integrated system is evaluated using the Gazebo simulator because the cost is lower than implementing the features in a real robot.