Faculty of Computing

Permanent URI for this communityhttps://rda.sliit.lk/handle/123456789/4202

Browse

Search Results

Now showing 1 - 2 of 2
  • Thumbnail Image
    PublicationEmbargo
    E-Learning Assistive System for Deaf and Mute Students
    (IEEE, 2022-12-09) Ranasinghe, P; Akash, K; Nanayakkara, L; Perera, H; Chandrasiri, S; Kumari, S
    E-learning has become a popular digital platform among both students and teachers. When using an e-learning system, deaf-mute students can get significant benefits. It allows students to better grasp their studies by providing additional details. The major problem that the deaf and mute community encounters in the e-learning environment is that they are no longer attempting to enroll in normal institutions, which do not provide many facilities for them due to a lack of resources, a lack of learning facilities, and some social disturbances. To achieve that problem this system will translate the lecturer’s voice into text, map words with pre-created sign language animations, generate subtitles for lecture videos, clearly identify the face position of the lecturer, detect difficult words, track the hand gestures, and practice sign language so that it will increase learning resources, facilities, usability and help teachers to execute their teaching process through this platform. Therefore, normal institutions can use this system as their learning management system. It will approach deaf and mute students to enroll in normal institutions and do their studies as typical students.
  • Thumbnail Image
    PublicationEmbargo
    Computer Vision and NLP based Multimodal Ensemble Attentiveness Detection API for E-Learning
    (IEEE, 2021-04-21) Wijeratne, M. D; Lakmal, R. H. G. A; Geethadhari, W. K. S; Athalage, M. A; Gamage, A; Kasthurirathna, D
    Attention is the fundamental element of effective learning, memory, and interaction. Learning however, with the evolvement of technologies in the modern digital age, has surpassed traditional learning systems to more convenient online or e-learning systems. Nevertheless, unlike in the traditional learning systems, attention detection of a student in an e-learning environment remains one of the barely explored areas in Human Computer Interaction. This study proposes a multimodal ensemble solution to detect the level of attentiveness of a student in an e-learning environment, with the use of computer vision, natural language processing, and deep learning to overcome the barriers in identifying user attention in e-learning. The proposed multimodal captures, processes, and predicts user attentiveness levels of individual students, which are subsequently aggregated through an ensemble model to derive an overall outcome of better accuracy than individual model outcomes. The final outcome of the ensemble model produces a range of percentages, within which the attentiveness level of the student lies during a single online lesson. This range is consequently delivered to the users through an Application Programming Interface.