Faculty of Computing

Permanent URI for this collectionhttps://rda.sliit.lk/handle/123456789/4776

Browse

Filters

20252

Advanced Search

Filter by

Settings

Subject: search.filters.subject.Computer Vision

Search Results

Now showing 1 - 2 of 2
  • Thumbnail Image
    ItemEmbargo
    Hybrid Deep Learning Approach Using YOLO and Spatial Transformers for Kinesthetic Math Education in Low-Resource Settings
    (Institute of Electrical and Electronics Engineers Inc., 2025-07-03) Sellapperuma M.S; Wasana, K.H. I; Dhananjana, B.K. T; Anuruddhika, D. L. N; Krishara, J; Wijendra, D
    This research presents a hybrid deep-learning system to enhance kinesthetic math education for Grade 4 and 5 students in low-resource Sri Lankan classrooms, addressing addition, subtraction, and time-telling skills in Sinhala. Integrating fine-tuned You Only Look Once version 11 (YOLOv11) for real-time abacus recognition and pre-trained Spatial Transformer Network (STN) with Residual Network 50 (ResNet50) for analog clock analysis, the system bridges physical manipulatives with digital feedback. Optimized for low-cost hardware via post-training quantization, it reduces model sizes by up to 56.6% and inference times by 45.9%, enabling deployment on standard PCs. The methodology employs YOLOv11 to detect abacus beads (mean Average Precision, mAP50-95: 0.898) and STN + ResNet50 to correct clock perspectives (95.2% accuracy on SynClock), delivering immediate Sinhala feedback through a culturally adapted interface. The system was evaluated on an Intel Core i5 PC with 8GB RAM and achieved sub-second inference (YOLOv11: 170.1 ms, STN + ResNet50: 32 ms post-quantization) while retaining accuracy. A pilot study with 20 students showed a 25% improvement in arithmetic scores and 30% in time-telling accuracy, with 85% reporting higher engagement. These findings demonstrate the system's efficacy in boosting numeracy and interaction in resource-scarce settings, aligning with the Visual, Aural, Read/Write, Kinesthetic (VARK) framework. Despite challenges like hardware constraints and real-world variability, this scalable, offline-capable solution offers a novel approach to educational technology, with potential for broader deployment in Sri Lanka and similar contexts, addressing gaps in artificial intelligence-driven kinesthetic learning tools. ©
  • Thumbnail Image
    ItemEmbargo
    AI Interviews with Facial Emotion Recognition for Real-Time Feedback and Career Recommendations
    (Institute of Electrical and Electronics Engineers Inc., 2025) Herath R.P.N.M; Arachchi D.S.U.; Gunaratne M.H.B.P.T.; Hansana K.T.; Wijayasekara, S.K; Jayasinghe, D
    The hiring process is complex, requiring evaluation of candidates across multiple dimensions, including technical proficiency, behavioral traits, and credibility. Traditional interviews often suffer from biases and inefficiencies. This research presents an AI-driven Interview System integrating Machine Learning (ML), Natural Language Processing (NLP), and Computer Vision to automate and enhance recruitment. The system generates contextual interview questions, evaluates candidate responses using LLM-based scoring models, and provides real-time feedback for engagement. It includes speech-to-text transcription and offensive word detection to ensure professionalism. The behavioral analysis module leverages facial emotion recognition and computer vision to assess non-verbal cues such as confidence and attentiveness. Additionally, Curriculum Vitae (CV) parsing and LinkedIn data extraction use NLP-based entity recognition to extract educational background, work experience, and key skills, enabling personalized interviews. The technical assessment module administers real-time coding challenges, evaluating solutions for correctness, efficiency, and best practices while providing AI-generated feedback. By automating these key hiring aspects, this system enhances objectivity, efficiency, and decision-making, ensuring a data-driven, unbiased, and scalable selection process while improving the candidate's experience and employer insights