Development of Low Resource Machine Learning Models for Child Cognitive Ability Assessments

Abstract

Automated cognitive assessment tools are state-of-the-art in assessing cognition development. Due to the low availability of resources, building automated cognitive ability evaluation tools is challenging. This study focuses on developing machine learning models using a limited amount of data to assess Reasoning IQ, Knowledge IQ, Mental Chronometry and Attention-levels of Sinhala-speaking children between the age of 7 to 9 years. Our solution includes Sinhala speech recognition systems, image classification models, gaze estimation, blink count detection and facial expression recognition models to evaluate the above four cognitive ability measuring factors. Open domain speech recognition has been used to evaluate complex Sinhala child verbal responses and limited vocabulary responses were assessed using an end-to-end speech recognition system, respectively achieving 40.1% WER and 97.14% accuracy. Additionally, the image classification models for handwritten Sinhala letter recognition and two shape recognition models have gained 97%, 89% and 99% accuracy. The linear regression model for attention level evaluation that utilizes the inputs from a combination of eye-gaze estimation, facial expression recognition and blink rate detection models has gained 85% accuracy.