Automated Analysis of Children Emotion Expression Levels

Abstract

Despite the advancement in the field of facial emotion expression analysis, less attention has been given for facial emotion expression and emotion level analysis in children. This paper presents three novel findings in the area of child emotion expression. Identifying and validating the AU stimulation of children, automating the child emotion and level of emotion prediction and age wise analysis of child emotion expression. Emotion predictions were compared resulting through deep learning methods such as 3DCNN and machine learning approaches using EFA.AU stimulation results generated through EFA are consistent with the FACS. Through AU analysis, the paper shows that a child video or image can be predicted for the expressed emotion and its level with 91.04% accuracy through KNN classifier. While the 3DCNN approach resulted in 82.64% accuracy, the age wise emotion prediction through CNN resulted in the range of 60% to 86.6%. Though all approaches evidenced comparable results in emotion prediction, the emotion level prediction through EFA and AU outperformed 3DCNN and CNN approaches in all cases. Happy emotion prediction in age wise emotion analysis resulted in a higher accuracy over sad and disgust emotions. As emotion level prediction in age wise analysis display mixed results, a further research on age wise AU stimulation is encouraged.