Sensor-Based Emotion Tracking System for Computer Games

Abstract

The game development industry is among the leading industries globally, and in 2020, gaming emerged as a popular entertainment activity upon the COVID-19 outbreak. Thus, competition among gaming companies is high. Hence, they try to adopt new technologies often. Gaming brings multiple feelings for the gamer. At times, the conditions may get even worse from the game’s end where the gamer may end up venting out his rage and annoyance. Hence, there is a massive possibility for the gamer to switch to another game which may result in the company to lose its customers. In that scenario, this system can monitor the emotional states of the gamer while playing and manipulate the gaming environment, sound environment, enemy behavior, and gamer mechanism according to the emotional state of the gamer. The sensor-based emotion tracking system identifies the gamer's emotional state using facial emotions, detected through a webcam and heart rate, detected through sensors. The development was carried out through the machine learning models, open cv, Arduino techniques, and reactive programming. The emotional state and facial emotions that will be tracked will count to an accuracy of above 95%. Through that, the target will be to make the gamer satisfied by building appreciation for the services given and by improving the gamer's gaming experience and retain the gamer with the game provider.