Remote heart rate extraction using microsoft kinecttm v2. 0

Abstract

Remote and contactless heart rate detection is still an open research issue of great clinical importance. Available approaches lack the necessary accuracy and reliability for acceptance by medical experts. In this study, we propose a new method for remote heart rate extraction using the Microsoft KinectTM v2.0 image sensor. The proposed approach relies on signal processing and machine learning methods in order to create a model for accurate estimation of the heart rate via RGB and infrared face videos. Electrocardiography (ECG) recordings and RGB and infrared face videos, captured using the KinectTM v2.0 image sensor, were acquired from 17 subjects and used to create a machine learning model for remote heart rate detection. Experimental evaluation through supervised regression experiments showed that the proposed approach achieved a mean absolute error of 6.972 bpm, demonstrating the capabilities of the underlying technology.