Deep Transfer Learning Approach for Facial and Verbal Disease Detection

Abstract

Millions of people have been subjected to different kind of acute diseases, some of them are eye diseases, facial skin diseases, tongue diseases and voice abnormalities. Most of eye diseases cause fully or partial blindness. Skin and tongue complications can be signs of cancers. Voice abnormalities can be cured at initial stages. Well-practiced medical practitioners have the ability of diagnose these diseases, but due to the pandemic situations and high consultation costs people do not tend to consult doctors. This research is predominantly focused on development of an application for automatic detection of eye, skin, tongue and verbal diseases using transfer learning (TL) based deep learning (DL) approach. Deep learning is a part of machine learning (ML) which has been used in most computer vision approaches. Transfer learning has been used to rebuild the existing convolutional neural network (CNN) models and used in disease detection. DenseNet121, MobileNetV2, RestNet152V2, models have been used to detect eye, skin and tongue diseases respectively and a new model has been used to detect voice abnormalities. CNN models are capable of automatically extracting features from the given images and voice data. All the trained models have been given accuracy rate of 80%-95%.