Domain Specific Conversational Intelligence: Voice Based E-Channeling System

Abstract

In this research the application of Automatic Speech Recognition, Natural Language Understanding, Neural Networks and Text To Speech Conversion is investigated to create a domain specific end to end voice based E-Channeling system. The novel idea in this research can be extended to any other domain(e.g.: Taxi Application) and build a conversational intelligence system. This system enables the user to avoid the shortcomings in the traditional doctor appointment channeling procedures. The system also have the ability to predict the doctor specialization according to the symptoms of the patient and can give emergency health tips by using the powerful Neural Network module. Domain-specific speech recognition model is created according to Sri Lankan accents and handles the context-specific to this domain(94% accuracy). Extracting the entities, handling e-channeling functions and selecting the most suitable API is done by the RASA backend. Neural Network will give the first aid and doctor specialization recommendations according to user input with a validation accuracy of 90%. Speech synthesis model will output the response in user preferred language(Sinhala, English or Tamil).