Faculty of Computing

Permanent URI for this communityhttps://rda.sliit.lk/handle/123456789/4202

Browse

Search Results

Now showing 1 - 3 of 3
  • Thumbnail Image
    PublicationEmbargo
    Speech Master: Natural Language Processing and Deep Learning Approach for Automated Speech Evaluation
    (IEEE, 2021-12-06) Kooragama, K.G.C.M; Jayashanka, L. R. W. D; Munasinghe, J. A; Jayawardana, K. W; Tissera, M; Jayasingha, T. B
    Every English speaker wishes to expertise his/her public speaking skills sharply. However, it is extremely difficult and requires a significant amount of practice and experience on an individual basis. This paper introduces a novel online tool “Speech Master” to practice and improve public English speech delivering skills in a professional manner. Using natural language processing, machine learning, and deep learning approaches, the proposed system analyzes the user's speech in terms of content, grammatical accuracy, grammatical richness, facial expressions, and flow. The accuracy was checked by comparing actual results taken from experts with the predicted results obtained from the tool. “Speech Master” achieves an average accuracy of more than 80% and produces a better overall result. This novel tool benefits English speakers all over the world by meeting the demand for a simple and easy-to-use solution for improving or practicing English speech delivery skills; enhancing oratory skills, boosting confidence, and delivering well-articulated speeches.
  • Thumbnail Image
    PublicationEmbargo
    Machine learning based automated speech dialog analysis of autistic children
    (IEEE, 2019-10-24) Wijesinghe, A; Samarasinghe, P; Seneviratne, S; Yogarajah, P; Pulasinghe, K
    Children with autism spectrum disorder (ASD) have altered behaviors in communication, social interaction, and activity, out of which communication has been the most prominent disorder among many. Despite the recent technological advances, limited attention has been given to screening and diagnosing ASD by identifying the speech deficiencies (SD) of autistic children at early stages. This research focuses on bridging the gap in ASD screening by developing an automated system to distinguish autistic traits through speech analysis. Data was collected from 40 participants for the initial analysis and recordings were obtained from 17 participants. We considered a three-stage processing system; first stage utilizes thresholding for silence detection and Vocal Activity Detection for vocal isolation, second stage adopts machine learning technique neural network with frequency domain representations in developing a reliant utterance classifier for the isolated vocals and stage three also adopts machine learning technique neural network in recognizing autistic traits in speech patterns of the classified utterances. The results are promising in identifying SD of autistic children with the utterance classifier having 78% accuracy and pattern recognition 72% accuracy.
  • Thumbnail Image
    PublicationEmbargo
    Machine Learning Based Automated Speech Dialog Analysis Of Autistic Children
    (IEEE, 2019-10-24) Wijesinghe, A; Samarasinghe, P; Seneviratne, S; Yogarajah, P; Pulasinghe, K
    Children with autism spectrum disorder (ASD) have altered behaviors in communication, social interaction, and activity, out of which communication has been the most prominent disorder among many. Despite the recent technological advances, limited attention has been given to screening and diagnosing ASD by identifying the speech deficiencies (SD) of autistic children at early stages. This research focuses on bridging the gap in ASD screening by developing an automated system to distinguish autistic traits through speech analysis. Data was collected from 40 participants for the initial analysis and recordings were obtained from 17 participants. We considered a three-stage processing system; first stage utilizes thresholding for silence detection and Vocal Activity Detection for vocal isolation, second stage adopts machine learning technique neural network with frequency domain representations in developing a reliant utterance classifier for the isolated vocals and stage three also adopts machine learning technique neural network in recognizing autistic traits in speech patterns of the classified utterances. The results are promising in identifying SD of autistic children with the utterance classifier having 78% accuracy and pattern recognition 72% accuracy.