Faculty of Computing
Permanent URI for this communityhttps://rda.sliit.lk/handle/123456789/4202
Browse
2 results
Search Results
Publication Embargo SPAVIS: Mobile Application for Visually Impaired Based on Assistive Software and Volunteerism(IEEE, 2022-12-09) Mahir, M.A.M.; Hussain, M.N.M.; Perera, R.D.D; Upendra, Y.A.M; Wickramarathne, C. J.; Kasthurirathna, DSri Lankan population accounts up to almost one million visually impaired individuals out of which are mostly students and young individuals. As the educational structure for the visually impaired improves with funds, blind schools, and free education, assistance with minute needs for most visually impaired individuals comes at a cost. There are many assistive technologies, such as audio books, screen magnifiers, braille books, and screen readers, prevalent around the island. However, there are several limitations to these technologies, mainly their availability and affordability. In Sri Lanka, many individuals, societies, clubs, and many more are willing to volunteer to help those in need, even those that require physical attention. As much as it is anticipated to aid those in need, there is very little attention to the ways it can be done. Hence, this research provides a way to develop a user-friendly mobile application with assistive software and volunteerism to aid visually impaired students with their daily needs.Publication Embargo Guided Vision: A High Efficient And Low Latent Mobile App For Visually Impaired(IEEE, 2021-12-09) Rizan, T; Siriwardena, V; Raleen, M; Perera, L; Kasthurirathna, DThis paper presents a novel solution for visually impaired individuals. A mobile app is connected to an ESP32CAM and a remote server to help visually impaired individuals to navigate around their environment safely. A deep learning model is deployed in the mobile app to detect obstacles in real-time without connecting to the internet. Other tasks such as reading texts, recognizing people, and describing objects are done in the remote server. We managed to connect the mobile app to the ESP32CAM and the remote server simultaneously. This was possible because the ESP32CAM is connected to the mobile app through Bluetooth. This gave the mobile the ability to connect to the remote server via the internet. To the best of our knowledge, no research has been done using Bluetooth to stream images to do object detection in a mobile app locally. Hence, our solution can detect obstacles locally and do other tasks mentioned previously in the remote server. This paper discusses how the ESP32CAM, obstacle detection module, face recognition module, text reading module, and object description module was implemented such that a low latent and highly efficient mobile app is created using minimal resources.
