Faculty of Computing
Permanent URI for this communityhttps://rda.sliit.lk/handle/123456789/4202
Browse
6 results
Search Results
Publication Embargo SPAVIS: Mobile Application for Visually Impaired Based on Assistive Software and Volunteerism(IEEE, 2022-12-09) Mahir, M.A.M.; Hussain, M.N.M.; Perera, R.D.D; Upendra, Y.A.M; Wickramarathne, C. J.; Kasthurirathna, DSri Lankan population accounts up to almost one million visually impaired individuals out of which are mostly students and young individuals. As the educational structure for the visually impaired improves with funds, blind schools, and free education, assistance with minute needs for most visually impaired individuals comes at a cost. There are many assistive technologies, such as audio books, screen magnifiers, braille books, and screen readers, prevalent around the island. However, there are several limitations to these technologies, mainly their availability and affordability. In Sri Lanka, many individuals, societies, clubs, and many more are willing to volunteer to help those in need, even those that require physical attention. As much as it is anticipated to aid those in need, there is very little attention to the ways it can be done. Hence, this research provides a way to develop a user-friendly mobile application with assistive software and volunteerism to aid visually impaired students with their daily needs.Publication Embargo Guardian - Smart Assistant Tool for Visually Impaired People(IEEE, 2022-12-09) Amarasinghe, C.K.; Pinto, R.D.S.P.; Sudusinghe, K.N.At present, with the advancement of technology, various devices and solutions have been found to aid the visually impaired community (VI Community). Even with the countless technological breakthroughs, yet they face many problems performing the most basic functions in daily life. Identifying the objects, they use daily, identifying a person, whether it’s someone they know or not, and their emotions, and reading a text information displayed anywhere, without the assistance from another person are the basic issues we deal with and try to resolve using a tool consisting of a pair of spectacles with an inbuilt camera that is integrated with a mobile application. The inbuilt camera will capture the image of a text containing label, an object, or a person which will be then detected, analyzed, and recognized and will be converted to Speech using Google TTS engine and produced through the headphones giving the output to the user. Tesseract OCR, YOLO algorithm, and TensorFlow models have been used for each feature of the tool respectively. This tool will be very beneficial to a blind person as it mitigates them the frustration caused by being incapable of performing daily activities without any assistance from another person.Publication Embargo Real-time Smart Navigation System for Visually Impaired People(IEEE, 2022-12-09) Sudaraka Keshara, S.R.D.; Weragoda, W.R.J.M.; Chandrasiri, S; Ellankovan, J; Madushan, W.AVisual sense plays a primary role in guiding sighted people through an unfamiliar environment and assisting them to reach their destination safely. Visual impairment describes the actual damage that makes it difficult to accomplish visual tasks because it makes it difficult to see clearly. This paper proposes an approach to overcome the challenges faced by visually impaired people with the help of machine learning. This proposed system combines a smart cane and a wearable smart glass. The detection of obstacles and potholes helps to increase the safety and comfort of visually impaired users by detecting and displaying obstacles, and the Smart Walk-lane Navigation assists in navigating through the walk-lanes without letting them enter the main roads and helps to prevent accidents. Road sign detection allows users to follow road signs and cross the roads safely, while face and emotion detection allows users to recognize well-known people and their emotions.Publication Embargo iRetina: An Intelligent Mobile Application for the Visually Impaired in an Indoor Environment(IEEE, 2021-12-09) Labeeshan, A; Satharasinghe, S. A. R. L. P; Dhananjana, A. M; Rupasinghe, T. D; Rajapaksha, S, K; Haddela, P. SThe Visually Impaired face a lot of problems while they carry out their day-to-day activities. Even though there are various ways that technologies have been used together to come up with a solution, there is still no proper, efficient, user-friendly, low-cost solution crafted just for them. Mobile Phones these days are beyond smartness, and they could be used to achieve so many things now compared to before. In this application, the camera of the mobile phone acts as the eyes for the Visually Impaired. The main purpose of this system is to intelligently navigate the visually impaired. This research covers some components namely, intelligent environmental identification by using the YOLOv4 object detection algorithm, calculation of distance by using the Inertial Measurement Unit (IMU) sensors, focusing, guiding and detecting the expiry date of packaged products, identifying and enhancing objects in a low-light environment. The communication between the system and the Visually Impaired will be a verbal voice communication through the microphones and the speakers of the mobile phone. The results presented show that the proposed application successfully achieves its goals by providing the required functionality.Publication Embargo A Bilingual Audio Based Online Shopping Mobile Application for Visually Impaired and the Elderly People(IEEE, 2021-12-07) Kangeswaran, V; Vasandarai, D; Eliyas, C; Munsil, M. M. M; Kodagoda, N; Suriyawansa, KDespite the widespread success of online shopping, it is not available to all consumer types. In this sense, visually impaired and elderly users, in particular, frequently face daunting barriers. Due to the inaccessibility and difficulty of current online shopping mobile applications, millions of visually impaired and elderly people are unable to benefit from the convenience provided by online shopping. Developing ideas that inspire people is really essential for visually impaired and elderly people to engage in social life. Generic product explanations, unhelpful images, and visually appealing user experiences are provided to average eyes in online shopping, and they are incompatible with visually impaired people, even with visually impaired assistive devices. Due to visual barriers and inaccessible user experiences, the visually impaired are struggling to do online shopping independently. During this COVID-19 pandemic situation, online shopping is one of the better ways to meet everyone's needs and wants. Ordinary individuals can meet their needs and desires, but the visually impaired and elderly people who live alone find it difficult to manage their daily life. Therefore, we have come up with a solution for this by having an online shopping mobile application. Our objective with this application is to assist visually impaired and elderly individuals in meeting their underlying needs and to help them in this pandemic situation. This paper presents an online shopping mobile application for visually impaired and elderly people that allows them to shop online in a variety of convenient ways.Publication Embargo Guided Vision: A High Efficient And Low Latent Mobile App For Visually Impaired(IEEE, 2021-12-09) Rizan, T; Siriwardena, V; Raleen, M; Perera, L; Kasthurirathna, DThis paper presents a novel solution for visually impaired individuals. A mobile app is connected to an ESP32CAM and a remote server to help visually impaired individuals to navigate around their environment safely. A deep learning model is deployed in the mobile app to detect obstacles in real-time without connecting to the internet. Other tasks such as reading texts, recognizing people, and describing objects are done in the remote server. We managed to connect the mobile app to the ESP32CAM and the remote server simultaneously. This was possible because the ESP32CAM is connected to the mobile app through Bluetooth. This gave the mobile the ability to connect to the remote server via the internet. To the best of our knowledge, no research has been done using Bluetooth to stream images to do object detection in a mobile app locally. Hence, our solution can detect obstacles locally and do other tasks mentioned previously in the remote server. This paper discusses how the ESP32CAM, obstacle detection module, face recognition module, text reading module, and object description module was implemented such that a low latent and highly efficient mobile app is created using minimal resources.
