e-ISSN: 2582-5208

International Research Journal of Modernization in Engineering Technology and Science

( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:05/Issue:04/April-2023 Impact Factor- 7.868 www.irjmets.com

SMART MACHINE LEARNING SYSTEM FOR BLIND ASSISTANCE

B. Gnana Chand*1, Md. Rahman*2, Gaurav Rajak*3, Subra Debnath*4,
Azad Ali*5, Dr. Navneeth Kaur*6
*1,2,3,4,5,6School Of Computer Lovely Professional University Punjab, India.
DOI : https://www.doi.org/10.56726/IRJMETS35265
ABSTRACT
A blind assistance system is a piece of technology that helps the visually impaired navigate their environment.
The system uses a variety of sensors and algorithms to recognize and understand the surroundings, and it then
conveys this knowledge to the user via tactile or aural input. Features like obstacle detection, interior
navigation, and face recognition might be part of the system. Blind assistance systems are designed to increase
the freedom and security of visually impaired people in their everyday lives, allowing them to move around
their surroundings more confidently and easily. This paper surveys the state of art techniques for blind
assistance systems.
Keywords: Blind Aid System, Blind Users, Visually Impaired, Sensors, Algorithms, Feedback, Obstacle
Detection, Indoor Navigation, Facial Recognition.
I. INTRODUCTION
A machine learning-based blind assistance system intends to help people who are visually impaired in their
daily lives. Using text-to-speech or voice recognition technology, the system employs machine learning
algorithms to identify and analyze the user's surroundings and offers aural feedback.
To provide consumers with a greater sense of awareness of their surroundings, the system may be integrated
into a variety of devices, including smartphones, smart glasses, and wearable technologies. The technology can
guide users through new environments and recognize items, people, and obstacles in their immediate
surroundings. Also, the method can help in recognizing and identifying everyday objects like coins, road signs,
and food items. To provide users with a complete and seamless experience, the system may also be connected
with other technologies like voice assistants and GPS. The purpose of the picture dataset was to advance image
recognition. The COCO dataset includes difficult, high-quality visual datasets for computer vision, mostly
cutting-edge neural network datasets.
A visually impaired person can use a smartphone or other device with a camera and microphone to get real-
time auditory input about their surroundings with the use of a blind assistance system powered by machine
learning. The system can recognize and describe things, read text, and aid in navigation. Moreover, machine
learning algorithms may learn from human input and get better over time.
Machine learning-based blind assistance systems provide numerous advantages, but there are still certain
issues that need to be resolved. For instance, these systems depend on precise and current data, which in some
circumstances might be challenging to collect. Because of the possibility that users would be disclosing critical
information about their position and surroundings, they also need to be developed with privacy and security in
mind.
Overall, the machine learning-based blind assistance system has the potential to dramatically enhance the
quality of life for those who are blind by giving them more freedom and mobility.
II. LITERATURE REVIEW
[1]Druga Devi et al. proposes a Raspberry Pi-based system that employs a camera to take pictures, which are
subsequently analyzed using Python programming. An audio jack receives the modified image and converts it
into audio signals before sending them to the speaker.
[2]R. Kadhim et al. employ the YOLO deep learning technology, which is an extremely quick method that uses a
convolutional neural network with numerous layers that perform a specific job at each layer, to help the blind
identify and distinguish various items in an indoor setting. To guarantee that the conclusions were accurate.

www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science

[37]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:05/Issue:04/April-2023 Impact Factor- 7.868 www.irjmets.com
[3]R. Devi et al. suggest a visual aid image processing system for blind people that can understand spoken
commands to assist the blind person in managing everyday duties and navigating their environment. The
authors want to achieve high accuracy and real-time performance using state-of-the-art object identification
methods
[4] S. Priya et al. highlight numerous devices and systems created to help with obstacle identification and
avoidance, navigation, and location sharing as they concentrate on the use of technology to assist visually
impaired people. According to the authors, these technologies have the potential to significantly improve the
quality of life for those who are visually impaired. in their proposal,
[5]G. Shivam et al. suggest using an Android application developed using Android Studio and Tensor-flow Lite,
an open-source deep learning framework for on-device inference, to swiftly detect items.
Data and variables:
You will require a dataset of textual and aural data that captures the needs and experiences of the visually
impaired people to construct a blind assistance system using machine learning. Consider the following
hypothetical data sources and variables:
Textual information: Conversation transcripts from online chat rooms or message services where people with
vision impairments seek help Tweets or posts on social media by people with vision impairments describing
their needs or experiences Case studies or medical records of people with vision impairments.
Detecting Objects: Our project's first module, object detection, acts as its cornerstone. Essentially, it requires
using datasets for which the model is trained to find nearby and distant objects. has experience. Because people
with visual impairments are the primary audience for our program, detection is essential.
Audio recordings: For support group meetings or blind people's treatment sessions are examples of auditory
data. For audiences who are blind, audio explanations are provided for videos or movies. recordings of
conversations with visually challenged people requesting assistance via the phone or video The following
factors might be taken into account while assessing this data Age, gender, and location-based demographic data
The particular problems or obstacles that a person who is blind faces are forms of assistance that the person
has requested (e.g., emotional support, practical advice, assistive technology).The efficiency of various forms of
assistance in meeting a person's needs terminology used to discuss visual impairments and associated
experiences communication's emotional undertone (e.g., positive, negative, neutral) By examining this data and
looking for trends using machine learning methods.
III. METHODOLOGY AND MODEL SPECIFICATIONS
Data Gathering: The initial phase is gathering a significant quantity of data from several sources, including
cameras, microphones, and other sensors. Images, audio files, and other sorts of sensory information can be
included in this data.
Data pre-processing: When the data has been gathered, it must be pre-processed to draw out useful
characteristics. To extract important elements from the data, techniques like image and audio processing may
be used.
Feature Extraction: To find patterns and features that may be utilized to create predictions, the pre-processed
data is then run through feature extraction algorithms. To extract important characteristics, methods like
Principal Component Analysis (PCA) or Convolutional Neural Networks (CNNs) may be used.
Model Training: After pre-processing and extracting the data, the next step is to train a machine-learning model
on it. To train the model on the data, one may utilize approaches like supervised or unsupervised learning.
Model evaluation: It is necessary after the model has been trained to make sure it is operating properly. Cross-
validation techniques may be used in this to make sure the model is capable of generalizing successfully to
fresh data.
Deployment: The model may be used in a blind assistance system to give blind people real-time help after it has
been trained and assessed. This may entail combining the model with sensors and other hardware to provide
the user with auditory or physical feedback.
Key model requirements for a machine learning-based blind aid system include the following:
www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science
[38]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:05/Issue:04/April-2023 Impact Factor- 7.868 www.irjmets.com
Machine learning algorithm type: Depending on the particular issue being solved, a particular machine learning
algorithm will be employed. Support vector machines (SVMs), decision trees, random forests, and neural
networks are examples of frequently used algorithms. Images, audio files, and other sensory data are frequently
used as the model's input data.
Methods for Extraction of Relevant Features: From the input data, pertinent features will be extracted using
feature extraction techniques. This may be accomplished using methods like PCA, CNNs, and other deep
learning algorithms.
Performance Metrics: Performance metrics will be employed to assess the model's level of accuracy. Metrics
like accuracy, precision, recall, and F1-score are frequent.

Statistics

www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science

[39]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:05/Issue:04/April-2023 Impact Factor- 7.868 www.irjmets.com
IV. CONCLUSION
In conclusion, machine learning-based blind assistance systems, particularly CNN and RNN, offer a potential
way to increase the freedom and mobility of visually impaired people. These systems may use a lot of data to
train algorithms for obstacle detection, interior navigation, and even facial recognition by utilizing the coco
datasets. These devices can give the user auditory or tactile input, allowing them to securely navigate their
environment. Blind assistance systems are anticipated to become progressively more complex and useful in
supporting people who are visually impaired in their everyday lives as cutting-edge technology continues to
improve.
V. REFERENCES
[1] S.Durgadevi, “SMART MACHINE LEARNING SYSTEM FOR,” 2nd International Conference on Power,
Energy, Control and Transmission System, p. 4, 2020.
[2] M. R. Kadhim, “Blind Assistive System Based on Real Time Object Recognition using Machine learning,”
Control and Systems Engineering Dept., University of Technology-Iraq, Alsina’a street, 10066 Baghdad,
Iraq, p. 7, 2022.
[3] R. Devi, “Blind Assistance System using Image Processing,” Global Journal of Computer Science and
Technology, p. 10, 2022.
[4] S. Priya, “Blind Assistance System Using Machine learning,” Department of Computer Science and
engineering, p. 15, 2022.
[5] G. Shivam, “Assisting Blind People Using Machine Learning Algorithms,” Turkish Journal of Computer
and Mathematics Education, p. 9, 2021.

www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science

[40]