Download as doc, pdf, or txt
Download as doc, pdf, or txt
You are on page 1of 8

Solar Powered Smart Wheel Chair controlled by

MPU6050 and Voice App with obstacle detection.

Abstract— Disable individuals are disregarded more often Asia, it will similarly enable many impairments to individuals
than not. Presently, they will have the opportunity to proceed and will attempt to make it less expensive.
onward their own without relying upon the full-time backing of a
human person. An alternate methodology has been made for There are on a fundamental level two sorts of wheelchair open
individuals having various inabilities in all nations. A savvy
wheelchair is planned so that individuals can control the
for incapacitation people one is worked physically using our
wheelchair by simply utilizing hand gestures. Other than these, body quality and the other is worked thusly using engines.
individuals with another diverse kind of incapacity can likewise Regardless, people groups are confronting issues when they
control by voice direction via a phone application. Considering are going to utilize these wheelchairs. If considers manual
the source power and its utilization of power, it is being planned wheelchairs, they have a gross loss of mechanical viability,
with sunlight-based power (Solar panel used). Along these lines, and as such, the danger of client weakness and upper-
while moving around all around the battery can be revived extremity harm is extended. As being handicap they need to
effectively. This keen wheelchair is additionally fit for hindrance confront plenty of issues in their day by day life and don't
recognition. This will avoid any sort of obstacle with any objects.
need them to confront any longer.
Keywords— BTS7960, Gear Motor, Bluetooth Android App.
II. RELATED WORKS
I. INTRODUCTION
The goal of this paper is to set up a Hand Gesture Controlled
Insufficiency incorporates at any rate one component of Wheelchair for physically handicapped people who face
physical limit, particular development or social collaboration. trouble in moving to start with one spot then onto the next in
A debilitation can be organized into different sorts of hearing everyday life. Many related works had been studied to find out
insufficiency, visual failure, physical impediment, talk a better solution for designing the wheelchair. The summary
handicap, mental powerlessness. Those impairment people are of several papers is given below:
facing various issues in their regular day to day existence.
People acknowledge them as weight as they are unfit to move The present examination uses a quality capacity
like different people. Those impediments about 15% of people arrangement technique to build up a wheelchair with a client
in the whole world are enduring any kind of physical failure. selectable manual/electric drive mode and an assistant solar
For making their lives more straightforward people imagined power supply system. The auxiliary solar power supply
wheelchairs quite a while prior. Regardless, as everything is expanded the movement scope of the wheelchair by around
changing well ordered the development for wheelchairs is 26% contrasted and that of a wheelchair controlled by battery
moreover evolving. From the start, individuals used a self- alone. The wheelchair has a particular plan and can be
moved wheelchair, by then in 1890 the electric wheelchair disassembled and folded for ease of transportation or storage.
was concocted and after that electric wheelchairs experience a By and large, the present results recommend that the proposed
few adjustments for better versatility and better comfort for wheelchair gives a successful and helpful method for
debilitating people groups. Our principal objective is to give gathering the portability needs of people with versatility
the opportunity of development to those physically debilitate challenges. [1]
individuals. This is a brutal truth for them and at times they
need to confront this sort of awful circumstance in their Another strategy for estimating the joint angle
everyday life. Other than among 15% incapacitated utilizing a combination of accelerometers and gyroscopes is
individuals 3% of individuals who have numerous inabilities. exhibited. The strategy proposes a negligible sensor design
The individuals who have incapacity both in their spinal lines with one sensor module mounted on each section. The model
and hand mussel they can't utilize the ordinary wheelchairs. depends on evaluating the acceleration of the joint center of
Along these lines, the voice control framework will help them rotation by setting a couple of virtual sensors on the adjacent
so they don't need to confront troubles to control the segments at the center of rotation. In the proposed method,
wheelchairs. There are just about 10 % to 16% of individuals joint angles are found without the requirement for integration,
in Bangladesh who are handicapped among the complete so total angles can be gotten which are free from any source of
populace. It is evaluated in 2011 that there are almost 101,585 drift. The strategy was approved by estimating knee flexion-
individuals in Bangladesh and Asia (more than millions) with extension angles of eight subjects, walking at three distinct
an inability and is frequently discovered without the speeds, and contrasting the outcomes with a reference
advantages of national improvement. From the perspective of movement measurement system. The outcomes are extremely
near those of the reference system showing exceptionally little sensors, and a Zigbee interface. The PC server with the Kinect
errors and incredible correlation coefficients. The calculation interface handles the gesture recognition; identifies the
can give joint angles continuously and prepared for use in disabled elder location. Once the PC server detects the
walk investigation. [2] request, it decides the wheelchair moving path based on the
algorithms and then the infrared sensors are activated by the
planned route and the wheelchair move towards the elder. The
patient uses a smartphone application for the navigation of the
wheelchair to his desired location through a specific hand
gesture sensed by the Kinect camera. [5]

The principal focus of the voice control shrewd


wheelchair errand is prescribed to control a wheelchair by
using a discourse acknowledgment module. The procedure is
intended to control a wheelchair using the voice of a person.
The objective of this task is to support the development of
individuals who are debilitated and elderly folks who are not
prepared to move well. The point of this framework will
Figure 1: Joint-Angle Measurement Using Accelerometers and Gyroscopes[3]
empower certain individuals to continue with a presentation
Voice Controlled Wheel Chair System is intended to with less dependence on others for their improvement as
control a wheelchair utilizing the voice of an individual. consistently needed. Discourse acknowledgment innovation is
Discourse acknowledgment is a key innovation that can give a key innovation that will give another technique for human
human correspondence with machines for controlling a participation with a machine or gadget. Thusly, the issues that
wheelchair. For the commitment of the human voice, the they face can be handled by using discourse acknowledgment
Android telephone is utilizing as a go-between. Arduino unit innovation for the development of a wheelchair. This can be
is utilized as a controller to control the development of a recognized and progressed with the use of the PDA gadget as
wheelchair dependent on the human voice. [3] a center individual or interface. In this task, interfaces have
been arranged thusly to develop a program for seeing
discourse moreover controls the development of the seat and
The main point of this paper is to build up a smart
an application which can bargain or deal with the graphical
wheelchair for physically challenged persons. This voice-
headings. [6]
controlled smart wheelchair comes with enhanced features
like electric-powered, voice control, line follower with
Solar Energy is delivered by the sunlight is a non-
obstacle avoidance, etc. The smart wheelchair control unit has
disappearing renewable source of energy which is free from
the combination of AVR type microcontroller particular model
eco-friendly. Consistently enough daylight energy achieves
ATmega328 with a Bluetooth module, ultrasonic and infrared
the earth to satisfy the world's energy needs for an entire year.
sensors and a circuit that is motor driven for controlling motor
In the present age, Electricity is required consistently. Sunlight
speed.
based Energy is produced according to applications like
mechanical, business, and private. It cans effectively energy
drawn from direct daylight. So, it is very effectiveness and
free environment pollution for surrounding. In this article, it
has been having looked into Solar Energy from Sunlight and
talked about their future patterns and viewpoints. The article
additionally attempts to talk about working, sun-based board
types; emphasize the different applications and strategies to
advance the advantages of solar energy.

9. Gesture Recognition 3D Accelerometer: The initial step of


the accelerometer-based signal acknowledgment framework is
Figure 2: Demonstrates the chair and route that travels.[4]
The Smart Wheelchair comprises of voice recognition, line to get the time arrangement of a motion movement. Past
follower circuit along with obstacle detection, temperature examinations have received explicit gadgets to catch
sensor along with GSM module. Ward k, Ward M, Ward V quickening information of a signal. For instance, TUB-Sensor
must be spoken in the android app. And the chair will follow Glove can gather hand direction and increasing speed, and
the line and reach the destination.[4] finger joint points. Tsukada structured a finger-based motion
input gadget with an IR transmitter, contact sensor, twist
Gesture-Based Wheel Chair Control Using Kinect sensor, and speeding up sensor. Mäntyjärvi put a sensor
Camera: The system has three parts: gesture recognition, Tx- enclose into a telephone request to recognize the 3-pivot
Rx operation, and mobile application, Kinect, a PC server, IR speeding up of clients' hand movements. Presently most
accelerometers can catch three-pivot increasing speed Push the board upward with an increasing speed of A m/s2.
information, for example, 3D accelerometers, which pass on The quickening of the gravity is dynamic and equivalent to the
more movement data than 2D accelerometers. They have been speeding up of the square short the power of gravity ≈ (+A-
installed into a few business items, for example, iPhone and 9.81) m/s2.
Wiimote. This paper utilizes Wiimote as the motion input After the conversion analog to digital converter over the
gadget for test set-up and execution assessment. To perceive Arduino, the signals are passed to the DC motor. DC motors
motion from the caught information, scientists have connected themselves are extremely basic; any fundamental DC Motor
different AI and example acknowledgment systems. The will have two leads that can be legitimately joined to a battery
fundamental calculations in the writing are DTW (dynamic or power supply of adequate limit. The side of the engine that
time traveling)- based methodology [17,18,20] and HMM is associated with the positive of the power source will figure
(concealed Markov model) - based methodology [1,5,6,7,24]. out what direction the engine rotates.[9]
The two arrangements of calculations process the increasing
speed information in the time area. (Wu, Zhang, and Pan, B. Working process of solar panel: The solar panel power
2019) system is one of the main focal points in this project. To make
the system in such a way that consumes less electricity. When
a person moves outside with a wheelchair the solar panel starts
III. BASIC COMPONENTS REQUIRED to work automatically. So when the solar panel comes across
The components needed for the project to be completed is to the sunlight it will start charging a storage battery.
given below: Photovoltaic is the main thing in a solar panel system that
12V battery, Gear Motor, BTS7960 Motor Driver, Arduino converts solar energy into electricity. Photovoltaic cells
Mega 2560, Bluetooth Module HC-06, Accelerometer produce a direct current or DC energy but a single
(MPU6050), Arduino Nano, Monolithic 20-Watt Solar Panel, photovoltaic cell is not enough to produce much electricity for
Distance Measuring Sensor, Jumper wires and Cables, the wheelchair. For such reason a module of a photovoltaic
Wheel Structure Components: Hollow cube metal rod, Bicycle cell to get enough energy. This module of a photovoltaic cell
wheels, Chain, Motor Plate. is a solar panel. The solar panel cell is a semiconductor
device. It works as a PN junction diode. An internal electric
IV. METHODOLOGY field is made by the semi-conducting materials in photovoltaic
cells and these cells are doped to form P-N structure. The p-
This wheelchair will use renewable energy resources such as type material has the propensity to give up electrons and
the solar panel to power up the motors and charge the obtain holes. On the other hand, the n-type material accepts
batteries. There are two special features for different types of electrons. When the cells are come across to the sunlight, the
disabled people who can use gesture control and the voice photons in the light release some electrons in semi-conductor
recognition method for the movement of the wheelchair. In to become electron-hole pair.
addition to the movement in case of emergency or any At the stage where light reaches the p-n junction, light photons
obstacle found in front of the wheelchair, the wheelchair can can pass through the meager p-type layer without much of a
immediately stop moving. And the methods of the individual stretch in the junction. Like photons, the light vitality provides
features are split into several parts in detail. the intersection with sufficient vitality to create different
electron-gap sets. The episode light breaks the intersection's
A. Working process of Gesture Device Accelerometer: hot equilibrium status. The free electrons in the district of
An accelerometer is an electromechanical gadget used to exhaustion can quickly go to the intersection's n-type side.
quantify speeding up powers. An accelerator resembles a basic Thus, the consumption openings can quickly go to the
circuit for some bigger electronic gadgets. intersection's p-type side. Once the newly made free electrons
The capacitance accelerometer detects changes in capacitance go to the side of the n-type, they cannot cross the intersection
between microstructures situated in the gadget. In the event further due to the intersection's obstruction capacity. Also, the
that an accelerative power moves one of these structures, the recent gaps once they go to the p-type side can't cross the
capacitance will change and the accelerometer will make an intersection any further was the destiny of the intersection's
interpretation of that capacitance to voltage for elucidation. same hindrance capacity. [10]
Increasing speed of Gravity in X Direction: Hold the board so
the board faces you and the line to one side of the chip is C. Working process of Distance Measuring Sensor:
adjusted vertically to the table. The speeding up of gravity is The IR distance measuring sensor has been used to detect the
static on the grounds that the chip is stationary. distance of any obstacles. An IR separation sensor utilizes a
In the resultant [1x3] vector, the main worth that speaks to the light emission light to reflect off an article to quantify its
speeding up at the X-pivot ≈1 g (9.81 m/s2). The last two separation. The separation is determined by utilizing the
qualities that speak to the speeding up at the Y and Z triangulation of the light emission. The sensor comprises an IR
tomahawks (opposite to the increasing speed of earth gravity) LED and a light identifier or PSD (Position Sensing Device).
≈ 0.00 g. At the point when the light emission gets reflected by an item,
the reflected bar will arrive at the light locator and an 'optical
spot' will frame on the PSD. Right when the circumstance of
the article changes, the edge of the reflected shaft and the
circumstance of the spot on the PSD changes moreover. The We have learned all the features and after merging together to
sensor has a worked in signal preparing circuit. This circuit achieve a proper plan diagram. The Methodology or the plan
forms the situation of the optical spot on the PSD to decide the diagram is given below:
position (separation) of the intelligent item. It yields a simple
sign which relies upon the situation of the article before the
sensor. Here Sharp GP2Y0A21YK0F has been used and the
Sharp GP2Y0A21YK0F distance measuring sensor is a 3-stick
module, whose stick names are Vcc, IRPin(V0) and Ground
separately. IR separation sensors yield a simple sign, which
changes relying upon the separation between the sensor and an Accelerometer

article. Voice Control


App

Theoretically, Switch

Distance (cm) = 27.726 *POW (Output voltage, —1.2045)


Obstacle Switch AC/
Detection
Results: For Distance (minimum) > 10cm DC

Accelerometer Accelerometer
The best partition assessed
Accelerometer Voiceis constrained for this sensor by
Control Voice Control
two points of view: theVoiceproportion App
Control of reflected light is Arduino Mega App

lessening and disappointment Appof the PSD selecting the little

changes of the territory of the reflected bar. When evaluating


objects
Switch which are unnecessarily far, the yield stays around Switch
proportionate
Switch to it is while assessing the articles at the most Motor Driver
BTS 7960

outrageous partition. Least partition is restricted in view of the


idiosyncrasy
Obstacle
Detection
of Sharp
Switchsensors,
AC/ which implies the yield starts to Obstacle
Detection
Switch AC/
DC Charge BatteryDC
decrease
Obstacle
Detection
(again) strongly
Switch AC/ as the detachment is at a certain
DC
point (dependent upon the model 4-20 cm). This infers one
estimation of the yield analyzes two estimations of
detachment. This issue can be kept up a key good way from
Arduino Mega Motor Arduino Mega

seeing that the article doesn't unnecessarily approach the


Arduino Mega

sensor. [11]

D. Voice control via the app:


Motor Driver Motor Driver Solar Panel
AC Current

At the point when we control the voice, the main term to be


BTS 7960
Motor Driver
BTS 7960

considered in discourse acknowledgment is where the


BTS 7960
Wheel Control
framework comprehends the words given through discourse.
Charge Battery Charge Battery
The fundamental point of this undertaking is to control the
Charge Battery
wheelchair through the human voice. This venture is for the
most part utilized for physically tested individuals who are
subject toMotora wheelchair and particularly those people who Motor

control utilize
Motor
their hands to drag their wheelchair in view of
some incapacity. In this framework, we have utilized the voice
acknowledgment module to perceive the voice of the client for
controlling the bearing of the wheelchair. The progression of
AC Current AC Current
utilized in this venture is to control home apparatuses by
Solar Panel
AC Current
Solar Panel

utilizing voice order toSolarthis Panel task can likewise fill in as a home

robotization framework.
Wheel Control
For home mechanization, the Wheel Control

transmitter circuitWheelisControl
available at the wheelchair and the
accepting circuit is available at the switchboard. The direction Figure 3: Overall Methodology and Plan Diagram
was set in the Arduino board. The home machines can be
constrained by two techniques, by giving voice directions or
by utilizing versatile as a remote controller.[12]
V. PROTOTYPE address of the slave module with the master module. After
Our examination empowered us to reason that albeit a few completing the configuration, the circuit must be designed to
Intelligent Wheelchair models are being created in an place the Master Bluetooth module, MPU 6050 and Arduino
enormous number of research ventures, far and wide, the Nano connecting it properly to send signals to the receiver end
adjustment of their UI to the patient is a frequently ignored for controlling the motion of the wheelchair. Below the circuit
research point. In this way, ventures targeting growing new design is given for the hand gesture system.
ideas of Intelligent Wheelchairs are required utilizing
multimodal interfaces and wheelchair interfaces adjusted to
the client attributes. Keeping in concern about the costing and
other additional features we have designed a wheelchair that is
fully made up of metal. We have built a wheelchair from
scratch. We have used the bicycle tire to lift the chair. Four
small rotatable wheels are added to balance the wheelchair
from collapsing. Below we have given the basic prototype of
the wheelchair.

Figure 5: Circuit of the Hand gesture System that includes MPU6050, Master
Bluetooth Module HC-06 and Arduino Nano. [13]

After completing the Transmitter end, we move forward to the


Receiver end. The receiver ends do most of the work. It
receives a signal and gives instructions to the motor to rotate
in the preferred direction. The overall circuit of the Receiver
side is given below.

Figure 4: Prototype of the Wheelchair

In this Wheelchair, we had to implement the basic circuit


design of the Gesture control (which is known as the
transmitter end) and this circuit includes the MPU6050,
Bluetooth module HC-06, Arduino nano and a small battery
(power source). Before initializing the source code at the
transmitter end, we need to configure the Master-Slave
Bluetooth module. There are codes online to configure the
Master Bluetooth module (transmitter end) and the Slave
Bluetooth module (receiver end) to receive data sent by the
transmitter end from the hand. Configuring a Bluetooth
module, you need to get inside the AT command mode line to
get the address of the Slave Bluetooth module. Moreover, you
need to set transmission rate for signals (data) to be
transmitted wirelessly. By following the same procedure, we
need to configure the Master Bluetooth module and bind the
Figure 7: Transmitter side of the hand gesture

Accordingly with the tilting of the transmitter side, in


forwarding direction enables the wheel to move forward. And
tilting the device(transmitter side of hand gesture) in back
position enables the wheel to move in back direction.

Figure 6: Receiver End containing Arduino Mega 2560, Slave Bluetooth


Module, BTS 7960 Motor Driver, Motors, Sharp Distance Sensor, Solar Panel
and 12V Battery Source. [13]

VI. RESULT ANALYSIS


The last finished model is a wheelchair with the intention of
decreasing the movement troubles for handicapped
individuals. The result analysis is shown below:

A. Hand Gesture Working:


There are two Bluetooth modules in hand gesture to transmit
and receive data wirelessly. One is known as a master module
and the other one is known as a slave module. When the
master module gives the command, the slave module receives
the command and executes. We have to pair and bind the
Figure 8: Wheelchair with the connection
modules for master and slave among those two HC06 of all the receiver end devices.
Bluetooth modules. After that we upload the codes to
transmitter end to the Arduino Nano.
B. Solar Panel working:
The solar panel has also been integrated into the wheelchair.
Which is placed in the backside of the wheelchair.
passed through the phone will execute the motor for the
required movement. A picture below indicates the voice
working with the given commands.

Figure 9: Solar panel integrated at the


the backside of the wheelchair.
Figure 10: Wheelchair movement with the given command “forward”.
The solar that we have integrated is a 20Watt monolithic solar
panel.
Thoratically,

Total battery power = 60 Watt per hour


Solar supply power = 20 Watt per hour
Time required on average to charge
Battery(hour) = 60 watt / 20 watt = 3 Hours

On average with very bright sunlight the minimum time


required to charge the battery is 3 hours. With the current
supply 1.12 A and voltage supply 17.3 V. With this supply of
voltage, it is possible to supply power to the Arduino mega
constantly and to the BTS7960 driver and provide charge to
the battery. As the battery is 24 V, we are using a power
booster charger to increase the supply of the voltage to meet
the requirement of the battery source.

C. Voice App Working:


Over here we have used the same source code and just set
string command fixed for receiver end.
Figure 11: The voice app User interface and command passed forward
Practically, “forward”.

Forward movement = “forward” D. Obstacle detection working:


Backward movement = “back” The Sharp distance sensor is integrated at the front side of the
Left side rotate 90 degree = “let” wheelchair. The distance sensor uses the formula that has been
Left side rotate 90 degree = “right” provided in the Methodology section. To stop the motor the
Stop movement = “stop” minimum distance should be at least 10 cm. At this distance
the sharp distance sensor receives the obstacle and stops the
Applying these commands over the phone app will send the motor and prevents any kind of collision.
command over Bluetooth. So before sending the commands
the phone Bluetooth must be paired with Slave Bluetooth
Module (HC-06) and to get connected to the app. The app VII. CONCLUSION
must be opened and then by searching the module it will be This paper depicts a novel methodology of a wheelchair for
connected automatically. After that the above commands disabled people. People having multiple difficulties can use
this wheelchair easily as it offers hand gestures and voice
control method for the movement of the wheels. This
wheelchair also has a distance measurement sensor which
helps to stop the movement if any immediate threats have
shown up. For reducing the consumption of energy it also has
a solar panel which helps to reduce the charging cost of the
battery. In future GPS can add for live monitoring of the
wheelchair which helps to detect the location of the
wheelchair in case of any emergency.

VIII. REFERENCE
[1] Pipkin, J. (2018). U.Va. Team’s Solar-Powered Wheelchair Wins World
Cerebral Palsy Day Competition. [online] UVA Today. Available at:
https://news.virginia.edu/content/uva-teams-solar-powered-wheelchair-wins-
world-cerebral-palsy-day-competition.
[2] Wu, J., Zhang, D., and Pan, G. (2019). Gesture Recognition with a 3-D
Accelerometer. [online] https://www.researchgate.net. Available
at:https://www.researchgate.net/publication/221601229_Gesture_Recognition
_with_a_3-D_Accelerometer
[3] Ilyas Malik, M., Bashir, T. and Farooq Khan, M. (2019). [online]
Ijcsmc.com. Available at:
https://www.ijcsmc.com/docs/papers/June2017/V6I6201776.pdf
[4] Joshi, K., Ranjan, R. and Sravya, E. (2019). Design of Voice-Controlled
Smart Wheelchair for Physically Challenged Persons: Proceedings of IEMIS
2018, Volume 3. https://www.researchgate.net.
[5] YATNALLI, M., M., M. and M., M. (2019). GESTURE BASED
WHEELCHAIR CONTROL USING KINECT CAMERA. [online]
Kscst.iisc.ernet.in. Available at:
http://www.kscst.iisc.ernet.in/spp/40_series/SPP40S/02_Exhibition_Projects/1
63_40S_BE_2158.pdf [Accessed 25 Aug. 2019].
[6] Balderas, D. and Rojas, M. (2016). Human Movement
Control. Automation and Control Trends. [online] Available at:
https://www.intechopen.com/books/automation-and-control-trends/human-
movement-control
[7] Pipkin, J. (2018). U.Va. Team’s Solar-Powered Wheelchair Wins World
Cerebral Palsy Day Competition. [online] UVA Today. Available at:
https://news.virginia.edu/content/uva-teams-solar-powered-wheelchair-wins-
world-cerebral-palsy-day-competition.
[8] Wu, J., Zhang, D., and Pan, G. (2019). Gesture Recognition with a 3-D
Accelerometer. [online] https://www.researchgate.net. Available at:
https://www.researchgate.net/publication/221601229_Gesture_Recognition_w
ith_a_3-D_Accelerometer

[9] HowToMechatronics (2019). Arduino and MPU6050 Accelerometer and


Gyroscope Tutorial - HowToMechatronics. [online] HowToMechatronics.
Available at: https://howtomechatronics.com/tutorials/arduino/arduino-and-
mpu6050-accelerometer-and-gyroscope-tutorial/
[10] Richardson, L. (2018). How do solar panels work? [online] Solar News.
Available at: https://news.energysage.com/solar-panels-work/.
[‌ 11] Benne de Bakker (2019). How to use SHARP IR Distance Sensor with
Arduino (GP2Y0A710K0F). [online] Makerguides.com. Available at:
https://www.makerguides.com/sharp-gp2y0a710k0f-ir-distance-sensor-
arduino-tutorial/
[12] Instructables. (2019). Voice Activated Arduino (Bluetooth + Android).
[online] Available at: https://www.instructables.com/id/Voice-Activated-
Arduino-Bluetooth-Android/ [Accessed 24 Nov. 2019].
[13] Fritzing.org. (2016). Fritzing. [online] Available at:
https://fritzing.org/home/ [Accessed 24 Nov. 2019].

You might also like