HAND ASSISTIVE DEVICE FOR DEAF AND DUMB PEOPLE

A MINOR PROJECT REPORT

Submitted by

LOKESHNATH M (927621BME029)
MALARAVAN (927621BME033)
MANOOJ M S (927621BME034)

in partial fulfillment for the award of the degree

of

BACHELOR OF ENGINEERING

IN

MECHANICAL ENGINEERING

M.KUMARASAMY COLLEGE OF ENGINEERING, KARUR

ANNA UNIVERSITY: CHENNAI 600 025

DEC 2022
 M.KUMARSAMY COLLEGE OF ENGINEERING , KARUR
( Anna university affiliated Autonomous college)
BONAFIDE CERTIFICATE

Certified that this project report “HAND ASSISTIVE DEVICE FOR DEAF ANF DUMB
PEOPLE” is bonafide Work of LOKESHNATH M (927621BME029), MALARAVAN S
(927621BME033), MANOOJ M S (927621BME034) who carried out the project work during the academic
year2022 – 2023 under my supervision. Certified further, that to the best of my knowledgethe work reported herein
does not form part of any other project report or dissertationon the basis of which a degree or award was conferred on
an earlier occasion on this or any other candidate.

SIGNATURE SIGNATURE

DR.M.MOHANPRASAD M.E,MBA,Ph.D DR.S.PADMAVATHY M.E,MBA,Ph.D.

SUPERVISOR HEAD OF THE DEPARTMENT

Department of Mechanical Engineering, Department of Mechanical Engineering,

M.Kumarasamy College of Engineering, M.Kumarasamy College of Engineering,

Thalavapalayam, Karur-639113 Thalavapalayam, Karur-639113

This project report has been submitted for the end semester project viva voce
Examination held on
 DECLARATION

We affirm that the Project titled “HAND ASSISTIVE DEVICE FOR DEAF AND
DUMB PEOPLE” being submitted in partial fulfillment of for the award of Bachelor of Engineering
in Mechanical Engineering, is the original work carried out by us. It has not formed the part of any other
project or dissertation on the basis ofwhich a degree or award was conferred on an earlier occasion on
this or any other candidate.

Student name Signature

1 LOKESHNATH M (927621BME029)

2 MALARAVAN S (927621BME033)

3 MANOOJ M S (927621BME034)

Name and signature of the supervisor with date

 ACKNOWLEDGEMENT

Our sincere thanks to Chairman Thiru.M.Kumarasamy, and Secretary Dr.K.

Ramakrishnan, of M.Kumarasamy College of Engineering for providing extra
ordinary infrastructure, which helped us to complete the project in time.

It is a great privilege for us to express our gratitude to our esteemed Principal

Dr.N. Ramesh Babu M.E, Ph.D for providing us right ambiance for carrying out the
project work.

We would like to thank Dr.M. Mohanprasad M.E,MBA,Ph.D Professor and

Head, Department of Mechanical Engineering, for their unwavering moral support
throughout the evolution of the project.

We offer our whole hearted thanks to our internal guide

Senior Assistant Professor, Dr.S. Padmavathy M.E,MBA,Ph.D Department of
MechanicalEngineering, for his constant encouragement, kind co-operation, valuable
suggestionsand support rendered in making our project a success.

We offer our whole hearted thanks to Mr.S. Saravanakumar M.E, our project
coordinator, Department of Mechanical Engineering, for his constant
encouragement, kind co-operation, valuable suggestions and support rendered in
making our project a success.

We glad to thank all the Teaching and Non teaching Faculty Members of
Department of Mechanical Engineering for extending a warm helping hand and
valuable suggestions throughout the project.

Words are boundless to thank Our Parents and Friends for their constant
encouragement to complete this project successfully.
 INSTITUTION VISION & MISSION
Vision
❖ To emerge as a leader among the top institutions in the field of technical
education.
❖ Produce smart technocrats with empirical knowledge who can surmount the
global challenges.

Mission

❖ Create a diverse, fully-engaged, learner-centric campus environment to

provide quality education to the students.
❖ Maintain mutually beneficial partnerships with our alumni, industry and
professional associations.

DEPARTMENT VISION, MISSION, PEO, PO & PSO

Vision
❖ To create globally recognized competent Mechanical engineers to work in multicultural
environment.

Mission
❖ To impart quality education in the field of mechanical engineering and to enhance their
skills, to pursue careers or enter into higher education in their area of interest.
❖ To establish a learner-centric atmosphere along with state-of-the-art research facility.
❖ To make collaboration with industries, distinguished research institution and to become a
centre of excellence

PROGRAM EDUCATIONAL OBJECTIVES (PEOS)

The graduates of Mechanical Engineering will be able to
❖ PEO1: Graduates of the program will accommodate insightful information of
engineering principles necessary for the applications of engineering.
❖ PEO2: Graduates of the program will acquire knowledge of recent trends in technology
and solve problem in industry.
❖ PEO3: Graduates of the program will have practical experience and interpersonal skills
to work both in local and international environments.
❖ PEO4: Graduates of the program will possess creative professionalism, understand
their ethical responsibility and committed towards society.
 PROGRAM OUTCOMES
The following are the Program Outcomes of Engineering Graduates:
Engineering Graduates will be able to:

1. Engineering knowledge: Apply the knowledge of mathematics, science, engineering

fundamentals, and an engineering specialization to the solution of complex engineering
problems.
2. Problem analysis: Identify, formulate, review research literature, and analyze complex
engineering problems reaching substantiated conclusions using first principles of
mathematics, natural sciences, and engineering sciences.
3. Design/development of solutions: Design solutions for complex engineering problems
and design system components or processes that meet the specified needs with appropriate
consideration for the public health and safety, and the cultural, societal, and
environmental considerations.
4. Conduct investigations of complex problems: Use research-based knowledge and
research methods including design of experiments, analysis and interpretation of data, and
synthesis of the information to provide valid conclusions.
5. Modern tool usage: Create, select, and apply appropriate techniques, resources, and
modern engineering and IT tools including prediction and modeling to complex
engineering activities with an understanding of the limitations.
6. The engineer and society: Apply reasoning informed by the contextual knowledge to
assess societal, health, safety, legal and cultural issues and the consequent responsibilities
relevant to the professional engineering practice.
7. Environment and sustainability: Understand the impact of the professional engineering
solutions in societal and environmental contexts, and demonstrate the knowledge of, and
need for sustainable development.
8. Ethics: Apply ethical principles and commit to professional ethics and responsibilities
and norms of the engineering practice.
9. Individual and team work: Function effectively as an individual, and as a member or
leader in diverse teams, and in multidisciplinary settings.
10. Communication: Communicate effectively on complex engineering activities with the
engineering community and with society at large, such as, being able to comprehend and
write effective reports and design documentation, make effective presentations, and give
and receive clear instructions.
11. Project management and finance: Demonstrate knowledge and understanding of the
engineering and management principles and apply these to one’s own work, as a member
and leader in a team, to manage projects and in multidisciplinary environments.
12. Life-long learning: Recognize the need for, and have the preparation and ability to
engage in independent and life-long learning in the broadest context of technological
change.
 PROGRAM SPECIFIC OUTCOMES (PSOs)
The following are the Program Specific Outcomes of Engineering Graduates:
The students will demonstrate the abilities
Real world application: To comprehend, analyze, design and develop innovative products and provide solutions
for the real-life problems.
Multi-disciplinary areas: To work collaboratively on multi-disciplinary areas and make quality projects.
Research oriented innovative ideas and methods: To adopt modern tools, mathematical, scientific and
engineering fundamentals required to solve industrial and societal problems.
BLO
COURSE
C OMS P P P P P P P P P P PO PO PSO1 PSO2 PSO
STATEMEN
O LEV O O O O O O O O O O 11 12 3
T
EL 1 2 3 4 5 6 7 8 9 10
identify a real
world
problem,
1 the requirement K4 3 3 3 3 3 3 3 2 3 3 2 2 2 2 2
and develop the
design
solutions.
Identify technical
2 ideas,
strategies and K4 3 3 3 3 3 3 3 2 3 3 2 2 3 2 2
methodologies
.
Utilize the new
tools,
algorithms,
3 techniques K4 3 3 3 3 3 3 3 2 3 3 2 2 3 2 2
that contribute to
obtain the
solution of the
project.
Test and validate
through
conformance
of the 3 1 - - 2 1 1 2 3 3 2 2 - - -
4 developed K4
prototype and
analysis the cost-
effectiveness.
Prepare report and
present oral
5 demonstration K5 3 - - 2 1 - 2
3 3 2 2 -- -- --
s

PROGRAM 3 2. 3 3 2.6 2.2 2.5 2 3 3 2 2 2.6 2 2

OUTCOMES 5
 ABSTRACT

Micro controller based speaking system for deaf and dumb is designed to give
the signs, which are preloaded in the device. It is a micro controller based device,
which gives the alert sounds just by pressing the control buttons, which are given
some redefined messages like asking for water, washroom etc., here the person
can just press the control button which indicates the sign of water (example) then
the device sounds the same with some output volume. Micro controller is the
heart of the device. It stores the data of the needs of the person. So that it can
make use of the data stored whenever the person uses the device. This device
helps the deaf and dumb people to announce their requirements. By this the
person who is near can understand their need and help them. This saves the time
to understand each other and ease in communication.

viii
 TABLE OF CONTENTS

CHAPTER CONTENTS PAGE

NO NO
ABSTRACT VIII
LIST OF FIGURES XI
LIST OF TABLES XII
01 INTRODUCTION 01
1.1 Description

02 LITERATURE REVIEW 03
03 PARAMETERS TO BE ANALYSED 05
3.1 Cost
3.2 Processing Power
3.3 Memory
3.4 Temperature Tolerance
3.5 Hardware Interference
3.6 Hardware Architecture
04 DETAILS ABOUT THE PROJECT 06
4.1 Purpose
4.2 Significance
4.3 Limitations

05 COMPONENTS DESCRIPTION 07
5.1 8051 Series Microcontroller 07
5.2 Accelerometers 07
5.3 Voice Recording Module 08
5.4 Relay Module
5.5 LCD
06 WORKING PRINCIPLE 09
6.1 Methodology 09
6.2 Block diagram 10

ix
07 CODING ANALYSIS 12
08 RESULT 15
8.1 Graphical Result Analysis 15

8.2 Expected Result

09 CONCLUSION 20
10 REFERENCES 21

x
 LIST OF FIGURES

FIGURE TITLE PAGE

NO NO
5.1 8051 Series Microcontroller 07
5.2 Accelerometers 07
5.3 Voice Recording Module 08
5.4 Relay Module 09
5.5 LCD 10
6.1 Methodology 11
6.2 Block Diagram 12
7.1 Compiler 13

xi
 LIST OF TABLES

TABLE TITLE PAGE

NO NO
5.1 Pin Name and its Description 13

8.1 Result of the Project

xii
 CHAPTER 1
INTRODUCTION

India is multilingual society and many of its population lives in villages they are
not aware of these sing languages. Similarly, a large proportion are speech
disabled or Dumb people. The problems encountered by both deaf and dumb is
tremendous by both deaf and dumb is tremendous as far as communication is
concerned. Dumb people can communicate only through the use of sign
conventions or with the help of interpreters. The difficult with sing languages is
that the normal person might not know the sign language at all and hence the
communication between the deaf and dumb people can become impossible in
such scenario. Thus, in order to make them self-reliant and give them the
freedom to communicate with normal people without the use of interpreters can
be made possible by developing a system which helps them communicate
directly with the normal person without any interruptions and thereby expressing
their feelings and emotions. It is a micro controller based device, which gives the
alert sounds just by pressing the control buttons, which are given some redefined
messages like asking for water, washroom etc., here the person can just press the
control button which indicates the sign of water (example) then the device
sounds the same with some output volume. Micro controller is the heart of the
device. It stores the data of the needs of the person. So that it can make use of
the data stored whenever the person uses the device. This device helps the deaf
and dumb people to announce their requirements. By this the person who is near
can understand their need and help them. This saves the time to understand each
other and ease in communication his device is designed to provide with a greater
advantage producing voice based announcement for the user i.e. the user gets the
voice which pronounces his need as and when it is required.

1
 1.1 Description

In our country around 2.78% people are not able to speak properly.
Such people find it difficult to communicate with other people.
They sense a gap of communication while interacting with other people,
due to which they are not able to express their emotions and feelings openly.
So the proposed idea is to develop a device called as hand assistive
system for deaf and dumb people.
This project tries to solve various problems faced by deaf and dumb people.
The main idea of this project is to somehow reduce the barrier of communication
between deaf-dumb and normal people.
To minimize this barrier, the proposed device converts their hand gestures into
voice which a normal person can understand.
This device consists of gloves, flex sensors, accelerometer sensors,
microcontroller, voice module and 16x16 LCD display.
The voice module will basically convert the gestures into real time speech output
and display will give text for corresponding gesture.
So, this device provides an efficient way of communication for both deaf-dumb
and normal people.
the person can just press the control button which indicates the sign of needing
things then the device sounds the same with some output volume. Micro controller
is the heart of the device.
It stores the data of the needs of the person.
So that it can make use of the data stored whenever the person uses the device.

2
 CHAPTER 2
LITERATURE REVIEW
While much research has been conducted on Hand Assistive Device, not
so many studies have investigated the role of Speaking Gadget with
Microcontroller .
K.NaveenKumar,P.Surendranath&K.Shekar[1] :This paper work
focuses on finding a technique that aids the visually impaired by letting them
hear what is represented as text, This paper also provides a way for the people
with Hearing impairment to read which is in audio form by speech to text and
we also provides a way for the vocally impaired to represent their voice by the
aid of text to voice. All these solution were modulated in single system using
prevailed 2005, 3 boys UN agency have passed the examination wasn't
appointment as IAS officers simply because they're deaf. This should not
continue. They face several issues in their day to day life like transportation,
Communication, level of dependency, social stigma and lots of things. The
terribly initial drawback is suppression of Deaf individuals raising voice for his
or raspberry-pi. The keywords used in this project are Raspberry-pi, Assistive
device, Tesseract Optical Character Recognition OCR speak, Open CV, Google
API. The advantage is that the device can be taken away easily and is of loss
weight.
SunitaV.Matiwade,Dr.M.R.Dixit[2] : This paper aimed to growing an
digital support device which could translate sign language into text and speech
so that it will make the communiqué take place among the mute groups with the
overall public. The keywords used in this challenge are Hand Gloves, signal
language, flex Sensor,ARM7TDMI, LM386, voice section. This undertaking
have recognized hand gesture of sign language for alphabet A to Z with logic
levels as per price of flex sensor. This machine is used for verbal exchange
between deaf and dumb people with regular person.
Piyush Patil, Jayesh Prajapat[3] : This paper is to make bigger an
advanced technique of verbal exchange for deaf human beings with the assist of
IOT .This gadget could make right use of recent technology that is based totally
on Embedded Linux board named Raspberry Pi with an brought advanced
function of changing speech to text in Real Time. Normal character will speak
into raspberry pi device and it will stumble upon the sound using speech
reputation module. After that the Speech will be transformed into textual content
and sent to the deaf character's Mobile Application by the usage of Wi-Fi,
Bluetooth or Cloud Server according to the situation.
3
 Anish Kumar,Rakesh Raushan,Saurabh Aditya,Vishal Kumar
Jaiswal,Mrs. Divyashree Y.V.[4]: This paper provide a method for a blind man
or woman to study a text and it can be carried out through shooting an
photograph via a camera which converts a textual content to speech (TTS). It
presents a way for the deaf human beings to read a text by using speech to
textual content(STT) conversion technology. Also, it gives a method for dumb
people using textual content to voice conversion. The gadget is provided with
four switches and every switch has a specific function. The blind people can be
capable of examine the words using by Tesseract OCR (Online Character
Recognition), the dumb people can speak their message through textual content
with the intention to be examine out by way of speak, the deaf human beings can
be able to listen others speech from text. All these functions are implemented
with the aid of the use of Raspberry Pi. The keywords used for this challenge are
Raspberry Pi, Tesseract OCR(Online Character Recognition), speak, Speech to
text (STT),Text to Speech (TTS).

Kanwal Yousaf , Zahid Mehmood, TanzilaSaba , AmjadRehman ,

Muhammad Rashid , Muhammad Altaf ,and Zhang Shuguang[5] : The
proposed software, named as vocalizer to mute (V2M), uses computerized
speech recognition (ASR) method The hidden Markov model toolkit (HTK) is
used for the process of speech recognition. The software is likewise incorporated
with a 3D avatar for imparting visualization support. To recognize the speech of
Deaf-mute and convert it right into a recognizable shape of speech for a ordinary
person. The quantitative and qualitative analysis of consequences also found out
that face-to-face socialization of Deaf-mute is progressed by the intervention of
mobile technology. The participants also suggested that the proposed mobile
software can act as a voice for them and they can socialize with pals and family
by way of using this app.

4
 CHAPTER 3
PARAMETERS TO BE ANALYSED
To analyze the main component of the Project :
Which is Microcontroller (MCU)

A microcontroller (MCU), is the smallest and most basic computer.

Running on a single chip, it has a CPU, memories (RAM and ROM), and
interfaces (input/output ports) for additions like video, audio, USB, and
cameras. Unlike a microprocessor, which serves more generalized
applications, a microcontroller aims at more specific applications.

Cost : Microcontrollers fall within a wide price range, from a hundred

units for a few rupees to a few rupees per unit. If you want to scale, you
need to consider the overall cost versus the individual performance power
of a microcontroller.
Processing Power : A multicore processor will be significantly faster,
but it will also consume more energy. Also, will a graphics processing
unit (GPU) be necessary.
Memory : The amount of memory (RAM and ROM) you need will
depend on the programs you will be running. More programs need more
random access memory (RAM). In addition, a GPU will require not only
more RAM but faster read/write time as well.
Temperature tolerance : Depending on the environment in which your
microcontrollers operate, you may want devices that withstand extreme
temperature. There will be a trade-off between temperature tolerance and
cost.
Hardware interface : The nature of the task will dictate the need for
hardware interfaces such as USB, Wi-Fi, Bluetooth, audio, video, or
camera.
Hardware architecture : A microcontroller’s packaging directly
influences its size and performance. Dual in-line packaging is the most
common type. Small-outline transistors have a small footprint, and quad
flat packs take up more areas but less vertical space.
5
 CHAPTER 4
DETAILS OF THE PROJECT

4.1 PURPOSE OF THE PROJECT

The wireless control is achieved using a single RF transmitter module
in the glove that interfaces with multiple RF receivers.
A fabric Microcontroller is fixed into the board. A GSM module
is used for sending predefined messages to registered contacts.
With the help of this, a mute person can easily answer.

4.2 SIGNIFICANCE OF THE PROJECT

To minimize this barrier, the proposed device converts their hand
gestures into voice which a normal person can understand.
This device consists of flex sensors, accelerometer sensors,
microcontroller, voice module and 16x16 LCD display.
The voice module will basically convert the gestured into real time
speech output and display will give text for corresponding gesture.
So, this device provides an efficient way for communication for
both deaf-dumb and normal people.

4.3 LIMITATION OF THE PROJECT

There is lot of chances to occur a message when signal of the hand
Is made unnecessarily. It won’t be as much durable for a long working
hours. The range of the signal is so weak ,so that the owner should
avail near the hand assistive device. The size of the speaker in
not portable for many places like walking,jogging it would be
interrupt for the owner.

6
 CHAPTER 5
COMPONENTS DESCRIPTION

5.1 8051 Series Microcontroller

➢ Compatible with MCS®-51 Products

➢ 8K Bytes of In-System Programmable (ISP) Flash Memory
➢ 4.0V to 5.5V Operating Range
➢ Crystal Frequency 11.0592MHZ
➢ Three-level Program Memory Lock
➢ 256 x 8-bit Internal RAM
➢ 32 Programmable I/O Lines
➢ Three 16-bit Timer/Counters
➢ Eight Interrupt Sources
➢ Full Duplex UART Serial Channel
➢ Watchdog Timer

FIG 5.1(a) 8051 Microcontroller FIG 5.2(a)Microcontroller Pin Diagram

7
5.2 Accelerometers
➢ A linear acceleration full-scale of ±2 g / ±4 g / ±8 g
➢ Fully selectable by the user
➢ Single-supply operation: 1.8 V to 3.6 V
➢ Measure acceleration with a minimum full-scale range of ±3 g.
➢ Measure the static acceleration of gravity in tilt-sensing
applications.
➢ Used in Mobile devices ,Gaming systems ,Disk drive protection,
Image stabilization ,Sports and health devices.
➢ Output Response vs. Orientation to Gravity
➢ However, the spec. and my experiment are inconsistent

FIG 5.2 (a) Accelerometers

FIG 5.2 (b) Accelerometers Block Diagram

8
5.3VOICE RECORDING MODULE

➢ Here the IC APR 33 is used as the voice bank.

➢ The prerecorded messages can be stored in any location.
➢ This can be replayed by selecting the respective signal.
➢ The output of this IC is given to the power amplifier circuit.
➢ The aPR33A specially designed for simple key trigger, user can record and
playback the message averagely for 1, 2, 4 or 8 voice message(s) by switch, It is
suitable in simple interface or need to limit the length of single message.
➢ Another heart of the circuit is IC LM386, which is pre amplifier IC.
➢ Input Signal is given through 10K volume control Preset.
➢ By changing the wiper position of volume control we can very the volume.
➢ Some passive components are used to reduce the invocated noise.
➢ The amplified output is available at speaker.

FIG 5.3 (a) Voice Recording Module FIG 5.3 (b) Voice Recording Module Pin Diagram

9
 Table 5.1 Pin Name and its Description

VDDP, VDD, VDDA, VDDL - Positive supply

VSSL, VSSP, VSSA - Power ground
VLDO - Internal LDO output
VCORE - Positive power supply for core
VREF - Reference voltage
VCM - Common mode voltage

Features

➢ Operating Voltage Range: 3V ~ 6.5V

➢ Single Chip, High Quality Audio/Voice Recording & Playback Solution No
External ICs Required.
➢ Minimum External Components User Friendly, Easy to Use Operation.
➢ Programming & Development Systems Not Required.
➢ Nonvolatile Flash Memory Technology
➢ No Battery Backup Required External Reset pin.
➢ Powerful Power Management Unit Very Low Standby Current: 1uA
➢ Low Power-Down Current: 15uA
➢ No External OPAMP or BJT Required Easy to PCB layout
➢ Configurable analog interface
➢ Differential-ended MIC pre-amp for Low Noise
➢ High Quality Line Receiver
➢ High Quality Analog to Digital and PWM module
➢ Resolution up to 16-bits
➢ Simple And Direct User Interface
➢ Averagely 1,2,4 or 8 voice messages record & playback
10
 5.4 RELAY MODULE

➢ It Is A Electro Magnetic Switch

➢ Used To Control The Electrical Devices
➢ Copper Core Magnetic Flux Plays Main Role Here
➢ ULN is Relay driver application
➢ The ULN2003 is a monolithic high voltage and high current
Darlington transistor arrays.
➢ It consists of seven NPN Darlington pairs that features high-voltage
outputs with common-cathode clamp diode for switching inductive
loads.
➢ The collector-current rating of a single Darlington pair is 500mA.
➢ The Darlington pairs may be paralleled for higher current capability

FIG 5.4 (a) Relay Module FIG 5.4 (b) Relay Module Pin Diagram

11
 5.5 LIQUID CRYSTAL DISPLAY (LCD)

➢ Most common LCDs connected to the microcontrollers are

16x2 and 20x2 displays.
➢ This means 16 characters per line by 2 lines and 20 characters
per line by 2 lines, respectively.
➢ The standard is referred to as HD44780U, which refers to the
controller chip which receives data from an external source
and communicates directly with the LCD.
➢ If an 8-bit data bus is used the LCD will require 11 data
lines (3 control lines plus the 8 lines for the data bus)
➢ The three control lines are referred to as EN, RS, and RW
➢ EN=Enable (used to tell the LCD that you are sending it
data)
➢ RS=Register Select (When RS is low (0), data is treated as a
command) & (When RS is High(1), data being sent is text
data )
➢ R/W=Read/Write (When RW is low (0), the data written
to the LCD) & (When RW is low (0), the data reading to the
LCD)

FIG 5.5 (a) LCD FIG 5.5 (b) LCD Pin Diagra

12
 CHAPTER 6
WORKING PRINCIPLE
The input is obtained from the flex sensor inputs, which gives different
resistance values based on the angle of bending of fingers.
This sensor works on the principle of voltage divider.
Based on the range of resistance values obtained from all the fingers,
we are identifying the alphabets by matching it with the above list.
After identifying the alphabet, we are displaying the alphabet
using LCD. The identified alphabet is converted into a voice message
using text to voice converter.

6.1 Methodology

Goal of this project is to create a device that will work on hard gesture
recognition and the data glove would be worn by the deaf and dumb person.

The gestures will undergo signal processing with the use of microcontroller and
the corresponding output would be shown on the LCD display for the deaf
person and via speaker for the dumb person

FIG 6.1 Methodology of the Project

13
 6.2 Block Diagram

FIG 6.2 Block Diagram of the Project

The above block diagram represents the working procedure of the Hand Assistive Device.

14
 CHAPTER 7
CODING ANALYSIS

/************************************************************************************/
//Speaking Microcontroller For Deaf and Dumb - implementing the 4-bit mode LCD interface with 89c51
microcontroller//
/************************************************************************************/

/************* Header Files Declaration ******************************/

#include <at89x51.h>
#include <stdio.h>
#include "LCD_4Bit_data.h"
#include "DELAY.h"

/************ LCD control signals declaration ****************************/

#define RS P2_7 // Register Select line

#define RW P2_6 // Read/write line
#define Enable P2_5 // Enable line

#define LCD_PORT P0 // P0_4 ---->DB4 to P0_7--->DB7 (P0_0 to P0_3 left open)

/**********************/// Port Pin definitions///*********************************/

#define ON 1
#define OFF 0

#define XSelectOut P2_0

#define YSelectOut P2_1

#define Voice1Out P3_0

#define Voice2Out P3_1
#define Voice3Out P3_2
#define Voice4Out P3_3

#define ADC_Wr P2_3

#define ADC_In P1

/************************ Main Funciton declaration ****************************/

//void Read_ADC(unsigned char val);

void CheckXphase();
void CheckYphase();

unsigned char Reading;

15
void main()
{
P0 = 0x00;
P2 = 0x00;
P3 = 0x00;

ADC_In = 0xFF;
ADC_Wr = 1;

Voice1Out = 1;
Voice2Out = 1;
Voice3Out = 1;
Voice4Out = 1;

delayms(100);

/************************** LCD reset Process sequence as per datasheet*************************/

delayms(15); // wait for more than 15ms after supply rises to 4.5V
send_cmd(0x30);
delayms(4); // wait more than 4.1ms
send_cmd(0x30);
delayms(1); // wait more than 100us, but delayms(1) will provide 1ms
send_cmd(0x30);
delayms(1);
send_cmd(0x02); // return to home
delayms(1);

LCD_Init();

send_cmd(0x80); // Force cursor to beginning of 1st line - 1st position, if the number is 0x85 then force
the cursor to 5th position

delayms(1);
send_string(" SPEAKING MCU ");
delayms(1);

send_cmd(0xC0); // Force cursor to beginning of 2nd line - 1st Position

delayms(1);
send_string("FOR DEAF & DUMB"); // displays at second line
delayms(1000);

while(1)
{
Reading = 0;
CheckXphase();

Reading = 0;
CheckYphase();
}

16
void CheckXphase()
{
XSelectOut = ON;
delayms(50);

ADC_Wr = 0;
delayms(1);
ADC_Wr = 1;
Reading = ADC_In;
delayms(50);

send_cmd(0x80); // Force cursor to beginning of 2nd line - 1st Position

delayms(1);
wrt_int(Reading); // displays at second line
delayms(100);

if ((ADC_In > 0xBF)&&(ADC_In < 0xC5))

if ((ADC_In > 0x5E)&&(ADC_In < 0x63))
if ((ADC_In > 0x5E)&&(ADC_In < 0x6A))
{
send_cmd(0x80);
delayms(1);
send_string("Can I have Some");
delayms(1);

send_cmd(0xC0);
delayms(1);
send_string("Drinks...Please!");
delayms(1);

Voice1Out = 0;
Voice2Out = 1;
Voice3Out = 1;
Voice4Out = 1;

delayms(1000);
delayms(1000);
}

else if ((ADC_In > 0xDF)&&(ADC_In < 0xE5))

else if ((ADC_In > 0x3E)&&(ADC_In < 0x4A))
{
send_cmd(0x80);
delayms(1);
send_string("Please Switch ON");
delayms(1);

send_cmd(0xC0);
delayms(1);
send_string("Lights.......Fan");
delayms(1);

Voice1Out = 1;
Voice2Out = 0;
17
 Voice3Out = 1;
Voice4Out = 1;

delayms(1000);
delayms(1000);
}

else
{
send_cmd(0x80);
delayms(1);
send_string(" ");
delayms(1);

send_cmd(0xC0);
delayms(1);
send_string(" ");
delayms(1);

Voice1Out = 1;
Voice2Out = 1;
Voice3Out = 1;
Voice4Out = 1;
}

XSelectOut = OFF;
delayms(50);

void CheckYphase()
{
YSelectOut = ON;
delayms(50);

ADC_Wr = 0;
delayms(1);
ADC_Wr = 1;
Reading = ADC_In;
delayms(50);

send_cmd(0xC9); // Force cursor to beginning of 2nd line - 1st Position

delayms(1);
wrt_int(Reading); // displays at second line
delayms(100);

if ((ADC_In > 0xBF)&&(ADC_In< 0xC5))

if ((ADC_In > 0x5E)&&(ADC_In < 0x6A))
{
send_cmd(0x80);
delayms(1);
send_string("Thank U verymuch");
delayms(1);

send_cmd(0xC0);
18
 delayms(1);
send_string(" Bye! See You ");
delayms(1);

Voice1Out = 1;
Voice2Out = 1;
Voice3Out = 0;
Voice4Out = 1;

delayms(1000);
delayms(1000);
}

else if ((ADC_In > 0xDF)&&(ADC_In < 0xE5))

else if ((ADC_In > 0x3E)&&(ADC_In < 0x4A))
{
send_cmd(0x80);
delayms(1);
send_string("Hai! How are you");
delayms(1);

send_cmd(0xC0);
delayms(1);
send_string(" Please Come ");
delayms(1);

Voice1Out = 1;
Voice2Out = 1;
Voice3Out = 1;
Voice4Out = 0;

delayms(1000);
delayms(1000);
}

else
{
send_cmd(0x80);
delayms(1);
send_string(" ");
delayms(1);

send_cmd(0xC0);
delayms(1);
send_string(" ");
delayms(1);

Voice1Out = 1;
Voice2Out = 1;
Voice3Out = 1;
Voice4Out = 1;
}

YSelectOut = OFF;
delayms(100);}
19
KEIL COMPILER

20
FIG 7.1 Compiler

21
 CHAPTER 8
RESULT

8.1 Graphical Result Analysis

Table 8.1 Result of the Project

22
 8.2 Expected Result

➢ The final system designed is portable since the whole operation is

performed on the microcontroller and it consist of gloves which is used for
gesture recognition.
➢ The flex sensors and accelerometer sensors are connected inside the glove.
➢ In this way, the circuit developed is quite easy and its connection is
relatively simple.
➢ So the disabled person only has to carry the hard glove and the
microcontroller board which is light in weight and consumes low power
upto 5voltes
➢ This device also eliminates the need of the interpreter and also avoids
miscommunication.
➢ Thus, the final system will not be much expensive making it accessible to
every needful person.
➢ With proper planning this system can be used in different organizations.
➢ Different types of sign conventions (ISL OR ASL) can be stored in the
device.

23
 CHAPTER 9

CONCLUSION

➢ In this presentation the role of sign language between normal and

dumb people is seen.
➢ The goal of this project is to design a useful and fully functional real-
world product that efficiently translates the movement of hand to
electrical signals to control the home appliances and perform
functions of a mobile phone. Our motivation is to help differently
abled, speech-impaired and paralyzed people to control the electrical
appliances more easily.
➢ The proposed system has the advantage of low power consumption,
simple hardware and hand gestures, easy to operate and user friendly.
➢ The main feature of this research work is that the gesture recognizer
is a standalone system applicable in daily life and for biomedical
purposes
➢ These device are proposed to make communication between a normal
and a disabled person easier and so that these people can be easily
accepted and heard in the society.
➢ The project can be extended further to make it better for use and also
improve the features and functions as per the needs and demands of
the people.
➢ We can include language translation options, thus its functionality can
be expanded. This assistive technology can also be extended for blind
people since it uses text to speech conversion.
➢ Use of more precise sensors. Implementation of gestures digitally that
are close to the existing sign language. So the user does not need to
learn a new set of actions or signs.

24
 CHAPTER 10
REFERENCES

➢ The 8051 Microcontroller and Embedded systems” by

Muhammad Ali Mazidi and Janice Gillispie Mazidi ,
Pearson Education.
➢ ATMEL 89S52 Data Sheets.
➢ www.atmel.com
➢ www.beyondlogic.org
➢ www.wikipedia.org
➢ www.howstuffworks.com
➢ www.alldatasheets.com
➢ Eriglen Gani , Alda Kika, “Albanian Sign Language
(AlbSL) Number Recognition from Both Hand’s Gestures
Acquired by Kinect Sensors” International Journal of
Advanced Computer Science and Applications, Vol. 7, No.
7, 2016.
➢ Miada A. Almasre, Hana Al-Nuaim, “A Real-Time Letter
Recognition Model for Arabic Sign Language Using Kinect
and Leap Motion Controller v2” International Journal of
Advanced Engineering, Management and Science
(IJAEMS), Vol-2, Issue-5,ISSN: 2454- 1311,May 2016.
➢ Rashmi. B. Hiremath, Ramesh. M. Kagalkar,
“Methodology for Sign Language Video Interpretation in
Hindi Text Language” International Journal of Innovative
Research in Computer and Communication Engineering,
Vol. 4, Issue 5, May 2016. [4] Cao Dong, Ming C.Leu,
Zhaozheng Yin, “ American sign language Alphabet
Recognition Using Microsoft Kinect”, Computer Vision .
25
26