SYSTEM FOR

GESTURE RECOGNITION

Chandan k. yadav (650419)

04/05/2020
OUTLINE OF PRESENTATION
Introduction
Overview
Background
Objectives
Block-diagram
Gesture detection
Speech synthesis
Expected outcome
Gantt chart
Budget estimation
Conclusion
References

04/05/2020
 What is gesture recognition ?
 The identification and recognition of human behaviors
are also the subject of gesture recognition techniques.

Gesture recognition is a large scale multi-

microcontroller based system.

Designed to facilitate the communication among the

dumb, deaf and blind communities and their
communication with the normal people.

04/05/2020
OVERVIEW
• The invention can make dumb people speak, make
disables people operate wheelchair.

• Can facilitate the life of human by providing home-

automation program

It is cost effective since image processing is not used, thus

reducing hardware and hence the cost.

04/05/2020
BACKGROUND
Gesture recognition is a topic in computer science and
language technology with the goal of interpreting
human gestures via mathematical algorithms.

Gesture recognition has been being conducted with

techniques from computer vision and image
processing

04/05/2020
OBJECTIVES
• This invention allows the deaf people to communicate
with the normal human beings

 use of sensors as mainly done through image processing

which has difficulty with the complexity of hardware and
software.

04/05/2020
BLOCKDIAGRAM

04/05/2020
SERIAL INTERFACE IC
 Serial Interface for transmission and reception of serial data at
various baud rates we use TTS256 IC.

 Contains 600 Rules for concatenation of characters and

numbers.

• compatible with the SpeakJet Speech Synthesizer IC.

04/05/2020
SPEAKJET IC

 This little 18 Pin IC is used to add speech and audio.

 It uses a mathematical sound algorithm to control sound

synthesizer to generate sound.

 The SpeakJet is programmed with 72 speech elements,64 bytes

of buffer.

 Control pitch, rate, bend and volume.

04/05/2020
HT6230 REMOTE ENCODER
The HT6230 is designed as remote encoder, usually
applied to TV systems.

Has 96 keys, each with one programmable code.

Used to operate Televisions, video cassette recorder.

04/05/2020
 GESTURE DETECTION
Followed by bend detection.

Bending generates voltage drop which are fed to ADC’s of

microcontroller to convert it into unique codes.

Even a little bend of the finger is detected at this stage of

the system.

 combine the movement of each finger and name it a

particular gesture .

04/05/2020
 Contd……
 In the next step the system checks the data, which was sent by tilt detection
module at port one of the microcontroller.

 The gesture detection module assigns a different 8bit code to each gesture.

 If the gesture is meaningful the system sends an eight bit data to the speech
synthesis module.

04/05/2020
 SPEECH SYNTHESIS
This module of the system is consisted of a microcontroller, a TTS256 IC,
speech synthesizer IC and a speaker.

The function of this module is to produce voice against the respective gesture.

The microcontroller receives the eight bit data from the “bend detection”
module against voltage drop for particular gesture.

Comparing this data with the predefined values the microcontroller comes to
know that which gesture does the hand make.

The last step of the system is to give voice to the each defined gesture.For this
purpose a speech synthesizer IC along with TTs256IC is used.

04/05/2020
EXPECTED OUTCOME
Device is made up of basic electronic components like
IR sensor or flex sensor in order to recognize gesture
which results as a text and voice.

Some specified operation such as remote.

04/05/2020
Gantt chart

04/05/2020
BUDGET ESTIMATION

04/05/2020
 CONCLUSION
This system is useful for dumb, deaf and blind people to
communicate with one another and with the normal people.

The dumb people use their standard sign language which is not
easily understandable by common people and blind people
cannot see their gestures.

This system converts the sign language into voice which is

easily understandable by blind and normal people. The sign
language is translated into some text form, to facilitate the deaf
people as well. This text is display on LCD.
04/05/2020
 REFERENCES
Sushmita Mitra and Tinku Acharya,”Gesture Recognition:
A Survey”, IEEE TRANSACTIONS ON SYSTEMS, MAN,
AND CYBERNETICS.
Pranav Mistry , Paricia Maes , “Wearable Gesture
Interface “ –USPTO Pub.No: US 2010/0199231 A1 (AUG
5 , 2010)
“Gesture recognition technology” by kari bokat
http://seminarprojects.com/s/hand-gesture-recognition-tec
hnology-based-
wireless-surveillance-bomb-diffusing-robo, 12 August
2012
04/05/2020
 THANK YOU

04/05/2020
 QUERY ?

04/05/2020