JANSONS INSTITUTE OF TECHNOLOGY

Department Of Computer Science and Engineering

GESTURE LANGUAGE TRANSLATOR FOR

DUMB AND DEAF PEOPLE-ENABLE TALK
GLOVES
Guided By, Presented By,

Ms.Ashwini.R Najreen A (711120104048)

(Assistant Prof / CSE) Prithiviram M (711120104056)
Sanjiv Roshan R (711120104063)
Santhosh K (711119104065)
 Abstract
 Our project focuses on the design and implementation of a
hardware-based gesture language translator, specifically tailored
to cater to the needs of individuals who are mute or deaf.
 By employing sensors capable of detecting and interpreting hand
gestures, coupled with a robust translation algorithm, the system
aims to translate gestures into spoken or textual language output
in real-time.
Here we have proposed a system to over come this problem.

 Primarily benefit individuals who are both deaf and mute,

allowing them to communicate more easily through gestures. So,
those who face the challenge of being unable to communicate
verbally or through sign language would benefit most from such
technology.
 Introduction
 Our project presents the design and implementation of a hardware-based
gesture language translator aimed at empowering individuals with speech
and hearing impairments to communicate effectively.
 The system utilizes sensor technology, microcontroller programming, and
signal processing algorithms to interpret hand gestures and translate them
into spoken or textual language output.
 Our project aims to contribute to assistive technology solutions that promote
inclusivity and independence for individuals with speech and hearing
impairments. Future enhancements may include multilingual support, online
translation integration, and advanced gesture recognition capabilities,
fostering continued innovation in the field of assistive communication
devices.
 Existing System
 Sign Language Interpreters:
 Pros: Provides direct translation in real-time, allows for
nuanced communication.

 Written Communication:
 Pros: Universally understood, can be used in various
settings.

 Text-to-Speech Devices:
 Pros: Converts typed text into spoken words, can be used
independently.
 Drawbacks
 Availability may be limited, communication may be
delayed, privacy concerns.

 Relies on literacy skills, may not be practical for real-

time interactions, lacks nuance.

 Requires access to technology, may not capture gestures

or non-verbal cues, can be robotic.
 Problem Definition
 The problem arises when someone relies primarily on
spoken language, communication with a deaf or hard-of-
hearing person can be difficult.
 If someone who is deaf or hard of hearing needs help in an
emergency, they may struggle to communicate their needs
or understand instructions if there are no accessible
communication methods available.
 When sign languages aren't recognized or valued as official
languages, it creates disadvantages for those who primarily
use them.
 Merits
 Enable talk gloves include improved communication,
 Gives expression for individuals who are deaf and mute.
 Enhanced inclusivity
 Independence and greater accessibility to social interaction,
education and employment opportunities
Block Diagram
 System Requirements
Hardware Software

 Adriuno  Programming Language

 Flex Sensors used Embedded C
 SD Card Module  Text-to-Speech Software
 Speaker
 Module Split-up
 Module:

 Adriuno
Flex Sensors
SD Card Module
Speaker
Module-1
 Module-1
 The Arduino Uno is a popular microcontroller board
designed for electronics prototyping and
experimentation. It's part of the Arduino family of
boards, which are widely used in various projects, from
simple blinking LED experiments to complex robotics
and automation systems.
 The Arduino Uno is built around the ATmega328P
microcontroller, which is an 8-bit AVR microcontroller
with 32KB of flash memory for program storage, 2KB
of SRAM for data storage, and various digital and
analog input/output pins.
 Module-1

 The Uno has 14 digital input/output pins.

 The microcontroller on the Uno runs at 16 MHz, which

provides the necessary processing power for a wide
range of applications.

 The board can be powered through a USB connection or

an external power source. The recommended input
voltage range is 7-12V, although it can accept up to 20V.
Module-2
 Module-2
 A flex sensor is a type of sensor that changes its
resistance when it is bent or flexed. It's often used to
detect the degree of bending or flexing in various
applications.
 Flex sensors are commonly used in electronic devices,
wearable technology, robotics, and other fields where
monitoring the bending or curvature of an object is
important.
 Flex sensor's resistance changes as it bends or flexes due
to the varying distance between its conductive traces.
This change in resistance is converted into an analog
signal that can be interpreted by electronic circuits to
determine the degree of bending or flexing.
Module-3
 Module-3
 An SD card module is a hardware component designed
to enable microcontrollers or embedded systems to
interact with SD (Secure Digital) cards.
 These cards are commonly used for data storage in
various electronic devices, such as digital cameras,
smartphones, and, in your case, embedded systems.
 The primary functionality of an SD card module
includes an SD card slot, voltage level shifters to ensure
compatibility with the SD card's voltage requirements,
and a communication interface for connecting to a
microcontroller.
Module-4
 Module-4
 The ISD1820 Recording Module Voice Board is the real
easy way to add Voice Recording (and Playback) to your
project.
 The Module can be operated directly by using the 3
Push-Buttons or with every microcontroller (ex.
Arduino).
 A microphone is implemented directly on the board, and
you can connect any 8 Ohm Speaker.
 Your recordings are saved even without power due to
the non-volatile storage on the ISD1820.
 This module uses the ISD1820 voice record and
playback IC to record a single voice message of up to 10
seconds in length.
 SURVEY OF PROBLEMS
 Conducting a survey to understand the challenges individuals
face with enable talk gloves is instrumental in refining their
design and functionality. The survey would delve into various
aspects to pinpoint areas for improvement.
 Firstly, the survey would assess the accuracy of gesture
recognition, probing users on the frequency of misinterpretations
or errors in recognizing sign language gestures. Understanding
the reliability of gesture recognition is pivotal in ensuring
effective communication.
 SURVEY OF PROBLEMS
 Secondly, it would scrutinize the quality of synthesized
speech output. Users would be asked to evaluate the
naturalness and understandability of the speech generated
by the gloves, identifying any areas for enhancement in
speech synthesis technology.
 Ease of use is another crucial aspect to explore. The survey
would gauge users' perceptions regarding the intuitiveness
of the user interface, comfort and fit of the gloves, and
simplicity of the setup process. Feedback on these elements
would inform usability enhancements.
 SURVEY OF PROBLEMS
 Furthermore, the survey would investigate users' satisfaction
with feedback mechanisms provided by the gloves. This
encompasses assessing the clarity of auditory cues, visibility
of visual indicators, and effectiveness of error messages in
guiding users.
 Customization options would also be probed. Users'
preferences regarding settings such as volume, pitch, gesture
sensitivity, and feedback preferences would be assessed to
ensure that the gloves cater to individual needs and
preferences.
 SURVEY OF PROBLEMS
 Compatibility and integration with other devices and
platforms would be scrutinized to identify any
challenges users face in connecting the gloves to
assistive technologies or communication devices.
 Additionally, users' perspectives on accessibility
features such as adjustable strap sizes, tactile markers,
and compatibility with assistive technologies would be
explored to ensure inclusivity.
 CODING THE PROGRAM
 The program for notifying the hand
movement of the sensors and the
information flow are made to work by
coding in Embedded C language.
 TESTING & IMPLEMENTATION
 The assembled kit will be tested for its
proper working and quality.
 If the quality and working is proper it
will be implemented in various regions
and user feedback will be collected.
 Based on the feedback if further
enhancement is required the product will
be improvised further and provided to
the user so that the customer need can be
satisfied.
 References
[1] Huang et al., 2018 - Developed visual-based sign language
recognition without temporal segmentation.

[2] Ko et al., 2019 - Proposed neural sign language translation based

on human key point estimation.

[3] Guo et al., 2018 - Utilized hierarchical LSTM for sign language
translation.

[4] Koller et al., 2019 - Used weakly supervised learning with multi-
stream CNN-LSTM-HMMs for sign language video analysis.

[5] Sridhar, 2017 - Presented a blind image watermarking technique

using wavelet coefficients.
 References
[6] Yakaiah and Naveen, 2022 - Proposed an approach for ultrasound
image enhancement using deep convolutional neural networks.

[7] Alsulaiman et al., 2023 - Developed a Saudi sign language dataset

to facilitate communication with deaf individuals.

[8] Hdioud and Tirari, 2023 - Employed deep learning for recognition
of Arabic sign language letters.

[9]Dixit et al., 2022 - Created an audio to Indian and American sign

language converter using machine translation and NLP techniques.

[10] Chaikaew, 2022 - Utilized holistic landmarks with deep learning

for Thai sign language recognition.
 CONCLUSION
 In conclusion, the Enable Talk Gloves represent a
revolutionary solution to address communication barriers faced
by individuals who are deaf and mute. This innovative
technology offers a transformative way for these individuals to
express themselves, communicate with others, and engage
more fully in various aspects of life.
 In essence, the Enable Talk Gloves are more than just a
communication device; they represent a beacon of hope,
empowerment, and innovation, ushering in a new era of
accessibility and inclusivity for individuals who are deaf and
mute.
THANK YOU