SRM INSTITUTE OF SCIENCE AND TECHNOLOGY

Ramapuram , Chennai – 600089

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

18CSP106L-SEMINAR - 2
Indian Sign Language Recognition system
BATCH NUMBER : 12
Team Members Supervisor
V.KOUSHIK (RA2111028020029) NAME: Mr. A. Madhu, AP/CSE
CH.BHAVISH (RA2111028020069)
K.NARASIMHA (RA2111028020034)

Date Slide Number

 Agenda
• Abstract
• Scope and Motivation
• Introduction
• Literature Survey
• Objective
• Problem Statement
• Proposed Work
• Architecture Diagram/Flow Diagram/Block Diagram
• Novel idea
• Modules
• Module Description
• Software & Hardware Requirements
• References
• Way forward towards Outcome (Research Paper/Patent)

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 ABSTRACT
 Indian Sign Language (ISL) serves as a vital mode of communication for
the deaf and hard of hearing community in India.
 Recognizing and interpreting ISL gestures accurately is crucial for
enabling effective communication and accessibility for this community.
 In this study, we propose a novel approach for Indian Sign Language
recognition that combines video analysis with finger image processing.
 Our approach begins by capturing videos of ISL gestures, which
provides temporal information crucial for understanding the dynamics
of the gestures.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Scope and Motivation
 The scope of Indian Sign Language Recognition (ISLR) based on video
and finger images lies in enabling seamless communication for the deaf
and hard of hearing community.
 By accurately interpreting sign language gestures captured through
video, supplemented by finger images, this technology can bridge
communication gaps and enhance accessibility in various domains like
education, healthcare, and employment.
 Motivated by the need for inclusive communication solutions, ISLR aims
to empower individuals with hearing impairments, facilitating their
participation in society on equal terms.
 This innovation represents a significant step towards fostering inclusivity
and breaking down communication barriers in diverse settings within
India.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Introduction
• ISLR is a dynamic field that integrates technology and accessibility for
the hearing-impaired community.
• It analyzes video recordings and detailed finger images to decode
gestures into meaningful language.
• Advanced algorithms are employed to interpret intricate hand and
finger movements.
• ISLR enables real-time translation of Indian Sign Language into text
or speech.
• Ongoing advancements in ISLR promise to enhance inclusivity and
communication for the deaf and hard of hearing in India and
globally.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Literature Survey
S.No. Title of the Year Journal/ Inferences
Paper Conference
Name
1 A Chinese Sign 2017 Virtual Reality
Language
Recognition
System Using
Leap Motion
2 Japanese Sign 2021 Nicograph
Language Internationa
Recognition
based on a
Video
3 Real-Time 2020 39th Chenese
Sign control
Language conference
Recognition
Based on
Video Stream
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING
 Objective
 The objective of a project for Indian Sign Language (ISL) recognition
based on a video accompanied by finger images would likely be to
develop a system or technology that can accurately interpret and
understand ISL gestures captured in video format, with additional focus
on finger images for more precise recognition.
 Develop an Indian Sign Language Recognition system leveraging video
and finger images to enhance comprehension and accessibility for
individuals with hearing impairments.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Problem Statement
• Develop an Indian Sign Language Recognition system using video
input and finger images.
• Utilize advanced computer vision and machine learning techniques
for accurate interpretation of sign language gestures.
• Enable seamless communication for individuals with hearing
impairments.
• Key objectives include real-time recognition, robustness to lighting
and hand orientation variations, and compatibility with diverse sign
language dialects.
• Integration of video and finger image data aims to enhance accuracy
and effectiveness in understanding sign language expressions.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Proposed Work
• Develop an Indian Sign Language Recognition system using video data
and finger images.
• Utilize advanced computer vision and machine learning techniques to
analyze hand movements and gestures captured in videos.
• Incorporate detailed finger images to accurately interpret sign language.
• Integration of video and finger image data aims to achieve enhanced
accuracy and robustness in recognizing complex signs and gestures
specific to Indian Sign Language.
• The research aims to empower the deaf and hard of hearing community
in India by facilitating seamless communication through technological
innovation.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

BLOCK DIAGRAM OF THE PROPOSED
SYSTEM
 NOVEL IDEA
 The proposed work aims to develop an Indian Sign Language Recognition system
utilizing video data accompanied by finger images.
 Leveraging advanced computer vision and machine learning techniques, the
system will analyze hand movements and gestures captured in videos along with
detailed finger images to accurately interpret sign language.
 By integrating both video and finger image data, the model can achieve enhanced
accuracy and robustness in recognizing complex signs and gestures specific to
Indian Sign Language.
 This research holds promise for empowering the deaf and hard of hearing
community in India by facilitating seamless communication through technological
innovation.
 Software & Hardware Requirements
• OpenCV : An open-source computer vision library used for processing video
frames, detecting hands, and extracting regions of interest
• Mediapipe : A framework by Google for building multimodal applied ML
pipelines, which includes hand detection and tracking models.
• TensorFlow : Deep learning frameworks used to build and train models for
recognizing sign language gestures.
• PyTorch : Another popular deep learning framework for implementing and
training neural networks.
• Jupyter Notebooks : Useful for prototyping and visualizing the results of various
models and preprocessing steps.
• Python : The primary programming language to interface with OpenCV.
• Video Capture and Preprocessing
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING
 References
[1] Y. Verma and R. S. Anand, “Gesture generation by the robotic hand for aiding
speech and hard of hearing persons based on indian sign language,” Heliyon, vol. 10,
no. 9, p. e29678, May 2024, doi: 10.1016/j.heliyon.2024.e29678.
[2] A. Kumari, K. Vinodhini and P. K. A. Jithra, "Indian Sign Language Recognition using
Machine Learning Algorithms," 2021 6th International Conference on Communication
and Electronics Systems (ICCES), Coimbatore, India, 2021, pp. 1191-1196, doi:
10.1109/ICCES51350.2021.9488956.
[3] A. P. Shete and R. S. Holambe, "Indian Sign Language Recognition using Optimized
Deep Learning," 2021 6th International Conference for Convergence in Technology
(I2CT), Mumbai, India, 2021, pp. 1-6, doi: 10.1109/I2CT51068.2021.9418110.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING