SRM INSTITUTE OF SCIENCE AND TECHNOLOGY

Ramapuram , Chennai – 600 089

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

18CSP106L-SEMINAR - 2
Indian Sign Language Recognition based on a
Video accompanied by the Finger Images
BATCH NUMBER : 15
Team Members Supervisor
V.KOUSHIK(RA2111028020029) NAME: Dr. C.G.Balaji.AP/CSE
CH.BHAVISH(RA2111028020069)
K.NARASIMHA(RA2111028020034)

Date Slide Number

 Agenda
• Abstract
• Scope and Motivation
• Introduction
• Literature Survey
• Objective
• Problem Statement
• Proposed Work
• Architecture Diagram/Flow Diagram/Block Diagram
• Novel idea
• Modules
• Module Description
• Software & Hardware Requirements
• Conclusion
• Future Work
• References
• Outcome ( Paper Submitted Proof /Patent Filing Proof)

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 ABSTRACT
Indian Sign Language (ISL) serves as a vital mode of communication for the
deaf and hard of hearing community in India. Recognizing and interpreting
ISL gestures accurately is crucial for enabling effective communication and
accessibility for this community. In this study, we propose a novel approach
for Indian Sign Language recognition that combines video analysis with
finger image processing. Our approach begins by capturing videos of ISL
gestures, which provides temporal information crucial for understanding
the dynamics of the gestures.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Scope and Motivation
The scope of Indian Sign Language Recognition (ISLR) based on video
and finger images lies in enabling seamless communication for the
deaf and hard of hearing community. By accurately interpreting sign
language gestures captured through video, supplemented by finger
images, this technology can bridge communication gaps and
enhance accessibility in various domains like education, healthcare,
and employment. Motivated by the need for inclusive
communication solutions, ISLR aims to empower individuals with
hearing impairments, facilitating their participation in society on
equal terms. This innovation represents a significant step towards
fostering inclusivity and breaking down communication barriers in
diverse settings within India.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Introduction
Indian Sign Language Recognition (ISLR) is a dynamic field bridging
technology and accessibility for the hearing-impaired community. By
analyzing video recordings accompanied by detailed finger images,
ISLR systems decode gestures into meaningful language. These systems
employ advanced algorithms to interpret the intricate movements of
hands
and fingers, enabling real-time translation of Indian Sign Language into
text
or speech. With ongoing advancements, ISLR holds immense promise in
fostering inclusivity and communication for the deaf and hard of hearing
in
India and beyond

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Literature Survey
S.No. Title of the Year Journal/ Inferences
Paper Conference
Name
1 A Chinese Sign 2017 Virtual Reality
Language
Recognition
System Using
Leap Motion
2 Japanese Sign 2021 Nicograph
Language Internationa
Recognition
based on a
Video
3 Real-Time 2020 39th Chenese
Sign control
Language conference
Recognition
Based on
Video Stream
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING
 Objective
The objective of a project for Indian Sign Language (ISL)
recognition based On a video accompanied by finger images
would likely be to develop a system or technology that can
accurately interpret and understand ISL gestures captured in
video format, with additional focus on finger images for
more precise recognition. Develop an Indian Sign Language
Recognition system leveraging video and finger images to
enhance comprehension and accessibility for individuals with
hearing impairments.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Problem Statement
The project aims to develop an Indian Sign Language Recognition
system
leveraging video input alongside finger images. Through advanced
computer vision and machine learning techniques, the system will
accurately interpret sign language gestures, enabling seamless
communication for individuals with hearing impairments. Key
objectives
include real-time recognition, robustness to variations in lighting and
hand
orientation, and compatibility with diverse sign language dialects. By
integrating video and finger image data, the system seeks to enhance
accuracy and effectiveness in understanding sign language expressions,
fostering inclusivity and accessibility in communication for the hearing
impaired community.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Proposed Work
The proposed work aims to develop an Indian Sign Language
Recognition system utilizing video data accompanied by finger images.
Leveraging advanced computer vision and machine learning techniques,
the system will analyze hand movements and gestures captured in videos
along with detailed finger images to accurately interpret sign language.
By integrating both video and finger image data, the model can achieve
enhanced accuracy and robustness in recognizing complex signs and
gestures specific to Indian Sign Language. This research holds promise
for empowering the deaf and hard of hearing community in India by
facilitating seamless communication through technological innovation.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Software & Hardware Requirements
Software Requirements:
• Programming Language
• Machine Learning Libraries
• Image Processing Tools
• Video Processing Software
• Data Annotation Tools

Hardware Requirements:
• Input Device
• High-performance CPU
• Storage

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Conclusion
In conclusion, developing a robust Indian sign language recognition
system based on finger images requires a combination of sophisticated
software and hardware components. By leveraging image processing
techniques, machine learning algorithms, and appropriate datasets, it’s
possible to create a system capable of accurately interpreting and
understanding sign language gestures.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Future Work
Future advancements in Indian sign language recognition using finger
images could involve refining models with larger, diverse datasets,
focusing on regional dialects. Real-time recognition systems on
mobile platforms could enhance accessibility, allowing immediate
communication. Integration of gesture translation to text or speech
would further aid communication between sign language users
and non-users.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 References
1.Sign Language Recognition (Advances in Computer Vision and Pattern
Recognition)" edited by Liang Wang and Guoyin Wang. While not
specifically focused on finger images, this book covers various aspects of
sign language recognition, which may include relevant techniques.
2.Machine Learning Techniques for Sign Language Recognition" by Adrien
Dufraux. This book provides insights into machine learning techniques
applied to sign language recognition, which may involve finger image
analysis.
3.IEEE Xplore, PubMed, and Google Scholar are valuable platforms for
finding research papers on sign language recognition.
4.Websites of universities and research institutions often provide access to
research publications and reports related to sign language recognition.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

 Outcome

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING