SIGN LANGUAGE

ALPHABET
RECOGNITION
 TEAM PRESENTATING
MEET KINJAL
BHANUSHALI  VAGHASIYA 
 TE A EXTC TE B EXTC
ROLL NO 05 ROLL NO 60

NIYATI KARANI  MEET BHANSALI 

TE B EXTC  TE A EXTC 
 ROLL NO 01 ROLL NO 04
 INTRODUCTION
• Sign language recognition is a problem that has been addressed in
research for years. However, we are still far from finding a complete
solution available in our society.
• Among the works developed to address this problem, the majority
of them have been based on basically two approaches: contact-
based systems, such as sensor gloves; or vision-based systems,
using only cameras. The latter is way cheaper and the boom of deep
learning makes it more appealing.
• This post presents a prototype of a dual-cam first-person vision
translation system for sign language using convolutional neural
networks. This is divided into three main parts: the system design,
the dataset, and the deep learning model training and evaluation.
 VISION SYSTEM
Vision is a key factor in sign language,
and every sign language is intended to
be understood by one person located in
front of the other, from this perspective,
a gesture can be completely observable.
Viewing a gesture from another
perspective makes it difficult or almost
impossible to be understood since every
finger position and movement will not
be observable.
Trying to understand sign
language from a first-vision
perspective has the same
limitations, some gestures will
end up looking the same way.
But, this ambiguity can be solved
by locating more cameras in
different positions. In this way,
what a camera can’t see, can be
perfectly observable by another
camera.
The vision system is
composed of two cameras: a
head-mounted camera and a
chest-mounted camera. With
these two cameras we obtain
two different views of a sign,
a top-view, and a bottom-
view, that works together to
identify signs.
 DATASET

To develop the first prototype of this system

is was used a dataset of 24 static signs from
the Panamanian Manual Alphabet. To model
this problem as an image recognition
problem, dynamic gestures such as letter J, Z,
RR, and Ñ were discarded because of the
extra complexity they add to the solution.
IMAGE CLASSIFICATION
TENSERFLOW

This model has been pre-trained for

A generic image classification
program that uses Google's
Machine Learning
library, Tensorflow and a pre-
trained Deep Learning
Convolutional Neural Network
model called Inception.
the ImageNet Large Visual
Recognition Challenge using the data
from 2012, and it can differentiate
between 1,000 different classes, like
Dalmatian, dishwasher etc. The
program applies Transfer Learning to
this existing model and re-trains it to
classify a new set of images.
REQUIREMENT
S
This project uses python 3.5 and the PIP following packages:
• opencv
• tensorflow
• matplotlib
• numpy
 CONCLUSION AND
REFERENCE
• This project is a sign language alphabet recognizer using Python, openCV
and tensorflow for training InceptionV3 model, a convolutional neural
network model for classification.
• The framework used for the CNN implementation can be found here:
• Simple transfer learning with an Inception V3 architecture model by
xuetsing
• The project contains the dataset (1Go). If you are only interested in code,
you better copy/paste the few files than cloning the entire project.