Professional Documents
Culture Documents
Alphabet and Number Recognition of Indonesian Sign Language Using SIFT Algorithm
Alphabet and Number Recognition of Indonesian Sign Language Using SIFT Algorithm
Abstract: The inability to generally used them in form of a text or sound. methods are still not perfect
hear or talk to cause people communicating. They used Approach to the and will continue to do
to become isolated and sign language as the recognizing of sign/gesture development[6] [7].
feeling lonely. It really gives Generally be classified into Scale Invariant Feature
the influence to their social
primary language in doing
life. They are the deaf/mute their activity. Standard sign three, namely: based on data Transform Algorithm is one
disabilities. They used sign language in the country of glove [2][3][4], using of method for detecting
language as the primary Indonesian using sensors EMG object [1]. This method has
language in doing their Indonesian Sign Language (electromyography) [3][5] a good performance to
activity. Standard sign System (ISLS) and based on vision [6][7] changes in scale, rotation,
language in the country of Dictionary[1]. Sign/Gesture [8][9]. brightness and noise This
Indonesian using Indonesian
has content specific This method of data method will have an added
Sign Language System
(ISLS) Dictionary. However, information, sometimes glove is a glove consist of advantage by combining the
not all people understand used by normal people to strain gauge sensor and features of another
sign language, and normal communicate as a hand tracker. Strain gauge matching technique. In this
people who does not communication sensor is used to detect hand paper, researchers proposed
understand sign language, nonstandard. this is and bend the finger, and the SIFT method to use on
will find difficult to tracker is an electronic the recognition of Number
generally used to interact
communicate with people
with the computer[2]. system used to provide and Letter on Indonesian
who use sign language to
communicate. To resolve this information location, sign language.
problem, sign language orientation, speed and
translation allows to help direction of the hand. This
deaf and mute people to glove data produce good II. Related Work
communicate with normal performance and have a
people. Sign/Gesture high reliability in the Many researchers have been
recognition is a technique to done based on sign
recognize certain sign/gesture
recognition of sign
language. This method language recognition using
and the end result can be vision based. For hand
translated into form of a text eliminated the phases of
detection technique
or sound. Scale Invariant pre-processing on vision
Feature Transform
described by [10] and [11],
technique. The methods has both use the HSV colour
Algorithm is one of method deficiency, namely: users
for detecting object. This models and YCbCr colour
need to wear glove, this model for the process of
method has a good
performance to changes in system is quite expensive segmentation on the skin
scale, rotation, brightness because uses many sensor. color of the hand.
and noise This method will Many electronic devices Researcher [11] using
have an added advantage by embedded in gloves and a generic fourier descriptor
combining the features of lot of cables are connected and nearest neighbour on
another matching technique. between the computer and feature extraction process,
In this paper, researchers
the gloves, as well as have this research produces the
proposed the SIFT method to
use on the recognition of the potential to inhibit the accuracy 86% for static data
Number and Letter on comfort and movement and 69% for dynamic data.
Indonesian sign language. when using this gloves data In [12] using labview
The best performance on the [2][3][4]. For vision based recognize of sign language.
recognitoin of the character technique, input device Researchers using static
sign language (letters and using a camera that was data and dynamic data, the
numbers) on the threshold Figure 1. Indonesian Sign used to observe the hand accuracy obtained 97.79%
value of 0, 65 namely: “B, H, for static sign and 80.38%
“1”, “2”, “4”, “5” and “10” Language System (ISLS) and its movement. In this
for dynamic sign.
with its 100% accuracy. Dictionary[1]. method, the signer is in
Researchers [9] using edge
Change the threshold value front of the camera and the
orientation histogram. This
that gives best accuracy is at However, not all people camera captures sign image,
the threshold value of 0,45 method produces
understand sign language, and then in the process of recognition level of 88.26%
which produces 79,71% using vision method for
accuracy. and normal people who within recognition time of
does not understand sign recognized and translated. 0.5 second. those results are
Keywords: SIFT method, language, will find difficult This method is relatively tested on a complex
Indonesian Sign Language, to communicate with people inexpensive because background and mixed
Threshold. who use sign language to requires only a camera for lightning condition.
communicate. To resolve pictures and many Researchers [13] combine
this problem, sign language developed by the between edge detection
I. Introduction translation allows to help researchers. For researchers algorithm and skin
deaf and mute people to is a challenge in perfecting detection algorithm for
The inability to hear or the introduction in any use gesture identification, and
communicate with normal
talk to cause people to of the application. using ANN algorithm for
people. Sign/Gesture
become isolated and feeling Researchers have many Static hand gesture
recognition is a technique to
lonely. It really gives the presents various methods of recognition. In [14],
recognize certain
influence to their social life. introduction sign/gesture. researchers develop
sign/gesture and the end
They are the deaf/mute Until now, the existing recognition hand signals in
result can be translated into depth data using dynamic
disabilities. Sign language
How to Format Your Paper for JIAS 3
communication
technology,
decision support
system, artificial
intelligence, and
mobile
computing.
Rosa Andrie
Asmara,
received the B.E.
degrees, in
electronics
engineering from
Brawijaya
University,
Indonesia in
2004 and M.S.
degree in
Multimedia
engineering from
Institute of
Technology
Sepuluh
Nopember,
Surabaya,
Indonesia in
2009, and Dr.
Eng degrees from
Saga University,
Japan in 2013.
He is a lecturer in
the Informatics
Management
field, Department
of Information
Technology at
State
Polytechnics of
Malang,
Indonesia. His
research interests
include signal
processing, image
processing,
parallel
processing,
pattern
recognition, and
computer vision.
Muh Bambang
Purwanto,
received her
Bachelor of
Engineering, in
electronics
engineering from
University
Merdeka Malang,
Indonesia in
2015. Currently
he has been
studying in
Electrical
Engineering, at
the third semester
of Master Degree
in State
Polytechnic of
Malang,
Indonesia. Her
research interests
include Control,
computer vision
and image
procesing.