Multimodal Biometric for Mobile
AttendanceAuthentication System
1st Tiffany Tantri
Abstract—Single biometric system has various problems, such
as noisy data, non-universality, spoof attacks, or unacceptable
error rates. This problems can be solved by using multimodal
biometric system, where it combines two or more individual
traits, like face, iris, retina, voice, fingerprint, and so on.
Another benefit from multimodal biometric is that it increases
the recognition accuracy. In this paper, two biometric modalities,
voice and fingerprints will be used and combined with fusion
techniques to generate accuracy result.
Index Terms—fingerprint recognition, voice recognition, mul-
timodal biometric, fusion
I. I NTRODUCTION
Authentication is a field that has been developed over the
past few decades, and will continue to grow in the future [1].
Nowadays, in the era of information technology, authentication
and authorization techniques are very important to implement
to secure resources [2]. There are many ways to verify
authentication and authorization, which can be categorized
into three classes [1]. The first one is ”something you know”,
passwords. Second is ”something you have”, as tokens. And,
the third is ”something you are”, such as biometric.
Today, although many industries are experiencing techno-
logical growth and changes, there are still some businesses that
stick with old-fashioned way, such as using manual way for
recording employee’s attendance [3] with paper or by calling
name on the list. These manual ways are not safe because for
example, the attendance record might be lost and also, it is
difficult to find certain record of employee’s attendance [4].
Also, with the manual system, employees can manipulate the
time of signing in and out. The most important thing in having
a system is to have an easy but accurate and precise way to
keep track of employee’s attendance.
Recently, biometric has become very popular and widely
used for attendance system to authenticate employees. Bio-
metrics are unique among human being and provide a form of
authentication of an individual’s identity [5]. Biometric can be
described as a method for recognizing the identity of a person
based on physical charateristic, like faces, fingerprints, palm
print, voice, etc. Biometric techniques have been known as a
strong approach in verifying the authenticity and authorization
of human being based on their physiological or behavioral
traits [6]. Hence, it can not be stolen, unlike passwords, pin,
or tokens.
Apart from its security, attendance machine using finger-
print biometric has some drawbacks, for example, employees
2nd Benfano Soewito
still need to queue up to do the attendance or when their
fingerprints are not recognized by the machine. Furthermore,
the price of the machine tends to be expensive. Therefore,
the idea of using biometric authentication with mobile for
attendance system has emerged to overcome the weaknesses
of other existing attendance systems.
The solution proposed for the problem is by using An-
droid based smartphones and multimodal biometrics (voice
and fingerprint) will be combined to have a more secure
authentication system. The rest of the paper is organised
as follows. Section 2 discusses the related work. Section 3
discusses the method and collected data. Section 4 presents
the performance results. And finally, Section 5 outlines some
important things of this research.
II. R ELATED W ORKS
Today, multimodal biometric system is one of the best
security system solutions for most applications and it is
believed to overcome limitations of unimodal biometric system
[7]. There are many biometric techniques are being used and
also, many new approaches are still being developed in the
early stages. Therefore, a number of studies have been done
on multimodal biometric by combining two or more biometric
traits.
Abdolahi [8], for example, used fuzzy logic to combined
fingerprint and iris where the accuracy of both combined
was higher, 98.3%, comparing to single biometric, where the
accuracy of fingerprint was 96% and iris was 97.5%. Another
example, Telgad [9], combined fingerprint and iris as well
using sum rule as the fusion method and the result of accuracy
was 97.5%.
Elhoseny [10] proposed a system with the same traits,
using AND rule by comparing the matching score from both
fingerprint and iris with the threshold set. In [11], Sarhan
used four biometrics, fingerprint, face, finger vein, and iris,
where two or three of them are combined together. Also, in
the paper, the authors compared each of the traits (unimodal
biometric) and also compared the combined with two different
fusion, feature level and matching score level fusion. The
results presented that with unimodal biometric, the accuracy
was below 95%, while with multimodal biometric, all of them
had accuracy above 95%.
 III. M ETHODS
A. Data Collection
The study uses two biometric datasets, fingerprint and voice.
The fingerprint data used is FVC 2000 and FVC 2002, with
total of 640 images of fingerprint with each of the dataset
contains four with 80 images of fingerprints. The data used
for voice recognition is VoxCeleb1, containing utterances from
1251 celebrities.
R EFERENCES
[1] M. O. Derawi, B. Yang, and C. Busch, “Fingerprint recognition with
embedded cameras on mobile phones,” in International Conference
on Security and Privacy in Mobile Information and Communication
Systems. Springer, 2011, pp. 136–147.
[2] D. T. Meva and C. Kumbharana, “Comparative study of different
fusion techniques in multimodal biometric authentication,” International
Journal of Computer Applications, vol. 66, no. 19, pp. 16–19, 2013.
[3] M. Oloyede, A. Adedoyin, and K. Adewole, “Fingerprint biometric
authentication for enhancing staff attendance system,” 2013.
[4] M. Olagunju, E. Adeniyi, and T. Oladele, “Staff attendance monitoring
system using fingerprint biometrics,” International Journal of Computer
Applications, vol. 179, no. 21, pp. 8–15, 2018.
[5] S. Vaishnav, S. Sunil, D. Ullas, V. K. Rao, and M. K. Panimozhi, “Secure
authentication system,” 2017.
[6] P. Sanjekar and J. Patil, “An overview of multimodal biometrics,” Signal
& Image Processing, vol. 4, no. 1, p. 57, 2013.
[7] C. C. Ho, M. A. Hussin, and H. Ng, “Match score fusion of fingerprint
and face biometrics for verification,” Jurnal Teknologi, vol. 77, no. 18,
2015.
[8] M. Abdolahi, M. Mohamadi, and M. Jafari, “Multimodal biometric
system fusion using fingerprint and iris with fuzzy logic,” International
Journal of Soft Computing and Engineering, vol. 2, no. 6, pp. 504–510,
2013.
[9] R. L. Telgad, P. Deshmukh, and A. M. Siddiqui, “Combination approach
to score level fusion for multimodal biometric system by using face
and fingerprint,” in International Conference on Recent Advances and
Innovations in Engineering (ICRAIE-2014). IEEE, 2014, pp. 1–8.
[10] M. Elhoseny, A. Elkhateb, A. Sahlol, and A. E. Hassanien, “Multimodal
biometric personal identification and verification,” in Advances in Soft
Computing and Machine Learning in Image Processing. Springer, 2018,
pp. 249–276.
[11] S. Sarhan, S. Alhassan, and S. Elmougy, “Multimodal biometric systems:
a comparative study,” Arabian Journal for Science and Engineering,
vol. 42, no. 2, pp. 443–457, 2017.