So we need an another way to identify
Face Recognition: A
Systematic Literature
Review
Yohanes Wijaya – P31.2019.02207
Department of Computer Science, Dian
Nuswantoro University Semarang
Abstract
Face recognition is way of recognizing a human
face through biometrics technology. The main
idea of face recognition is to compare the human
face with the faces within a database. Face
recognition plays a great role when it comes to
security, it can be used as an alternative way of
identifying and verifying humans through
biometrics such as fingerprint and eye iris
recognition systems or act as an extra
recognition system. Face recognition always
evolving from time to time, therefore, this SLR
mainly discuss about the current trends in face
recognition researches, especially in last 2 years.
Index Terms- face recognition, biometrics
1. Introduction
When it comes to identifying and
recognizing people, we can use our eye to
recognize someone identity, we can see their
physical appearance such as height, weight, face
shape, hair shape, etc to differentiate a people
with other people.
However, sometimes we cannot
differentiate someone from someone else if they
are have similar faces and body shapes, such as
that we can see on twins. Then in this case, we
can’t verify their identity easily and this could
result in security problems.
and recognize people, that is through biometrics
such as fingerprint, eye iris and human face as
the identifying factors, because every single
people have uniqueness in these three things,
there are no people with same exact fingerprint,
eye iris, and facial pattern, so we can compare
each one of them and verify their identity
correctly.
However, when it comes to biometrics
(fingerprint, eye iris, and facial properties), our
eye can’t see these things in very detail way, so
we need something that can scan or read all of
these biometrics properties in very detail that is
through technology.
Face recognition technology become
more popular on these days, this technology
always gets upgraded and improved through
researches years by years, although the accuracy
of facial recognition system as a biometric
technology is lower than eye iris and fingerprint
recognition, it is widely adopted due to its
contactless and non-invasive process.
2. Research Method
2.1 Systematic Literature Review
Planning
1 Formulate the Review’s Research
Question
2 Develop the Review’s Protocol
Conducting
3 Identify the Relevant Literature
4 Perform Selection of Primary Studies
5 Perform Data Extraction
6 Assess Studies’ Quality
7 Conduct Synthesis of Evidence
Reporting
8 Write Up the SLR Paper
2.2 Determine PICOC and Research Question Papers that are collected then will be filtered so
that only papers that are relevant to this research
The formulation of RQs about effectiveness of a
and can help to answer the research questions
treatment should focus on 5 elements known as
will be used. The criteria to filter the papers are:
PICOC
Inclus Papers that are published in
Population Face Recognition ion international journal that have scopus
Intervention Most popular journal, Criter index of Q1 and Q2
problem, method, and ia Papers that discuss about Face
dataset in Face Recognition Recognition problems, solutions, and
researches its development
Comparison - Papers that use public datasets
Outcomes Face Recognition problem, Exclu Conference or proceeding and papers
solution, and result sion that are published in international
Context Research in Face Criter journal that have scopus index of Q3
Recognition with small and ia or Q4
big (public) datasets. Papers that use Face Recognition as a
tool for the research
Papers that are not written in English
The Research Questions that used in this
research are

RQ What journal is mostly contains
1 research papers about Face Recognition
on these years?
RQ What problem is mostly found in the
2 Face Recognition researches?
RQ What dataset is mostly used for Face
3 Recognition researches?
RQ What algorithm or method that is
4 mostly used to solve the problem in
Face Recognition researches?
Papers that are collected from the search results
are then registered in Mendeley software to be
filtered using above criterias. After this process,
there are 30 papers that are relevant to this
research.
2.5 Data Extraction
Papers that are relevant to this research are then
extracted to answer the research questions

2.3 Search Strategy 3. Result

Search strategy in this paper are as follows: 3.1 Most Popular Journal in Face Recognition
research
1. Determine the digital library that will be
used in this research, in this case it is Journal Name Amount of FR
Elsevier (sciencedirect.com) related papers
2. Input the keyword “Face Recognition” Neurocomputing 8
in Elsevier site’s search engine and use Journal of Visual 4
the filter: research and review articles Communication and
only, and articles that published since Image Representation
2018 Applied Soft Computing 2
Journal
Computer 2
Communications
2.4 Paper Filtering Future Generation 2
 Computer Systems Dataset Papers Amou
Array 1 nt
Cognitive Systems 1 LFW 6, 9, 11, 12, 10
Research 14, 20, 21,
Computers and 1 22, 27, 30
Electronics in Agriculture AR 2, 3, 4, 11, 9
Expert Systems with 2 21, 24, 25,
Applications 28, 30
Microprocessors and 1 FERET 3, 11, 15, 16, 8
Microsystems 19, 20, 25, 29
Optik 1 CMU Multi-PIE 4, 19, 20, 21, 5
Pattern Recognition 1 22
ORL 2, 14, 21, 25, 5
Scientific African 1
26
Signal Processing 1 YALE 2, 4, 15, 16, 5
Signal Processing: Image 1 21
Communication CASIA-WebFace 6, 9, 13 3
Image and Vision 1 FRGC 1, 11 2
Computing
FEI 12, 14 2
Bosphorus 1 1
We can see that journal that mostly discuss BU-3DFE 1 1
about face recognition research is the 3D- TEC 1 1
Neurocomputing with number of article of 8, YTF 6 1
followed by Journal of Visual Communication Scface 9 1
and Image Representation with the number of
UCSD 11 1
article of 4.
YTC 11 1
GBU 13 1
3.2 Most discussed problem in Face Recognition RFW 13 1
research IJB 13 1
CDnet 16 1
Category Papers Tot NUST-RWFR 22 1
al
CAS-PEAL 23, 28 2
Effectivity 2, 3, 4, 5, 6, 7, 9, 25
10, 11, 12, 13, CelebA 23 1
14, 15, 17, 18, UFI 27 1
19, 20, 21, 22, AT&T 27 1
24, 25, 27, 28, AR-LQ 29 1
29, 30 MBGC 30 1
Security 8, 23, 26 3

Energy 1, 16 2 We can see that the most used dataset is the

consumption LFW dataset which is used in 10 papers,
followed by AR and FERET datasets which are
used in 9 and 8 papers respectively.
3.4 Most proposed method in Face Recognition
3.3 Most used dataset in Face Recognition research
Research
Solution / Method Amoun Deep learning 1, 5, 12
t Probabilistic Neural Network 2
improved kernel linear 2
discriminant analysis
exponential discriminant analysis 4
and fuzzy fusion framework
machine learning 5
convolutional neural network 6, 12
Local Binary Pattern 7
Efficient attitude tracking 8
algorithm
Classier Shared Deep Network 9
with multi hiearchy loss
cost-sensitive joint feature and 11
dictionary learning
clustering-based domain adaptation 13
tree-based deep models 14
copula probability models based on 15
Gabor wavelets
novel face detection and 16
recognition scheme based on VSN
novel blur invariant binary 19
descriptor
feature fusion, local features, low 20
rank approximation
novel multi-resolution dictionary 21
learning
multi-scale patch based 22
representation feature learning
(MSPRFL)
novel deep neural network, PCA 23
feature dimension reduction
robust supervised sparse 24
representation (RSSR) model
sparsity adaptive matching pursuit 25
based sparse representation
(SAMPSR)
Using randomness techniques, we 26
propose an affine transformation,
which consists of permutation, dif-
fusion and shift transformations, to
protect the privacy of faces.
Dense Local Graph Structure (D- 27
LGS)
local multiple patterns (LMP) 3
feature descriptor based on the
Weber’s law
Paper Data extracting
discrimina
N Paper Journal Problem nt feature
o Title 4 Adaptive Journal of Traditional
1 A fast and Neurocompu traditional illuminatio Visual face
robust 3D ting 3D face n-invariant Communicat recognition
face recognition face ion and method
recognition techniques recognition Image usually
approach suffer from via local Representati faces the
based on high nonlinear on challenge
deeply computatio multi-layer of varying
learned nal costs contrast lighting
face feature condition
representat 5 An Computers Automatic
ion adaptive and identificati
2 A hybrid Neurocompu Ineffective pig face Electronics on for
improved ting ness of recognition in disease
kernel nearest approach Agriculture detection,
LDA and neighbor using control,
PNN algorithm Convolutio and food
algorithm to handle nal Neural quality is
for training Networks needed
efficient and test 6 An end-to- Optik difficult to
face sample that end face design and
recognition are very recognition train the
similar method end-to-end
3 A local Neurocompu Human with face
multiple ting perception alignment recognition
patterns of a signal learning model
feature depends on 7 An Array varying
descriptor the ratio of improved lighting
for face the change face condition,
recognition of stimulus recognition noise in
to the algorithm face
stimulus and its images,
itself while application scale, pose
the change in challenges
of stimulus attendance in face
to the manageme recognition
stimulus nt system
itself is 8 Applicatio Computer Modern
usually n of Communicat smart door
ignored in attitude ions locks are
hand- tracking very
crafted algorithm susceptible
feature for face to errors
descriptors. recognition and
However, based on damage,
it is OpenCV in which will
important the reduce
for
 intelligent security 12 Deep face Future there are
door lock (has a recognition Generation numerous
passcode using Computer situations
entry or imperfect Systems where full
faces facial data frontal
recognition faces may
outside) not be
9 Classifier Signal Low- available
shared Processing: resolution — the
deep Image image imperfect
network Communicat face
with multi- ion images that
hierarchy often come
loss for from
low CCTV
resolution cameras
face 13 Deep face Neurocompu challenges
recognition recognition ting in real
10 Combining Microproces with world tasks
pixel sors and clustering where
selection Microsystem based training
with s domain images
covariance adaptation gathered
similarity from
approach Internet are
in different
hyperspect from test
ral face images
recognition because of
based on different
convolutio lighting
n neural condition,
network pose and
11 Cost- Neurocompu face image
sensitive ting samples quality
joint are 14 Deep Computer Automatic
feature and captured in learning- Communicat and
dictionary unconstrai based ions intelligent
learning ned intelligent face
for face environme face recognition
recognition nts such as recognition systems
varying in IoT- have high
poses, cloud accuracy in
illuminatio environme a
ns nt controlled
expression environme
s and nt;
resolutions however,
challenges they have
in face low
recognition accuracy in
 an satisfactory
uncontrolle when
d dealing
environme with
nt blurred
15 Dependenc Expert Low face
e structure Systems resolution, images
of Gabor with difficult 20 Learning Journal of practical
wavelets Applications illuminatio sparse Visual face
based on n and noise discrimina Communicat recognition
copula for affect the nt low-rank ion and systems
face performanc features for Image often deal
recognition e of face low- Representati with low
recognition resolution on resolution
system. face or poor
16 Energy- Applied Soft captured recognition quality
efficient Computing images are images,
face Journal meaningful with huge
detection multimedia variations
and -data that in pose,
recognition impose facial
scheme for high expression
wireless energy s, and
visual consumpti lighting
sensor on to be conditions
networks processed 21 Multi- Pattern Most of the
and resolution Recognition convention
transmitted dictionary al
17 Face Neurocompu learning dictionary
recognition ting for face learning
with dense recognition methods
supervision focus only
18 Kernel Scientific on a single
based African resolution,
locality – which
Sensitive ignores the
discriminat variability
ive sparse of
representat resolutions
ion for face of real-
recognition world face
19 Learning Neurocompu the images
Blur ting performanc 22 Multi-scale Applied Soft In practical
Invariant e of face patch Computing video
Binary recognition based Journal surveillanc
Descriptor based on representat e, the
for Face most ion feature quality of
Recognitio binary learning facial
n descriptors for low- regions of
are not resolution interest is
face usually
 recognition affected by 25 Sparsity Journal of Sparse
the large adaptive Visual representat
distances matching Communicat ion
between pursuit for ion and methods
the objects face Image have
and recognition Representati exhibited
surveillanc on promising
e cameras, performanc
which e for
undoubtedl pattern
y degrade recognition
the . However,
recognition these
performanc methods
e largely rely
23 Multi-view Future Existing on the data
face Generation face sparsity
recognition Computer recognition available in
using deep Systems algorithms advance
neural are prone and are
networks to be usually
attacked by sensitive to
various noise in the
face training
presentatio samples
n attacks 26 Towards Signal with the
(face-PAs), efficient Processing rapid
such as privacy- deploymen
printed preserving t of FR, the
paper, face privacy of
video recognition face
replay, and in the images has
silicone cloud been a
masks. growing
24 Robust Cognitive since concern,
supervised Systems previous especially
sparse Research SSR when FR is
representat methods performed
ion for face only deal in cloud
recognition with platforms.
Gaussian 27 Unconstrai Neurocompu the most
noise, they ned and ting challengin
cannot constrained g machine
satisfy face vision
empirical recognition application
face using s in the
recognition dense local field of
application descriptor human
which with identificati
faces wide ensemble on and its
variations. framework recognition
 accuracy unsatisfact
depends on ory
many performanc
constraints e for low-
of a face quality
image such images
as changes 30 Low Expert recognizin
in pose, resolution Systems g low
backgroun face with resolution
d, recognition Applications probe face
illuminatio using a images
n, facial two-branch when a
expres- deep gallery of
sion, age convolutio high
(aging), nal neural quality
etc. network images is
28 Face Journal of Identity architectur available
recognition Visual identificati e
based on Communicat on is a
genetic ion and necessary
algorithm Image prerequisit
Representati e to ensure
on the security
of the
system.
Accurate
identificati
on is
needed in
the fields
of finance,
national
security,
justice, e-
commerce
and so on.
29 Face Image and Although
recognition Vision unconstrai REFERENCES
in low- Computing ned face
quality recognition
images has been
using widely 1. Bah SM, Ming F. An improved face
adaptive studied recognition algorithm and its
sparse over the application in attendance
representat recent management system. Array.
ions years, 2020;5(November 2019):100014.
state-of- doi:10.1016/j.array.2019.100014
the-art
algorithms
2. Benuwa BB, Ghansah B, Ansah EK.
still result
in an
Kernel based locality – Sensitive
 discriminative sparse representation
for face recognition. Sci African.
2020;7:e00249.
doi:10.1016/j.sciaf.2019.e00249
3. Cai Y, Lei Y, Yang M, You Z, Shan
S. A fast and robust 3D face
recognition approach based on deeply
learned face representation.
Neurocomputing. 2019;363:375-397.
doi:10.1016/j.neucom.2019.07.047
4. Elmahmudi A, Ugail H. Deep face
recognition using imperfect facial
data. Futur Gener Comput Syst.
2019;99:213-225.
doi:10.1016/j.future.2019.04.025
5. Gao G, Yu Y, Yang M, Huang P, Ge
Q, Yue D. Multi-scale patch based
representation feature learning for
low-resolution face recognition. Appl
Soft Comput J. 2020;90.
doi:10.1016/j.asoc.2020.106183
6. Guo S, Xiang T, Li X. Towards
efficient privacy-preserving face
recognition in the cloud. Signal
Processing. 2019;164:320-328.
doi:10.1016/j.sigpro.2019.06.024
7. Kumar D, Garain J, Kisku DR, Sing
JK, Gupta P. Unconstrained and
constrained face recognition using
dense local descriptor with ensemble
framework. Neurocomputing. 2020;
(xxxx).
doi:10.1016/j.neucom.2019.10.117
8. Li C, Huang Y, Xue Y. Dependence
structure of Gabor wavelets based on
copula for face recognition. Expert
Syst Appl. 2019;137:453-470.
doi:10.1016/j.eswa.2019.05.034
9. Liu Z, Hong W, Zhang H, Ma J. Face
recognition with dense supervision.
Neurocomputing. 2020;387:100-109.
doi:10.1016/j.neucom.2019.12.052
10. Luo X, Xu Y, Yang J. Multi-
resolution dictionary learning for face
recognition. Pattern Recognit.
2019;93:283-292.
doi:10.1016/j.patcog.2019.04.027
11. Marsot M, Mei J, Shan X, et al. An
adaptive pig face recognition
approach using Convolutional Neural
Networks. Comput Electron Agric.
2020;173(January):105386.
doi:10.1016/j.compag.2020.105386
12. Masud M, Muhammad G, Alhumyani
H, et al. Deep learning-based
intelligent face recognition in IoT-
cloud environment. Comput Commun.
2020;152(January):215-222.
doi:10.1016/j.comcom.2020.01.050
13. Mi JX, Sun Y, Lu J, Kong H. Robust
supervised sparse representation for
face recognition. Cogn Syst Res.
2020;62:10-22.
doi:10.1016/j.cogsys.2020.02.001
14. Ouyang A, Liu Y, Pei S, Peng X, He
M, Wang Q. A hybrid improved
kernel LDA and PNN algorithm for
efficient face recognition.
Neurocomputing.
2020;393(xxxx):214-222.
doi:10.1016/j.neucom.2019.01.117
15. Rai AK, Senthilkumar R, R AK.
Combining pixel selection with
covariance similarity approach in
hyperspectral face recognition based
on convolution neural network.
Microprocess Microsyst.
 2020;76:103096.
doi:10.1016/j.micpro.2020.103096
16. Saad Shakeel M, Lam KM, Lai SC.
Learning sparse discriminant low-
rank features for low-resolution face
recognition. J Vis Commun Image
Represent. 2019;63:102590.
doi:10.1016/j.jvcir.2019.102590
17. Sun J, Shen Y, Yang W, Liao Q.
Classifier shared deep network with
multi-hierarchy loss for low
resolution face recognition. Signal
Process Image Commun.
2020;82:115766.
doi:10.1016/j.image.2019.115766
18. Tang F, Wu X, Zhu Z, et al. An end-
to-end face recognition method with
alignment learning. Optik (Stuttg).
2020;205:164238.
doi:10.1016/j.ijleo.2020.164238
19. Wang M, Deng W. Deep face
recognition with clustering based
domain adaptation. Neurocomputing.
2020;393:1-14.
doi:10.1016/j.neucom.2020.02.005
20. Wang Y, Peng Y, Liu S, Li J, Wang
X. Sparsity adaptive matching pursuit
for face recognition. J Vis Commun
Image Represent. 2020;67:102764.
doi:10.1016/j.jvcir.2020.102764
21. Yang W, Zhang X, Li J. A local
multiple patterns feature descriptor
for face recognition.
Neurocomputing. 2020;373:109-122.
doi:10.1016/j.neucom.2019.09.102
22. Zam A, Khayyambashi MR, Bohlooli
A. Energy-efficient face detection and
recognition scheme for wireless
visual sensor networks. Appl Soft
Comput J. 2020;89:106014.
doi:10.1016/j.asoc.2019.106014
23. Zhang G, Porikli F, Sun H, Sun Q,
Xia G, Zheng Y. Cost-sensitive joint
feature and dictionary learning for
face recognition. Neurocomputing.
2020;391:177-188.
doi:10.1016/j.neucom.2020.01.101
24. Zhao C, Li X, Dong Y. Learning Blur
Invariant Binary Descriptor for Face
Recognition. Neurocomputing.
Published online 2020.
doi:10.1016/j.neucom.2020.04.082
25. Zhao F, Li J, Zhang L, Li Z, Na SG.
Multi-view face recognition using
deep neural networks. Futur Gener
Comput Syst. 2020;111:375-380.
doi:10.1016/j.future.2020.05.002
26. Zhou L, Li W, Du Y, Lei B, Liang S.
Adaptive illumination-invariant face
recognition via local nonlinear multi-
layer contrast feature. J Vis Commun
Image Represent. 2019;64:102641.
doi:10.1016/j.jvcir.2019.102641
27. Zhu Z, Cheng Y. Application of
attitude tracking algorithm for face
recognition based on OpenCV in the
intelligent door lock. Comput
Commun. 2020;154:390-397.
doi:10.1016/j.comcom.2020.02.003