Journal of King Saud University – Computer and Information Sciences 34 (2022) 7236–7246

Contents lists available at ScienceDirect

Journal of King Saud University –

Computer and Information Sciences
journal homepage: www.sciencedirect.com

Enhanced IPCGAN-Alexnet model for new face image generating on age

target
Hady Pranoto a,b,⇑, Yaya Heryadi a, Harco Leslie Hendric Spits Warnars a, Widodo Budiharto b
a
Computer Science Department, BINUS Graduate Program-Doctor of Computer Science, Bina Nusantara University, Indonesia
b
Computer Science Department, School of Computer Science, Bina Nusantara University, Jakarta Indonesia

a r t i c l e i n f o a b s t r a c t

Article history: Cross aging face recognition ability will decrease to recognize someone’s face after a certain time. Adding
Received 13 April 2021 synthetics face images at a certain age generated from face aging architecture is one way to increase the
Revised 10 August 2021 performance of cross aging face recognition. A synthetics face image can create use the Generative
Accepted 2 September 2021
Adversarial Network-based architecture. The current Generative Adversarial Network-based in face aging
Available online 11 September 2021
still needs high computation to create a model. Based on that reason we proposed a new optimal variant
of Identity Preserving Conditional Generative Adversarial Network (IPCGAN), to generate a synthetic face
Keywords:
image at certain age groups. In the proposed architecture, change made at the structure in the generator
Face aging
Aging pattern transfer
module, age classification module, and change the objective function to increasing the accuracy perfor-
Generative adversarial network mance when generates a realistic synthetic face image in certain age groups and also speed up the train-
ing time. Modification in the age classifier at the proposed network forces our architecture to generate
better synthetics face in certain age groups. Evaluation using Facenet, and Age prediction shows our
method accuracy has 4.2% better results in k-NN classification, 3.6% better accuracy results in SVM clas-
sification, 8.6% better accuracy result in age verification, and 4.5% fewer accuracy results in age
prediction.
Ó 2021 The Authors. Published by Elsevier B.V. on behalf of King Saud University. This is an open access
article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

1. Introduction added effects of natural aging and rejuvenation. Facial aging is

Cross aging face recognition ability will decrease its ability to
recognize someone’s face after a certain time. This decrease in per-
formance is due to facial changes in people who want to be recog-
nized because face aging or age progression. Adding synthetics face
images at a certain age generated from face aging architecture is
one way to increase the performance of cross aging face
recognition.
Face aging or age progression is a term used to describe a pro-
cess to synthesize faces at certain age groups (Zhang et al., 2017),
defined as an aesthetic process for rendering a new face with the
⇑ Corresponding author at: Computer Science Department, BINUS Graduate
Program-Doctor of Computer Science, Bina Nusantara University, Indonesia.
E-mail address: hadypranoto@binus.ac.id (H. Pranoto).
Peer review under responsibility of King Saud University.
Production and hosting by Elsevier
the process of synthesizing a new face at the desired age.
Many research was conducted in face aging or age progression
(Wang, 2016; Kemelmacher-Shlizerman et al., 2014), but this
research is still challenging because the existence of training sam-
ples for the same person who has a long range of years is very dif-
ficult to find (Panis et al., 2016; Rothe et al., 2018), and the current
method in face aging still need high computation to create a model.
Much research in the field of facial aging has been done. Their
approaches can be classified into three categories: Conventional,
Deep Generative, and Generative Adversarial Networks Approach.
The conventional approach itself, divided into three categories:
model-based, prototype, and reconstruction approach. A model-
based approach is an early approach in age progression research.
Active Appearances Models (AAMs) (Patterson et al., 2006), Global
Aging Function, Appearance Specific Aging Function (ASA),
Weighted Appearance Angging Function (WAA), Weighted Person
Specific Aging Function (WSA) (Lanitis et al., 2002), Aging Pattern
Subspace (AGES) (Geng et al., 2010), and compositional and
dynamic model for face aging (Suo et al., 2010) are model-based
approach. This method usually utilizes a kind of appearance model
to represent the face structure and structure of the input photo.

https://doi.org/10.1016/j.jksuci.2021.09.002
1319-1578/Ó 2021 The Authors. Published by Elsevier B.V. on behalf of King Saud University.
This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
H. Pranoto, Y. Heryadi, Harco Leslie Hendric Spits Warnars et al.
The model-based approach has result unrealistic face image and
often lose the identity at generated face. This model-based
approach using face shape, texture changes due to aging processes
such as wrinkles, muscle changes, hair color are modeled with a
parameter (parametric model).
The prototype-based approach (Kemelmacher-Shlizerman et al.,
2014) applies an aging prototype to transfer differences between
age groups into input face images to generate a new face image in
a certain age group. This process estimates changes in age patterns
based using average face or means face (Rowland and Perrett,
1995), a pattern for each predefined age group (Liu et al., 2008).
Average face applied to the input face image to produce a synthetic
face image at a certain age group. When implementing the pattern
into the input face image, the prototype-based approach needs high
precision alignment between input images with a mean face, if not,
it will produce a plausible synthetic face image. This method, this
approach is limited to modeling aging patterns and missing the glo-
bal comprehension of the human face such as personality and
expression, which is a need in aging progression.
The reconstruction-based approach focuses only on finding the
aging bases or basic patterns of each age group and combining
them. The result of this method is a dictionary can be used to trans-
form the input image into the new synthetic image at the desired
age. Shu et al (Shu et al., 2015) proposed a Coupled Dictionary
Learning (CDL) to model the personalized aging pattern (Tang
et al., 2018) by preserving the personalized features of each indi-
vidual. They formulated CDL for short-term face aging photos,
not long-term aging photos because collecting the long-term dense
facing sequence is difficult.
Another method is the deep generative-based approach. This
method gives better results than conventional approaches. This
approach can produce synthetic faces more realistic than ever
before. An example experiment using the deep generative method
is an Age progression using Temporal Restricted Boltzmann
Machine (TRBM) (Duong et al., 2016) which utilized embedding a
temporal relationship between sequence face images, utilizing
the log-likelihood objective function and ignoring l2 reconstruction
error during training, capture non-linear aging process efficiently
and automatically synthesize a sequences age progression from
each age group with greater detail. The Recurrent Neural Network
(RNN) (Wang, 2016), and two Layer-Gated Recurrent Units (GRU)
to utilize the information (memory) from the previous layer, and
create a smooth transition of change between age groups when
synthesis faces images.
The face aging or age progression improved significantly when
Generative Adversarial Networks (GAN) method is discovered
(Goodfellow, et al., 2014). Many research uses the GAN method
can create fake characters, fake faces, and fake images. GAN
method has been demonstrated its success to generated high-
quality images (Goodfellow, et al., 2014; Mirza and Osindero,
2014) and also can be used to mapping image styles from a domain
to other domain images. For example, a mapping natural style
landscape images into photographic paintings style images, from
realistic face photos into sketch images (Zhu et al., 2017). A GAN
architecture can create various objects depending on the training
data provided (Im et al., 2016).
Generative Adversarial Networks have improvement when a
conditional GAN (cGAN) introduce. A cGAN can create desired out-
puts based on conditional given to architecture and can produce
one image translation to another image by implementing a certain
characteristic condition on the image (Isola et al., 2017) and can be
used also to evoke images of faces at a certain age in (Antipov et al.,
2018).
Identity Preserved Generative Adversarial Networks (IPCGANs)
(Wang et al., 2018), have successfully generated a new synthetic
7237
Journal of King Saud University – Computer and Information Sciences 34 (2022) 7236–7246
face image at a certain age and also preserving identity. Generating
a new synthetic face and preserving identity is a challenging com-
putational task. The main problem in GAN is the architecture has a
big number of parameters and high-cost computational and needs
a big number of sample data to produce a good model. IPCGAN as a
baseline architecture takes a long time in terms of training to
become convergent, the ability to maintain the identity of the
input image can also be improved. Based on that problem we pro-
posed a new more optimal variant of IPCGAN architecture within a
more simple architecture and quick process to generating new
faces at the target age and also maintaining identity.
2. Related work
Face aging or age progression using GAN borrowing from the
game generator and discriminator, where the discriminator learns
how to distinguish the data given from the generator as a real sam-
ple or not, and the generator learns how to produce a real sample,
to make a discriminator can not distinguished. This learning pro-
cess will continue until a certain point the discriminator is not able
to distinguish between real data and data generated by the gener-
ator. In the context of face aging data is face images. The challenge
in this method is to get a sufficient number of complete sequence
images of an individual for training data. GAN architecture can
generate any object from given noise, and depending on given
training data. Synthetics face can generate by GAN if the architec-
ture is trained with face dataset.
Generative Adversarial Networks change the face aging
approach from a step-by-step age progression approach into direct
age progression (Zhang et al., 2017; Antipov et al., 2018; Li et al.,
2018). The aging effect such as adding the wrinkle, sideburn, gray
hair, eye bags, and change the structure of the head, such as shrun-
ken chin, enlarge eyes added directly when simulated the aging or
rejuvenation process.
A certain condition can be given to GAN to produce the desired
image (Isola et al., 2017), this has inspired researchers to produce
facial images with certain age conditions (Antipov et al., 2018), by
utilizing a residual block, the process of change can occur (Liu,
et al., 2017). Previously GAN input that was derived from noise,
replaced by using an input image, this will shorten the process to
produce synthetic images because it eliminates the process of pro-
ducing face images from scratch. IPCGAN (Wang et al., 2018) using
this method to produce an aging effect and maintaining identity.
The generative Adversarial Network method can be categorized
based on how to architecture generated synthesis face image into
three categories: translation-based, sequence-based, and
condition-based.
A translation-based method is based on how to transfer style
from one set of images into another set of images, from one
domain into another domain images. Translation-based method
introduce by Zhu et al. (Zhu et al., 2017) in Cycle-GAN architecture
capturing style characteristics from a set of images and imple-
mented in another set image. The advantage of Cycle-GAN does
not require a pair match of two set domains. This advantage of
Cycle-GAN can utilize for face aging. But Cycle GAN also has a dis-
advantage. Cycle-GAN was only able to translate two domains.
Palsson et al. (Palsson et al., 2018) proposed a face aging architec-
ture by adopted an architecture style transfer from cycleGAN (Zhu
et al., 2017), and uses cyclic consistency between the input face
image and the generated synthetic image, to preserved identity
of the input face image in generated synthetic image.
The second method is sequence-based, this method is not
designed to perform direct translation between different age
groups. It uses multiple networks that are trained separately to
H. Pranoto, Y. Heryadi, Harco Leslie Hendric Spits Warnars et al.
perform sequential translations between two adjacent age groups.
In this method, the translation conducted sequentially, and com-
bined into a complete network. The output from network i-th will
be used as input for network i + 1th. The challenge in this method
is to get a complete and sequenced image of an individual. Accord-
ing to Wang et al, although the deep learning approach is already
powerful, there are still challenges in training the age-group tran-
sition from certain age groups to other age groups in a ‘‘one-shot”
way (Wang et al., 2019). But current face aging method used ‘‘one-
shot” and achieve the state-of-the-art (Despois et al., 2020; Liu
et al., 2019; Fang et al., 2020). Research using sequence-based
are FaceFeat-GAN: a Two-stage approach for identity-preserving
face synthesis (Shen et al., 2018); D. Deb et al. with Child Face
Age-Progression via Deep Feature Aging (Deb et al., 2020) to simu-
late child’s face; Q. Li et al (Li et al., 2019) with Age Progression and
Regression with Spatial Attention Modules, exploiting spatial
attention mechanisms to restrict image modification to regions
in face image, closely age changes, to produce high visual fidelity
face image; H. Fang et al with Triple-GAN: a progressive face aging
with triple translation loss (Fang et al., 2020), adopt a triple trans-
lation loss to model the robust interrelationship of age patterns
between different age groups. Duong et al (Duong et al., 2019)
introduce Inverse Reinforcement (IRL) and implement Subject-
dependent Deep Aging Path (SDAP) structure model and use an
additional aging controller in the TNVP structure, based on the
hypothesis that each subject should have its facial development.
Multiple training pairs increase the ability to learn the mapping
between pattern and label.
The third method is conditional-based, a method that utilizes a
conditional in GAN (Mirza and Osindero, 2014) to control architec-
ture produce synthetic faces in a certain age group using a label.
This method uses a one-hot code tensor to guiding the network
to generate synthetic face images on target age groups. From sev-
eral existing methods, the placement of this one-hot code varies.
Some methods place this one-hot code on the generator and dis-
criminator (Tang et al., 2018) part, other methods place one-hot
code only on the generator part which is one hot code concate-
nated with input images. For example, Yao et al. (Yao et al.,
2020) fuse age labels with latent vectors. In summary, the
condition-based method is based on the concept how guiding the
generator by including extra information about the target age
groups. The condition-based has high efficiency and a significant
advantage compared to the translation-based approach. Example
research use conditional-based approach is Zhang et al. conducted
Age progression/regression by conditional adversarial autoencoder
(Zhang et al., 2017), W. Wang et al with recurrent face aging
(Wang, 2016), J. Song et al. with Dual Conditional GANs for Face
Aging and Rejuvenation (Song et al., 2018), G. Antipov et al with
Face Aging using Conditional Generative Adversarial Networks
(Antipov et al., 2018), S. Liu, et al., with Face Aging with Contextual
Generative Adversarial Networks (Liu, et al., 2017), Synthetic face
images from many methods in Age GAN showed these methods
produce more realistic, high fidelity, and also preserved identity
from input images.
2.1. Conditional GAN (cGAN)
A Conditional GAN (cGAN) proposed by Isola et al. (Isola et al.,
2017) is an architecture based on GAN, this architecture translates
images from one style domain into another style domain by imple-
menting a conditional into the architecture to get certain charac-
teristics in the resulting image. In general model conditional GAN
can solve any style transfer problem from image to image, not only
for a specific style domain, the model not only maps from an input
image to output image but also can create a mapping function for
7238
Journal of King Saud University – Computer and Information Sciences 34 (2022) 7236–7246
certain conditions or styles. Using this method the resulting in the
image being more realistic, because the structure of the image can
be maintained. Conditional GAN can create face aging at certain
age groups by using face dataset and add aging conditional for each
age-groups.
First Age conditional GAN(acGAN) architecture proposed by
Antipov et al. (Antipov et al., 2018), can generate a synthetic face
at targeted age group use an age condition. The architecture is
composed of a two-step, reconstruction and face aging step. Recon-
struction steps are an optimization problem to find optimal latent
approximation z ⁄ and face aging step performed by a simple
change condition of y at the input of the generator. In the recon-
struction step, latent vector optimization compute Euclidean dis-
tance between input image x and synthesis image x result from
FRðxÞ and FRðxÞ to create face aging images from an input image
to the target age group and also preserve the original person iden-
tity. Minimum Euclidean distance indicates probability if the per-
son in both images same person. face aging step is process
compute Euclidean distance between input image x and images
from age groups.
2.2. Face aging with identity-preserved conditional generative
adversarial networks (IPCGANs)
Identity Preserved Generative Adversarial Networks (IPCGANs)
(Wang et al., 2018), is an architecture that has successfully gener-
ated a new synthetic face image at a certain age group and preserv-
ing identity. IPCGANs, has three modules: (1) conditional module
for generated real synthesis and look realistic face x from input
image x, in target age groups t using age conditional ct ; (2)
preserving-identity module to generated face synthesis x has the
same identity as input image x; and (3) classifier module (Yang
et al., 2018) which forced the synthesis of images x created at
desired age group.
The conditional module is adapted from cGAN architecture
(Isola et al., 2017). in this module, the generator tries to generate
a synthetics image x at certain age groups from images y using a
conditional characteristic. After synthetics image create discrimi-
nator part forced the image resulting from the generator to fall
in age target groups and look real as a human face. This conditional
module has two discriminators, the first discriminator D makes a
decision using a loss function to determine image produce by the
generator appears real or fake. Small loss values indicate the
resulting images look real, and vice versa. The second discriminator
has a task to align the output synthetics images y aligned with
images from target age groups t using age condition ct . To be able
to complete this task, the objective function of the module was for-
mulated as Eqn 1.
min max V ðD; GÞ ¼ Ex px ðxÞ ½logDðxjC t Þ
G D
þ Ey py ðyÞ ½1  log DðGðyjCt ÞÞÞ ð1Þ
where Px ðxÞ and P y ðyÞ are image distribution x, and y. Ex px ðxÞ are
expectation distribution data x and Ey py ðyÞ are expectation distribu-
tion data y. The loss function for discriminator D is logDðxjC t Þ and
generator G is 1  log DðGðyjCtÞÞÞ. Generator GðyjCt Þ modeled data
distribution from data given by y and ct .
IPCGANs use a Least Squares Generative Adversarial Networks
(LSGANs) (Shu et al., 2015) model to push the generated face
images to look real, and close to decision boundaries and make face
synthesis indistinguishable as real face images. LSGAN can gener-
ate high-quality images and training process more stable. A Condi-
tional LSGAN for face generation tasks in IPCGAN formulated in
Eqn 2.
H. Pranoto, Y. Heryadi, Harco Leslie Hendric Spits Warnars et al.
1 1
LD ¼ Ex P x ðxÞ ½ððDðxjC t Þ  1Þ2  þ Ey P y ðyÞ ½ðDðGðyjC t ÞÞ
2

2 2
1 h
LG ¼ Ey P y ðyÞ ½ðDðGðyÞjC t Þ  1Þ2 
2 LD ¼
To optimize Conditional LSGANs, IPCGAN using a matching
aware discriminator for effective aligning conditions with gener-
ated images.
The Identity-preserved module is used to preserve identity
information for the synthesized image. This module is an impor-
tant part of the architecture to preserve the identity information
for the synthesized face. Perceptual loss use in this objective func-
tion instead of Mean Square Error (MSE), because if use MSE to cal-
culate differences between input image x and face age GðxjC t Þ in
pixel square, the loss will force GðxjC t Þ to be the same as image x.
A perceptual loss encourages the generated synthetic image to be
close to a feature of input space in the same feature spaces. IPCGAN
uses a lower feature layer to keep the content or personality of the
input image, and a high feature layer to help keep style-related
such as color, texture, etc. An aged face must change in terms of
hair color, wrinkles, etc. IPCGAN also uses an Alexnet Classifier to
force image generated form generator, to synthesize face images
at certain age group by classifying them into an age group class,
when the output image from the generator has a small loss when
classified, it means the resulting image has age pattern from a
specific class. Architecture trains with this condition until the best
result model is created from architecture, the architecture trained
into minimum specific loss value as a threshold.
3. Research method
3.1. Proposed architecture
The proposed architecture is a new optimal variant of IPCGAN
with improved performance to produce face synthetics face images
at certain age targets and maintain the identity from input face
images. The proposed architecture aging process aims to generate
a synthesized face image x that lies in the target age C t from image
x, with the hope that the image x has the following characteristics:
(1) face image x looks really like a real face image; (2) x face image
has the same identity as x image; (3) face image x has an age in the
age group C t . Models train based on the age groups that face image
x belongs to related to C s , the model correspondent C s to any target
age groups C t in pair list. We, not training specify training C s age
groups to C t age groups.
Similar to IPCGANs, the proposed architecture has three-
module (1) a conditional GAN (cGAN) which generate a synthe-
sized face with a target age C t and guarantees image x looks real-
istic; (2) An age classifier module that enforces the image x fall
into the desired age C t ; (3) An identify preserving module that
guarantees image x the same identity with x.
The conditional in generator module has a task to generate a
synthesized face at a target age using generator G. Denote x as
input image within the source age group and y as a real face within
target age groups. We denote the distribution of x and y as px ðxÞ
and py ðyÞ. With cGAN, the synthesized face with age condition C t
should be can not be distinguished as a real image by discriminator
D. For real face sample generated from generator G, the probability
belong to real face DðxjC t Þ should be high. Discriminator D is also
responsible for aligning the input label C t with generated images.
When using optimization in standard GAN (Goodfellow, et al.,
2014), experience instability occurs, with consequences always
produce a bad and unrealistic picture. The proposed architecture
uses Least Square GAN (LSGAN) (Mao et al., 2017), the same as IPC-
GAN. The LSGAN tries to push both generated faces and real faces
into the same decision boundary, and make generated faces and
Journal of King Saud University – Computer and Information Sciences 34 (2022) 7236–7246
real faces difficult to distinguishable. LSGAN formulated as Eqn 3
and Eqn 4.
i 1 h i
ð2Þ 1
Ez px ðxÞ ðDðxjC t Þ  1Þ2 þ Ez px ðx Þ 2ðDðGðyjC t ÞÞ2 ð3Þ
2 2
1 h i
LG ¼ Ez px ðxÞ ðDðGðyjC t Þ  1Þ2 ð4Þ
2
The LSGAN conditional, optimized use matching aware discrim-
inator in (Reed et al., 2016), where the discriminator only checks
generated image samples for corresponding age groups.
To generate an aging pattern at a certain age group, the pro-
posed method using Age classification module based on Alexnet
Age Classifier in IPCGAN, this module has a task to generated
images at certain age groups. Using classifying method age classi-
fier guarantee the generated face GðxjC t Þ fall into the target age C t .
If the generated face fall in the group C t our age classifier will give a
small penalty, vice versa age classifier will give a big penalty to the
architecture. This age classifier trying to get the smallest loss to
generate face with an aging pattern at a certain age group. Loss
from objective function this age classifier forces the architecture
to generate an aging pattern in resulting images. Minimum loss
values make generated image has an aging pattern from each age
group. Age classifier in proposed method formulated as Eqn 5:
X
Lage ¼ lðGðxjC t Þ; C t Þ ð5Þ
xpx ðxÞ
where lðÞ is to softmax loss. Through backpropagation, age classi-
fication loss forces the parameter of the generator to change and
generate faces that lie in the correct age group.
To preserving identity input image in the synthesized face
image, proposed method using preserving identity module. This
preserve identity module uses a perceptual loss to guarantee the
resulting image has age pattern change, but still has identity infor-
mation from the input images. The preserving identity module did
not use adversarial loss in process generation of face, the adversar-
ial loss forced the generate synthesized face will follow the target
data distributions. Consequently, the generated sample can be like
any person in any age group, which means adversarial loss alone
cannot guarantee that the generated sample can preserve identity
information from input face images.
Actually, in IPCGAN or our proposed network, age classifier and
identity preserving module share part the same architecture from
the first layer to the seventh layer. With same age classifier archi-
tecture make synthetics face images at certain target age and pre-
vent the generated image losses the identity from an input image.
Feature space extracted from specific proper layer hðxÞ is impor-
tant to preserving the identity information and the lower layer is
good to keep. Experimental style transfer in (Gatys et al., 2016;
Johnson et al., 2016) showed the lower layer, is good to keep the
content and the higher layer is good for keeping the style-related
color, texture, etc. Even face-aging has changed in terms of hair
color, wrinkle, the identity information must be kept or not change.
Based on this we have concluded that face content is a representa-
tion of the identity information that can provide by a lower feature
on age classification hðxÞ.
Modified Age classifier in proposed architecture use loss func-
tion same with Alexnet Age Classifier (Eqn 6):
X 2
Lidentity ¼ jjhðxÞ  hðGðxjC t ÞÞjj ð6Þ
xpx ðxÞ
where h(x) is a feature extracted by a specific feature layer in a
modified preserve identity layer based on Alexnet age classifier
architecture. In this part, perceptual loss used instead of Mean
Square Error between x and its age face GðxjC t Þ. Using cross-
entropy loss the architecture allows the created image to still have
7239
H. Pranoto, Y. Heryadi, Harco Leslie Hendric Spits Warnars et al.
a change in terms of hair color, bread, wrinkles, hairlines, and create
new generated faces differences from input face x. This perceptual
loss is used instead of use Mean Square Error loss as a loss function.
Mean square error loss makes the input image and generated image
has to high similarity or identical. Age-face GðxjC t Þ function use
Mean Square Error will force generated image y became identically
as image x. Choose the perceptual loss as loss function are the right
choice, the perceptual loss encourages the generated image y to be
close in feature spaces with a feature space of input image x, but
still have differential with the image.
To make sure the proposed architecture successfully generated
faces in certain age groups and did not lose the identity from the
input image, we formulated an objective function for the proposed
architecture as we can see in Eqn 7:
Gloss ¼ k1 LG þ k2 Lidentity þ k3 Lage
where k1 controls to the extent the input image is aged. And k1 and
k3 controls to what extent we want to keep the identity information
and let the generated samples fall into the right age groups. In sec-
tion 4, we will empirically find the optimal k1 ,k2 , and k3 .
In the proposed architecture, we improved the accuracy of the
age classifier module. Increasing the accuracy of the classification
section will make the age classifier module stronger to force the
architecture to produce synthetic images in the intended age
group. We made a change in the classification section which to
increase the age classification accuracy is used as the part that
leads the architecture to produce face images in the desired age
group. We also make modifications to the generator, to reduce
the number of computational processes on the architecture, it is
hoped that reducing the number of residuals on the generator will
speed up the training process.
The proposed architecture change in Age Clasiffier and genera-
tors part contained in IPCGAN can see in Fig. 1.
3.2. Architecture
The proposed architecture has three networks in it. The three
networks consist of generator network, discriminator network,
and age classifier network, each of which has a specific task to
jointly produce new face images in the desired age group.
Generator Network: Our generator receives 128  128  3
images and 128  128  5 matrix one-hot code age condition as
input. One-hot code matrix is in age conditions will be inserted
into architecture. In one-hot code, only one feature map layer is
filled with one while the rest feature maps layer is all filled with
zeros. At training, the input image and one-hot code concatenate
before the first layer of convolutional. In the proposed architecture
number of generator residual layer was reduce from 6 residual lay-
Fig. 1. Proposed architecture.
Journal of King Saud University – Computer and Information Sciences 34 (2022) 7236–7246
ers in IPCGANs into 1 layer only, to make proposed architecture has
faster execution time in the training process. For clearly our gener-
ator architecture showed in Table 1.
The residual layer in the face aging architecture provides an
opportunity for the architecture to form an aging pattern using
the weight parameters obtained through the training process, the
residual layer provides an architectural opportunity to produce
synthetic images for the intended age group. However, the residual
layer has disadvantages. Adding the number of residual layers will
increase the number of the parameter in architecture. Increasing
the number of parameters also increases the number of computa-
tions processes, huge computation processes will burden the com-
puter and increase training time. For this reason, the author
reduces the number of residuals in the architecture to has a mini-
mum number of parameters as small as possible, but still can pro-
ð7Þ
duce a face aging pattern. The proposed architecture reduces the
number of computation processes needed, and the architecture
can synthesizing new faces at the desired age target more quickly.
Discriminator network: our discriminator consists 5-layer
convolutional network. The first layer is convolutional layer 4 x4
stride 2 and activation function leaky-ReLU. One hot code matrix
age condition feature with size 64  64  5 has concatenates
together with the output first layer and this combination use as
input for the second layer (Table 2).
Age classification network: our proposed age classification
network is modified from Alexnet age classification architecture.
In this network age classifier and identity preserve part, share
the same architecture from the first to seventh layer. The same
module will use to generated synthetics images at certain target
age groups and preserving information identity from the input face
image.
This age classification network receives 227  227  3-pixel
images from the generator. The generator produces 128  128 x3
pixel face images, before being used in the age classification net-
work. The image resizes into 227  227  3 pixel images uses
image bilinear interpolation. This network process the image with
the convolutional process, activation, batch normalization, pooling
process, linearization and drop out. And at the end of classification,
we use a softmax layer to classify the images and prevent
overfitting.
Because the proposed network use age classification for two
tasks: (1) to force generated image has an aging pattern and (2)
preserving identity, the network shared the first seven-layer. pre-
serving identity module uses the first seven-layer, output from this
layer, computed use perceptual mean-square-loss to force similar-
ity between generated image, an input image, with this way we
preserved the identity form input images. Output from the seventh
layer continued classified into an age group class. If the output
7240
H. Pranoto, Y. Heryadi, Harco Leslie Hendric Spits Warnars et al.
Table 1
Proposed architecture generator.
Input : 128  128  3 face image + 128  128  5 age condition
1 Concatenate 128  128  3 face image with 128  128  5
age condition
Conv 7  7, stride = 1
Batch Normalization 32, eps = 0.001
ReLU
2 Conv 3  3, stride = 2
Batch Normalization 64, eps = 0.001
ReLU
3 Conv 3  3, stride = 2
Batch Normalization 128, eps = 0.001
ReLU
4 Residual
Conv 3  3, stride = 1, padding = 1
BatchNormalization 128, eps = 0.001
ReLU
Conv 3  3, stride = 1, padding = 1
BatchNormalization 128, eps = 0.001
ReLU
5 Deconv 3  3, stride = 2, padding = 1
BatchNormalization 64 , eps = 0.001
ReLU
6 Deconv 3  3, stride = 2, padding = 1
BatchNormalization 32 , eps = 0.001
ReLU
7 Conv 7  7, stride = 1
Tanh
Output : Generated Face Image 128  128  3
Table 2
Proposed discriminator architecture.
Input : 128  128  3 face image + 64  64  5 age condition
1 Conv 4  4, stride = 2
Concatenate 64  64  64 feature map with 64  64  5 age condition
2 Conv 4  4, stride = 2
Batch Normalization 64, eps = 0.001
Leaky-ReLU(0.2)
3 Conv 4  4, stride = 2
Batch Normalization 128, eps = 0.001
Leaky-ReLU(0.2)
4 Conv 4  4, stride = 2
Batch Normalization 128, eps = 0.001
Leaky-ReLU(0.2)
5 Conv 4  4, stride = 2
Output : feature maps 512  4  4
image is classified into the wrong target age groups class, we give a
big penalty to architecture, and a small penalty if the input image
is classified into the right target age group class. Architecture use
this way to force the generated image to fall into the right target
age group class, this way assists the architecture to produce syn-
thetic faces at the specified target age.
To improving the accuracy performance of the age classifier, in
the proposed method, some part of the Alexnet age classifier was
modified. In the proposed architecture some max-pooling layer
in the Alexnet age classifier was replaced with a convolutional
layer.
In a convolutional neural network, a max-pooling layer pro-
vides the ability to learn invariant features and act as a regulator
to reduce the overfitting problem in the training process. A Max-
pooling layer, selected from the convolutional calculation and acti-
vation unit from the previous layer, and reducing the computation
cost by eliminating non-maximum components. By this elimina-
tion provide better performance on architecture that uses sparse
coding and linear classifier. A max-pooling layer also increases
training speed, because the max-pooling layer reduces the input
dimension for the next layer without adding a changeable weight
Journal of King Saud University – Computer and Information Sciences 34 (2022) 7236–7246
parameter, reduces the memory requirement, provides a robust
parameter, and increasing statistical efficiency. Max pooling is for-
mulated in Eqn 8.
fmaxðxÞ ¼ maxi ðxi Þ ð8Þ
However, the biggest drawback of the max pooling operation
relates to the purpose of the max pooling operation, which only
passes a maximum of elements. If the majority of elements in
the pooling area are of high magnitude, the discerning features will
disappear or be eliminated after the max-pooling operation. The
fact of this situation leads to an unacceptable result, as a lot of lost
information is passed on to the layer afterward (Sharma and
1x Mehra, 2019).
In the proposed architecture max-pooling layer in IPCGAN
replace with a convolutional layer until the number of Max-
pooling layers in the proposed architecture remains only 1 layer
from the 4 max-pooling layers. Replacing this max-pooling layer
by convolutional layer in the proposed architecture aim to prevent
information loss after a max-pooling operation. By replacing the
max-pooling layer, the proposed architecture got an increase in
the number of weight parameters from 56,888,709 parameters in
the baseline Alexnet classifier into 85,908,293 parameters.
Logically, increase the number of parameters, will increase
computation cost and processing time. But this replaces, the pro-
posed architecture has some benefits, fist information loss from
layer to layer will reduce, important information from the previous
layer can be reserved. This important feature need for an age clas-
sifier for the classification process, age classifier can classifier input
images into age groups with better accuracy. Max-pooling replace-
ment with a convolutional layer also allows the architecture gener-
ates new weight parameters, which has the benefit to produce
better accuracy (Sharma and Mehra, 2019). After replacing the
max-pooling layer, the proposed architecture c in Table 3.
When replacing the max-pooling layer with the convolutional
layer. we must consider the number of receptive fields in the pro-
posed architecture the same as the baseline model. The receptive
field in a convolutional neural network is defined as an important
region of input space in a convolutional neural network. Receptive
field feature also cand defined as it as central localization and size,
this field important to generating feature in CNN.
3.3. Dataset preparation
Author also observe some face aging dataset (dataset with age
label), such MORPH - Album 1 dataset (Ricanek and Tesafaye,
2006), MORPH - Album 2 dataset (Ricanek and Tesafaye, 2006),
FG-Net (Lanitis, 0000), AdienceFace dataset (Eidinger et al., 2014;
Levi and Hassner, 2015), Cross-Age Celebrity Dataset (CACD)
(Chen et al., 2014), IMDB-WIKI (Rothe et al., 2018), AgeDB
(Moschoglou et al., 2006), and UTKFace (Zhang et al., 2017). To
choose a dataset we must consider dataset distribution groups
and the number of images contained in each age group, unbal-
anced dataset and small or insufficient number of the image make
architecture difficult to find an age pattern model for face aging.
Cross-Age Celebrity Dataset (CACD) (Chen et al., 2014) choose
for training the architecture to generated a model and evaluations.
CACD contains 163,238 face images of 2000 celebrities with an age
range from 16 to 62 all the images are annotated with age, not the
clean label. This number of images is less than the number of the
image from the original dataset because some images are for
cleansing. Dataset has a large variation in pose, illumination,
expression, and even style in the dataset. This dataset also has a
balanced age group distribution, it will help the architecture to find
the age group pattern from the dataset. The distribution from the
dataset can see in Fig. 2.
7241
H. Pranoto, Y. Heryadi, Harco Leslie Hendric Spits Warnars et al.
Fig. 2. CACD dataset distributions.
Before use for training dataset preprocessed, each image in
dataset crop tightly, make face regions approximately 80% percent
of the image, continued with the alignment process into a frontal
face with the key point on the left eye, right eyes, nose, left mouth,
and right mouth, and resized it into 400 pixels  400 pixels. Data-
set divides and grouped into 5 non-overlapping age groups age 11–
29, 21–30, 31–40, 41–50, and 50+, respectively, and separated into
90:1 for training and testing.
3.4. Training process
For training we created a list of 400.000 pairs of age labels, to
make each age group get the same opportunity to train. This list
creates randomly from data but still considering each age group
has the same number of opportunities to train. This list contained
source age condition C s and target age condition C t .
For each age condition C s or C t we prepared a one-hot code
matrix with dimension h  w  5, where h is the height of face
image, w is width face image, and 5 number feature maps from 5
age groups. For the first age group feature maps, we filled one for
the first map, and zero for the rest of the maps, we filled with zeros.
For the second group feature map we fille one into the second map
and zero for the rest of the maps. And so on.
Architecture train to generate face synthetic age at a certain age,
we prepared a pair set of the source face image, and source age
conditions as one-hot code matrix as a label in the generation pro-
cess. We used two image sizes as input, first 128-pixel  128-pixel
face images, used as input images into the generator D and 227-
pixel  227-pixel face images used for the age classification pro-
cess. For the age conditions one-hot code matrix, we prepared
two sizes one-hot code matrix, with size 64  64  5 for the dis-
criminator and 128  128  5 for the generator. In each batch,
the model was trained using 32 pairs of face images and a one-
hot code matrix.
Using the Dataloarder, training data, and test data prepared
with a ratio of 9:1. Our architecture is trained by using train pair
labels of pairs of training label age groups to ensure the architec-
ture is trained in balance, to produce a model which is capable to
generated synthetic face images in age groups with the same good
quality in each age group.
We use the stochastic Gradient Descent (SGD) approach
because the proposed architecture requires an update and exami-
nation of the error on each sample. SGD as the optimization algo-
7242
Journal of King Saud University – Computer and Information Sciences 34 (2022) 7236–7246
rithm add more noise to the learning process, this helps to increase
the generalization of errors. Adam as Stochastic Gradient Descent
(SGD) choose in many deep learning architectures, adam optimizer
can straightforward to implement, need little memory, invariant to
diagonal rescale of gradient value, can use for large dataset or
parameters, fit for non-stationary objective, can implement into
very sparse or noisy gradient and hyperparameters, easy to imple-
ment using intuitive interpretation, easy to configure and only
need a little tuning. Default configuration parameters are almost
well on most problems (Xu, et al., 2015; Gregor et al., 2015). The
best properties in AdaGrad and RMSProp algorithms and combine
in Adam.
We trained the discriminator 2 times and the generator 1 time
to get optimal weight for the discriminator and generator. We
change the Alexnet classifier in the proposed architecture, task to
synthesizing age changes, we replace the max-pooling layer in
Alexnet classifier with a convolutional architecture, continue with
batch normalization to stabilize the layer as the similar method
applied by Perarnau et al (Perarnau et al., 2016). The proposed
age classifier can see in Table 3.
We comparing our method with the IPCGAN (Wang et al., 2018)
a conditional GAN which achieving state-of-the-art performance
for facial aging. For the training proposed architecture, we use
the learning rate as 0.001 and use 32 images per batch size, the
whole training process takes 12,500 iterations each epoch.
Both architectures are trained until the discriminator loss
threshold reaches a value of 10. Both models were trained 5 times
to produce the 5 model weight. Each model weight is used to gen-
erate 500 synthetic images from 100 person images. The 100 per-
son images we selected randomly but we still consider the
proportion of each age group. Both IPCGAN and proposed are
trained to produce faces that look real, at a certain target age
group. After training a model was produced, we train 5 times each
architecture.
The generated image from IPCGAN and our proposed architec-
ture can see in Fig. 3.
Table 3
Proposed architecture age classifier.
Input : 227  227  3 interpolate image from
128  128  3 generator image.
1 Conv 11  11 stride = 4
Batch Normalization 32, eps = 0.001
ReLU
2 Conv 3  3 stride = 2 groups = 2
Batch Normalization 256, eps = 0.001
ReLU
3 Conv 3  3 stride = 2 groups = 2
Batch Normalization 256, eps = 0.001
ReLU
4 Conv 3  3 stride = 1 groups = 2
Batch Normalization 384, eps = 0.001
ReLU
5 Conv 3  3 stride = 1 groups = 2
Batch Normalization 384, eps = 0.001
ReLU
6 Conv 3  3 stride = 2 padding = 1 groups = 2
Batch Normalization 256, eps = 0.001
ReLU
7 Max Pooling 3  3 stride = 2
8 Dropout
Linear (16.384,4096) or fc
ReLU
Linear (4096, 4096) or fc
ReLU
Linear (4096,5) or fc
Output: 5 age classification maps
H. Pranoto, Y. Heryadi, Harco Leslie Hendric Spits Warnars et al. Journal of King Saud University – Computer and Information Sciences 34 (2022) 7236–7246

Fig. 3. Generated image.

4. Experiment and discussion IPCGANs architecture, Table 4 shows the accuracy performance
of the proposed architectures through the measurement uses the
Architecture trained and produce a weight model. This weight k-NN and SVM classification methods by utilizing the triplet
model uses to create synthetics face images. One hundred (100) embedding loss value as a feature. From the results of the k-NN
images from 100 identities, chosen from the CACD dataset, this classification with the augmented dataset, our proposed architec-
image and use as input images for architecture to generate syn- ture has a 4.2% better accuracy from IPCGAN (86.9% accuracy from
thetics face images. For each image, architecture created 1 image the proposed architecture compared to 83.4% IPCGAN accuracy,
for each age group, at the end architecture will produce 500 images and statistical tests on the measurements performed show signifi-
for 5 age groups from 100 identities. These images use for the eval- cance (p-value: 0.009). The results using SVM classification with an
uations process. augmented dataset, our results also show a 3.6% better accuracy
(89.2% accuracy from proposed architecture compared to 86.1%
accuracy IPCGAN), and the results of statistical tests conducted
4.1. Preserving identity ability
show that these differences show significance (p-value: 0.009).
Increasing accuracy is caused by the reduction of the residual layer,
To evaluate preserving identity ability from the IPCGAN and
with the large number of residual layers that must be passed,
proposed architecture when generating a new fake image, we use
changes in weight parameters will rarely occur compared to
FaceNet face recognition architecture introduce by Schroff et al.
IPCGAN.
(Schroff et al., 2015), which using triplet loss embedding as a fea-
For the second scheme, we evaluate the generated synthetics
ture in the face recognition process. FaceNet gets state of art in face
images using the face verification method in the FaceNet architec-
recognition because the has high accuracy when identify and rec-
ture and augmented or not augmented. Augmented data happen
ognize somebody’s face. If FaceNet can identify the synthetic face
when generated synthetics image is included into the dataset,
generated by the GAN models with the correct identity, it means,
and non-augmented data happen when generated synthetics
the models can generate a look real face image and preserving
image is excluded from dataset In this scheme evaluation, similar-
the identity from input face images.
ity distance between synthetic faces and faces image in dataset cal-
FaceNet face recognition (Schroff et al., 2015) requires a dataset
culated using the triplet loss embedding feature. If the similarity
in the training process to produce its triplet loss embedding feature
distance value of the synthesis face is less than the threshold value
which is used in face recognition. To produce a good performance
(0.3), the synthesis face will be categorized as the same identity,
result, prepared 15 other face photos of the same person from 100
and we counted as correct prediction and vice versa. Verification
individuals as the reference dataset from the CACD dataset and a
accuracy is calculated by dividing the number of correct guesses
separate folder for each individual was previously selected. At
by the number of how many times the face recognition has
the end of the preparation of this dataset, we finally had 1500 pho-
guessed.
tos of faces from 100 identities from the dataset for face
Evaluation using the face verification method using an aug-
recognition.
mented dataset shows the proposed architecture also has 8.6% bet-
To evaluate the preserving identity ability from IPCGAN and
ter accuracy (93.7% accuracy from the proposed architecture
proposed architecture, 3 testing schemes were prepared. The first
compared to 86.3% IPCGAN accuracy, and statistical tests carried
scheme, preserving identity evaluates if synthetics image includes
out shows significance (p-value: 0.009). Measurement using the
as a part dataset of FaceNet face recognition, in this scheme gener-
non-augmented dataset also shows that the proposed architecture
ated synthesize face image, put together with FaceNet dataset or
is better than the IPCGAN (71.2% accuracy from proposed architec-
called augmented data. The total amount of face images after gen-
ture compared to 56.5% IPCGAN accuracy, the statistical test also
erated synthesize face images put in the dataset is 2100 images.
shows significance (p-value: 0.009).
The evaluation trying to recognize 100 identities was chosen
The results of the evaluation using k-NN and SVM classification
before. FaceNet trained, and preserving identity ability evaluate
measurements show that reducing the number of residuals in the
use face recognition performance using SVM and KNN classifica-
generator part shows an increase in the accuracy of identification
tion techniques. The same treatment was implemented on IPCGAN
of identities in synthetic images. Residual layers provide an aging
and proposed architecture. The evaluation result first scheme can
effect on the architecture, but this number can be reduced to a suf-
see in Table 4.
ficient number of layers to create an aging effect. In IPCGAN the
From the results of our research, we can conclude the proposed
number of residuals has a total of 6 residual layers, in the proposed
architecture has the ability to preserving identity better than the
7243
H. Pranoto, Y. Heryadi, Harco Leslie Hendric Spits Warnars et al. Journal of King Saud University – Computer and Information Sciences 34 (2022) 7236–7246
Table 4
Evaluation result from k-NN, SVM, Face verification, and umber of parameter.
Model Scheme 1 Scheme 2
Average k-NN Average SVM Face verification
Accuracy Accuracy Accuracy
(augmented)
IPCGAN 83.4% 86.1% 86.3%
Proposed model 86.9% 89.2% 93.7%
(modified Alexnet & (p-value 0.009) (p-value 0.009) (p-value 0.009)
generator)
Proposed model 81.9% 86.5% 87.3%
(modified Alexnet) (p-value 0.251) (p-value 0.465) (p-value 0.251)
architecture it is reduced to a sufficient number of layers to create
an aging effect. In IPCGAN the number of residuals has a total of 6
residual layers, in the proposed architecture it is reduced to only 1
layer. This speeds up the training process and increases the ability
to maintain identity.
The increase in accuracy in this section is caused by a reduction
in the amount of residual contained in the generator section. The
author reduces the number of residual layers to the number of lay-
ers that are still able to perform synthetic face aging on the input
image into a synthetic face image in the desired age group. the
residual layer has the task of producing the effect of face aging,
each parameter in the residual layer adding an aging effect to the
input image. The other convolutional layers in architecture also
adding an aging effect to the input image. Reducing the number
of residual layers to a certain number of the layer will still have
an aging effect on the architecture. The aging effect will reduce
the ability to preserve identity in the architecture. Author reducing
the number of residual layers from baseline architecture until the
number layer can still provide an aging effect, and also can main-
tain identity.
4.2. Aging effect ability
The third scheme uses to evaluate the ability of the models from
both architectures when generating synthetic faces in certain age
groups. In this scheme Age prediction from Rothe et al (Rothe
et al., 2018) architecture use to evaluate the ability of the model.
Age prediction is used to predict age from a generated face image.
If an image from an age group is predicted to be an image in the
same age group as the target age group, it’s called a correct predic-
tion, and if predicted as a different age group, we called this a false
prediction. The accuracy is calculated from the number of correct
predictions divided by the number of predictions was happen.
Evaluation of the aging process, we use age prediction. The pro-
posed architecture shows has 4.5% worst performance, (31.00%
accuracy in proposed architecture compared to 32.48% accuracy
in IPCGAN architecture, but statistical tests these differences do
not show significant results (p-value: 0.754). This decrease is
caused by the number of residuals being reduced from 6 residual
layers to only 1 residual layer, this decrease is due to the proposed
architecture, the opportunity is reduced to carry out the process of
generating aging effect features. Aging effect feature that is useful
for synthesizing facial images in the desired age group. The effect
aging feature can be improved by strengthening the classifier sec-
tion which is actually in charge of leading the architecture to get
the effect aging feature.
Particularly, when the author strengthens the part of the age
classifier to increase the aging effect, action to replace three
max-pooling in Alexnet age classifier with a convolutional layer
7244
Scheme 3
Face Average Age Number of Training
verification Prediction Parameters Speed
Accuracy Accuracy (second)
(non-
augmented)
56.5% 32.48% 66,122,600 191.37
71.2% 31.00% 85,908,293 179.25
(p-value (p-value 0.754)
0.009)
58.00% 33.20% 93,665,064 185.25
(p-value (p-value 0.754)
0.465)
in the proposed architecture is the correct action. Replacing
max-pooling with a convolutional layer reduces the important
information loss, which is this information need for the classifica-
tion process, and is also important in the formation of aging pat-
terns on newly synthesized faces. The improvement in the aging
effect in proposed architecture, when only changes the max-
pooling layer Alexnet classifier (modified Alexnet) show by accu-
racy increase from 32.48% in IPCGAN into 33.20% in the proposed
architecture. Age Prediction evaluation results can see in Table 4.
4.3. Number of parameters
We compared the number of model parameters from IPCGANs
as a baseline architecture compared with our proposed architec-
ture. The number of model parameters can be seen in Table 4.
4.4. Training speed
To evaluate training speed performance, we make a measure-
ment comparison. We measure the speed of training every 100
batch iteration. We average the speed value from 10 measure-
ments. We choose 100 iterations because we want to get big differ-
ences in training speeds between measurement values to make it
easy to compare. Decreasing training speed in proposed architec-
ture caused by elimination number of the residual layer in gener-
ator, from 6 layers to 1 layer.
5. Conclusion
The results of the evaluation using k-NN and SVM classification
method show that reducing the number of residuals in the gener-
ator part shows an increase in the accuracy of identification of
identities in synthetic images. Residual layers provide an aging
effect on the architecture, reducing the number of the residual
layer can be reduced to the ability of the architecture to create
an aging effect, but this factor is not significant. This statement
proves by decreased age prediction from 32.48% to 31.0% (model
1). Decreased accuracy in age prediction proves eliminating the
residual layer will reduce the ability to create the aging effect
but increase the ability to preserving identity.
This statement proved by accuracy increase in proposed model
1 (modified on Alexnet classifier and generator), accuracy increase
from 83.4% (IPCGAN) to 86,9% (model 1) using k-NN classification,
increase from 86.1% (IPCGAN) to 89.2% (model 1) using SVM clas-
sification, increased from 86.3% (IPCGAN) to 93.7% (model 1) using
face verification (augmented data), increase from 56.5% (IPCGAN)
to 71.2% (model 1) using face verification (non augmented data.
Reducing the number of residual layers also speeds up the training
process.
H. Pranoto, Y. Heryadi, Harco Leslie Hendric Spits Warnars et al.
Strengthen the ability of Age classification will increase the
ability to create an aging effect for architecture in general. when
in proposed architecture strengthen by replacing three max-
pooling layers in Alexnet Age classifier with a convolutional layer,
improve aging pattern creation ability. Reducing the max-pooling
layers prevents important information loss which is important
for creating an aging pattern.
In a face aging architecture, the ability to affect aging is inver-
sely proportional to the ability to preserve identity. However, the
aging effect ability can be reduced by strengthening the age classi-
fier section. By strengthening this classification ability, it will
increase the ability of the aging effect. The proposed architecture
utilizes an improved age classifiers to lead the architecture to
shape the face at the intended age. This can be seen in the results
of research that made changes to the classifier, the ability of pre-
diction accuracy increased from 32.48% in IPCGAN to 33.20% (pro-
posed, modified on age classification only.
We also evaluate the speed of training in the model training, the
results show that the training speed from the proposed architec-
ture is 12.77 s faster (191.37 s in IPCGAN subtract by 179.25 s in
the proposed architecture). This increase in processing speed is
caused by a reduction in the number of residual layers contained
in the generator, which reduces the number of parameters in the
architecture so that the computation of the architecture is reduced.
From the results of the evaluation, it can be concluded that:
eliminates residuals layers speeds up the training process because
of the reduction in the number of parameters, but reducing the
ability to produce the aging effect. Residuals help architecture to
produce images for the target age groups. Too many residual make
slower training speed.
Declaration of Competing Interest
The authors declare that they have no known competing finan-
cial interests or personal relationships that could have appeared
to influence the work reported in this paper.
Acknowledgment
No funding for this research.
References
Antipov, G., Baccouche, M., Dugelay, J.L., 2018. Face aging with conditional
generative adversarial networks. Proc. - Int. Conf. Image Process. ICIP vol.
2017-Septe, 2089–2093.
B. C. Chen, C. S. Chen, and W. H. Hsu, ‘‘Cross-age reference coding for age-invariant
face recognition and retrieval,” Lect. Notes Comput. Sci. (including Subser. Lect.
Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 8694 LNCS, no. PART 6, pp.
768–783, 2014.
D. Deb, D. Aggarwal, and A. K. Jain, ‘‘Child Face Age-Progression via Deep Feature
Aging,” arXiv, 2020.
Despois, J., Flament, F., Perrot, M., 2020. AgingMapGAN (AMGAN): High-resolution
controllable face aging with spatially-aware conditional GANs. In: Lect. Notes
Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes
Bioinformatics) vol. 12537 LNCS, pp. 613–628.
C. N. Duong, K. G. Quach, K. Luu, T. H. N. Le, M. Savvides, and T. D. Bui, ‘‘Learning
from Longitudinal Face Demonstration - Where Tractable Deep Modeling Meets
Inverse Reinforcement Learning,” Nov. 2019.
Duong, C.N., Luu, K., Quach, K.G., Bui, T.D., 2016. Longitudinal face modeling via
temporal deep restricted Boltzmann machines. Proc. IEEE Comput. Soc. Conf.
Comput. Vis. Pattern Recognit. vol. 2016-Decem, 5772–5780.
Eidinger, E., Enbar, R., Hassner, T., 2014. Age and gender estimation of unfiltered
faces. IEEE Trans. Inf. Forensics Secur. 9 (12), 2170–2179.
Fang, H., Deng, W., Zhong, Y., Hu, J., 2020. Triple-GAN: Progressive face aging with
triple translation loss. In: IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit
Work, pp. 3500–3509.
Gatys, L., Ecker, A., Bethge, M., 2016. A neural algorithm of artistic style. J. Vis. 16
(12), 326. https://doi.org/10.1167/16.12.326.
Geng, X., Fu, Y., Miles, K.S., 2010. Automatic facial age estimation. In: 11th Pacific
Rim Int Conf. Artif. Intell., pp. 1–130.
I. J. Goodfellow et al., ‘‘Generative Adversarial Networks,” pp. 1–9, 2014.
7245
Journal of King Saud University – Computer and Information Sciences 34 (2022) 7236–7246
K. Gregor, I. Danihelka, A. Graves, D. J. Rezende, and D. Wierstra, ‘‘DRAW: A
recurrent neural network for image generation,” 32nd Int. Conf. Mach. Learn.
ICML 2015, vol. 2, pp. 1462–1471, 2015.
D. J. Im, H. Ma, C. D. Kim, and G. Taylor, ‘‘Generative Adversarial Parallelization,” pp.
1–20, 2016.
Isola, P., Zhu, J.-Y., Zhou, T., Efros, A.A., 2017. Image-to-Image Translation with
Conditional Adversarial Networks. In: IEEE Conference on Computer Vision and
Pattern Recognition (CVPR), pp. 5967–5976.
Johnson, J., Alahi, A., Fei-Fei, L., 2016. Perceptual losses for real-time style transfer
and super-resolution. Lect. Notes Comput. Sci. (including Subser. Lect. Notes
Artif. Intell. Lect. Notes Bioinformatics) vol. 9906 LNCS, 694–711.
Kemelmacher-Shlizerman, I., Suwajanakorn, S., Seitz, S.M., 2014. Illumination-
aware age progression. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern
Recognit., 3334–3341
Lanitis, A., Taylor, C.J., Cootes, T.F., 2002. Toward automatic simulation of aging
effects on face images. IEEE Trans. Pattern Anal. Mach. Intell. 24 (4), 442–455.
A. Lanitis, ‘‘FG-NET Aging Database.” Oct-2010.
Levi, G., Hassner, T., 2015. Age and gender classification using convolutional neural
networks. In: 2015 IEEE Conf Comput. Vis. Pattern Recognit. Work., pp. 34–42.
Q. Li, Y. Liu, and Z. Sun, ‘‘Age Progression and Regression with Spatial Attention
Modules,” arXiv, 2019.
Li, P., Hu, Y., Li, Q., He, R., Sun, Z., 2018. Global and local consistent age generative
adversarial networks. Proc. - Int. Conf. Pattern Recognit. vol. 2018-Augus, 1073–
1078.
C. Liu, J. Yuen, A. Torralba, J. Sivic, and W. T. Freeman, ‘‘SIFT Flow: Dense
Correspondence across Different Scenes,” vol. 1, no. 1, pp. 28–42, 2008.
Liu, Y., Li, Q., Sun, Z., 2019. Attribute-aware face aging with wavelet-based
generative adversarial networks. Proc. IEEE Comput. Soc. Conf. Comput. Vis.
Pattern Recognit. vol. 2019-June, 11869–11878.
S. Liu et al., ‘‘Face Aging with Contextual Generative Adversarial Nets,” Proc. 2017
ACM Multimed. Conf. - MM ’17, pp. 82–90, 2017.
Mao, X., Li, Q., Xie, H., Lau, R.Y.K., Wang, Z., Smolley, S.P., 2017. Least squares
generative adversarial networks. Proc. IEEE Int. Conf. Comput. Vis. vol. 2017-
Octob, 2813–2821.
M. Mirza and S. Osindero, ‘‘Conditional Generative Adversarial Nets,” pp. 1–7, 2014.
S. Moschoglou, C. Sagonas, and I. Kotsia, ‘‘AgeDB : the first manually collected , in-
the-wild age database,” 2006.
Palsson, S., Agustsson, E., Timofte, R., Van Gool, L., 2018. ‘‘Generative adversarial
style transfer networks for face aging. In: IEEE Comput. Soc. Conf. Comput. Vis.
Pattern Recognit Work. vol. 2018-June, pp. 2165–2173.
Panis, G., Lanitis, A., Tsapatsoulis, N., Cootes, T.F., 2016. Overview of research on
facial aging using the FG-NET aging database. IET Biometrics 5 (2), 37–46.
Patterson, E., Ricanek, K., Albert, M., Boone, E., 2006. Automatic representation of
adult aging in facial images. Int. Conf. Vis. Imaging, Image Process., 171 C176.
Perarnau, G., Van De Weijer, J., Raducanu, B., Álvarez, J.M., Csiro, D., 2016.
‘‘Invertible Conditional GANs for image editing”, no. Figure 1, 1–9.
S. Reed, Z. Akata, X. Yan, and L. Logeswaran, ‘‘Generative Adversarial Text to Image
Synthesis,” 2016.
Ricanek Jr., K., Tesafaye, T., 2006. MORPH: A longitudinal image Age-progression, of
normal adult. Proc. 7th Int. Conf. Autom. Face Gesture Recognit.
Rothe, R., Timofte, R., Van Gool, L., 2018. Deep expectation of real and apparent age
from a single image without facial landmarks. Int. J. Comput. Vis. 126 (2-4),
144–157.
Rowland, D.A., Perrett, D.I., 1995. Manipulating Facial Appearance through Shape
and Color. IEEE Comput. Graph. Appl. 15 (5), 70–76.
Schroff, F., Kalenichenko, D., Philbin, J., 2015. FaceNet: A unified embedding for face
recognition and clustering. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern
Recognit. vol. 07–12-June, 815–823.
Sharma, S., Mehra, R., 2019. Implications of Pooling Strategies in convolutional
neural networks: A Deep Insight. Found. Comput. Decis. Sci. 44 (3), 303–330.
Y. Shen, B. Zhou, P. Luo, and X. Tang, ‘‘FaceFeat-GAN: a Two-stage approach for
identity-preserving face synthesis,” arXiv, 2018.
Shu, X., Tang, J., Lai, H., Liu, L., Yan, S., 2015. Personalized age progression with aging
dictionary. Proc. IEEE Int. Conf. Comput. Vis. vol. 2015 Inter, 3970–3978.
Song, J., Zhang, J., Gao, L., Liu, X., Shen, H.T., 2018. Dual conditional GANs for face
aging and rejuvenation. IJCAI Int Jt. Conf. Artif. Intell. vol. 2018-July, 899–905.
Suo, J., Zhu, S.C., Shan, S., Chen, X., 2010. A compositional and dynamic model for
face aging. IEEE Trans. Pattern Anal. Mach. Intell. 32 (3), 385–401.
X. Tang, Z. Wang, W. Luo, and S. Gao, ‘‘Face Aging with Identity-Preserved
Conditional Generative Adversarial Networks,” in 2018 IEEE/CVF
Conference on Computer Vision and Pattern Recognition, 2018, vol. 9, no. 1,
pp. 7939–7947.
Wang, W. et al., 2016. Recurrent face aging. In: 2016 IEEE Conf. Comput. Vis. Pattern
Recognit., pp. 2378–2386.
Z. Wang, X. Tang, W. Luo, and S. Gao, ‘‘Face Aging with Identity-Preserved
Conditional Generative Adversarial Networks,” in Proceedings of the IEEE
Computer Society Conference on Computer Vision and Pattern Recognition,
2018, vol. 9, no. 1, pp. 7939–7947.
Wang, W., Yan, Y., Cui, Z., Feng, J., Yan, S., Sebe, N., 2019. Recurrent face aging with
hierarchical autoregressive memory. IEEE Trans. Pattern Anal. Mach. Intell. 41
(3), 654–668.
K. Xu et al., ‘‘Show, attend and tell: Neural image caption generation with visual
attention,” 32nd Int. Conf. Mach. Learn. ICML 2015, vol. 3, pp. 2048–2057, 2015.
Yang, H., Huang, D., Wang, Y., Jain, A.K., 2018. Learning face age progression: A
pyramid architecture of GANs. In: Proc. IEEE Comput. Soc. Conf. Comput. Vis
Pattern Recognit., pp. 31–39.
H. Pranoto, Y. Heryadi, Harco Leslie Hendric Spits Warnars et al. Journal of King Saud University – Computer and Information Sciences 34 (2022) 7236–7246

X. Yao, G. Puy, A. Newson, Y. Gousseau, and P. Hellier, ‘‘High resolution face age
editing,” arXiv, 2020.
Z. Zhang, Y. Song, and H. Qi, ‘‘Age progression/regression by conditional adversarial
autoencoder,” Proc. - 30th IEEE Conf. Comput. Vis. Pattern Recognition, CVPR
2017, vol. 2017-Janua, pp. 4352–4360, 2017.
Zhu, J., Park, T., Isola, P., Efros, A.A., 2017. Unpaired image-to-image translation
using cycle-consistent adversarial networks. In: IEEE International Conference
on Computer Vision (ICCV), pp. 2242–2251.

7246