AEP-GAN: Aesthetic Enhanced Perception

Generative Adversarial Network for Asian

facial beauty synthesis
 Huanyu Chen, 
 Weisheng Li, 
 Xinbo Gao & 
 Bin Xiao 
Applied Intelligence (2023)Cite this article
 30 Accesses
 1 Altmetric
 Metricsdetails

Abstract
In this paper, we address the task of facial aesthetics enhancement (FAE).
Existing methods have made great progress, however, beautified images
generated by existing methods are extremely prone to over-beautification,
which limits the application of existing aesthetic enhancement methods in real
scenes. To solve this problem, we propose a new method called aesthetic
enhanced perception generative adversarial network (AEP-GAN). We builds
three blocks to complete facial beautification guided by facial aesthetic
landmarks: an aesthetic deformation perception block (ADP), an aesthetic
synthesis and removal block (ASR), and a dual-agent aesthetic identification
block (DAI). The ADP learns the implicit aesthetic transformation between the
landmarks of the source image and enhanced image. ASR ensures the
consistency of image identity before and after beautification. The DAI
distinguishes between the source images and generated images. At the same
time, to prevent over-beautification, we constructed a real-world facial
wedding photography dataset to enable the model to learn human aesthetics.
To evaluate the effectiveness of the AEP-GAN, this paper adopted the wedding
photography dataset for training, the SCUT-FBP5500 dataset, and the high-
resolution Asian face dataset for testing. Experiments showed that the AEP-
GAN addresses the over-beautification problem and achieves excellent results.
This is a preview of subscription content, access via your institution.

References
1. Thakerar JN, Saburo I (1979) Cross-cultural comparisons in
interpersonal attraction of females toward males. J Soc Psychol
108(1):121–122

Article Google Scholar 

2. Kim WH, Choi JH, Lee JS (2020) Objectivity and subjectivity in

aesthetic quality assessment of digital photographs. IEEE Trans Affect
Comput 11(3):493–506

Article Google Scholar 

3. Chen Y, Hu Y, Zhang L, Li P, Zhang C (2018) Engineering deep

representations for modeling aesthetic perception. IEEE Trans Cybern
48(11):3092–3104

Article Google Scholar 

4. Tommer L, Daniel CO, Gideon D, Dani L (2008) Data-driven

enhancement of facial attractiveness. ACM Trans Graph 27(3):38

Google Scholar 

5. Seo M, Chen Y-W, Aoki H (2011) Automatic transformation of ”kogao”

(small face) based on fast b-spline approximation. J Inf Hiding
Multimed Sig Process 2:192–203

Google Scholar 

6. Sun M, Zhang D, Yang J (2011) Face attractiveness improvement using

beauty prototypes and decision. In: The First Asian Conference on
Pattern Recognition, pp 283–287
7. Roy H, Dhar S, Dey K, Acharjee S, Ghosh D (2018) An automatic face
attractiveness improvement using the golden ratio. In: Advanced
Computational and Communication Paradigms, pp 755–763
8. Grammer K, Thornhill R (1994) Human (homo sapiens) facial
attractiveness and sexual selection: The role of symmetry and
averageness, vol 108, pp 233–42
9. Langlois JH, Roggman LA (1990) Attractive faces are only average.
Psychol Sci 1(2):115–121

Article Google Scholar