Skip to main content
SpringerLink
Log in

Improvement of Facial Beauty Prediction Using Artificial Human Faces Generated by Generative Adversarial Network

  • Published:
Cognitive Computation Aims and scope Submit manuscript

Abstract

Human beauty evaluation is a particularly difficult task. This task can be solved using deep learning methods. We propose a new method for determining the attractiveness of a face by using the generation of synthetic data. Our approach uses the generative adversarial network (GAN) to generate an artificial face and then predict the facial beauty of the generated face to improve facial beauty predictions. A study of images with different brightness and contrast showed that the methods using the convolutional neural network (CNN) model have fewer errors than compared to the multilayer perceptron (MLP) model that uses the method. The MLP model only responds to geometric facial proportions, whereas the CNN model additionally responds to changes in face color. Using the synthetic face instead of the real face improves the determination of accuracy of the facial attractiveness. The ability to appreciate facial beauty also opens the way for facial beauty modifications in a latent space. Further research could improve facial normalization in the latent space to improve the accuracy of facial beauty determination.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

Data Availability

Data will be made available upon reasonable request.

References

  1. Little AC, Jones BC, DeBruine LM. Facial attractiveness: evolutionary based research. Philosophical transactions of the Royal Society of London. Series B, Biol Sci. 2011;366(1571), 1638–1659. https://doi.org/10.1098/rstb.2010.0404.

  2. Rasti S, Yazdi M, Masnadi-Shirazi MA. Biologically inspired makeup detection system with application in face recognition. IET Biom. 2018;7:530–5. https://doi.org/10.1049/iet-bmt.2018.5059.

    Article  Google Scholar 

  3. Cunningham MR, Barbee AP, Philhower CL. Dimensions of facial physical attractiveness: the intersection of biology and culture. In: Rhodes G, Zebrowitz LA, editors. Facial attractiveness: Evolutionary, cognitive, and social perspectives. Ablex Publishing; 2002. p. 193–238.

    Google Scholar 

  4. Siagian C, Itti L. Biologically-inspired face detection: non-brute-force-search approach. Conference on Computer Vision and Pattern Recognition Workshop. 2004;2004:62–62. https://doi.org/10.1109/CVPR.2004.308.

    Article  Google Scholar 

  5. Tong S, Liang X, Kumada T, Iwaki S. Putative ratios of facial attractiveness in a deep neural network. In Vision Research 2021;Vol. 178, pp. 86–99. Elsevier BV. https://doi.org/10.1016/j.visres.2020.10.001.

  6. Saeed J, Abdulazeez AM. Facial beauty prediction and analysis based on deep convolutional neural network: a review. J Soft Comput Data Min. 2021;2(1):1–12.

    Google Scholar 

  7. Burusapat C, Lekdaeng P. What is the most beautiful facial proportion in the 21st century? comparative study among miss universe, miss universe thailand, neoclassical canons, and facial golden ratios. Plast Reconstr Surg - Glob Open. 2019;7(2). https://doi.org/10.1097/GOX.0000000000002044.

  8. Rizvi QM, Karawia AA, Kumar S. Female facial beauty analysis for assesment of facial attractivness. Proceedings of the 2013 2nd International Conference on Information Management in the Knowledge Economy, IMKE. 2013;156–160.

  9. Carvajal J, Wiliem A, Sanderson C, Lovell B. Towards miss universe automatic prediction: the evening gown competition. Int Conf Pattern Recognit. 2016;1089–1094. https://doi.org/10.1109/ICPR.2016.7899781.

  10. Chen F, Xiao X, Zhang D. Data-driven facial beauty analysis: prediction, retrieval and manipulation. IEEE Trans Affect Comput. 2018;9(2):205–16. https://doi.org/10.1109/TAFFC.2016.2599534.

    Article  Google Scholar 

  11. Dornaika F, Elorza A, Wang K, Arganda-Carreras I. Image-based face beauty analysis via graph-based semi-supervised learning. Multimedia Tools and Applications. 2020;79(3–4):3005–30. https://doi.org/10.1007/s11042-019-08206-8.

    Article  Google Scholar 

  12. El Rhazi M, Zarghili A, Majda A, Bouzalmat A, Oufkir AA. Facial beauty analysis by age and gender. Int J Intell Syst Technol Appl. 2019;18(1–2):179–203. https://doi.org/10.1504/IJISTA.2019.097757.

    Article  Google Scholar 

  13. Abayomi-alli OO, Damaševicius R, Maskeliunas R, Misra S. Few-shot learning with a novel voronoi tessellation-based image augmentation method for facial palsy detection. Electronics. 2021;10(8). https://doi.org/10.3390/electronics10080978.

  14. Hong Y, Nam GP, Choi H, Cho J, Kim IJ. A novel framework for assessing facial attractiveness based on facial proportions. Symmetry. 2017;9(12). https://doi.org/10.3390/sym9120294.

  15. Kaya KS, Türk B, Cankaya M, Seyhun N, Coşkun BU. Assessment of facial analysis measurements by golden proportion. Braz J Otorhinolaryngol. 2019;85(4):494–501. https://doi.org/10.1016/j.bjorl.2018.07.009.

    Article  Google Scholar 

  16. Young P. Assessment of ideal dimensions of the ears, nose, and lip in the circles of prominence theory on facial beauty. JAMA Facial Plastic Surgery. 2019;21(3):199–205. https://doi.org/10.1001/jamafacial.2018.1797.

    Article  MathSciNet  Google Scholar 

  17. Zhang L, Zhang D, Sun M, Chen F. Facial beauty analysis based on geometric feature: toward attractiveness assessment application. Expert Syst Appl. 2017;82:252–65. https://doi.org/10.1016/j.eswa.2017.04.021.

    Article  Google Scholar 

  18. Lebedeva I, Guo Y, Ying F. MEBeauty: a multi-ethnic facial beauty dataset in-the-wild. Neural Comput Appl. 2021. https://doi.org/10.1007/s00521-021-06535-0.

    Article  Google Scholar 

  19. Wei W, Ho ESL, McCay KD, Damaševičius R, Maskeliūnas R, Esposito A. Assessing facial symmetry and attractiveness using augmented reality. Pattern Anal Appl. 2021. https://doi.org/10.1007/s10044-021-00975-z.

    Article  Google Scholar 

  20. Cao K, Choi K, Jung H, Duan L. Deep learning for facial beauty prediction. Information. 2020;11(8). https://doi.org/10.3390/INFO11080391.

  21. Lin L, Liang L, Jin L. Regression guided by relative ranking using convolutional neural network (R3CNN) for facial beauty prediction. IEEE Trans Affect Comput. 2019. https://doi.org/10.1109/TAFFC.2019.2933523.

    Article  Google Scholar 

  22. Xu J, Jin L, Liang L, Feng Z, Xie D, Mao H. Facial attractiveness prediction using psychologically inspired convolutional neural network (PI-CNN). IEEE Int Conf Acoust Speech and Signal Process. 2017;1657–1661. https://doi.org/10.1109/ICASSP.2017.7952438.

  23. Siddiqi MH, Khan K, Khan RU, Alsirhani A. Face image analysis using machine learning: a survey on recent trends and applications. Electronics. 2022;11(8). https://doi.org/10.3390/electronics11081210.

  24. Iyer TJ, Rahul K, Nersisson R, Zhuang Z, Joseph Raj AN, Refayee I. Machine learning-based facial beauty prediction and analysis of frontal facial images using facial landmarks and traditional image descriptors. Comput Intell Neurosci. 2021. https://doi.org/10.1155/2021/4423407.

  25. Dantcheva A, Dugelay J-L. Assessment of female facial beauty based on anthropometric, non-permanent and acquisition characteristics. Multimed Tools Appl. 2014;74(24):11331–55. https://doi.org/10.1007/s11042-014-2234-5.

    Article  Google Scholar 

  26. Packiriswamy V, Kumar P, Rao M. Identification of facial shape by applying golden ratio to the facial measurements: an interracial study in malaysian population. N Am J Med Sci. 2012;4(12):624–9. https://doi.org/10.4103/1947-2714.104312.

    Article  Google Scholar 

  27. Little AC, Jones BC, DeBruine LM. Facial attractiveness: evolutionary based research. Philosophical transactions of the Royal Society of London. Series B, Biol Scie. 2011;366(1571), 1638–1659. https://doi.org/10.1098/rstb.2010.0404.

  28. Mealey L, Bridgestock R, Townsend G. Symmetry and perceived facial attractiveness. J Pers Soc Psychol. 1999;76:151–8. https://doi.org/10.1037/0022-3514.76.1.151.

    Article  Google Scholar 

  29. Ishi H, Jiro G, Kamachi M, Mukaida S, Akamatsu S. Analyses of facial attractiveness on feminised and juvenilised faces. Perception. 2004;33(2):135–45. https://doi.org/10.1068/p3301.

    Article  Google Scholar 

  30. Foo Y, Simmons L, Rhodes G. Predictors of facial attractiveness and health in humans. Sci Rep. 2017;7:39731. https://doi.org/10.1038/srep39731.

    Article  Google Scholar 

  31. Ibáñez-Berganza M, Amico A, Loreto V. Subjectivity and complexity of facial attractiveness. Sci Rep. 2019;9(1). https://doi.org/10.1038/s41598-019-44655-9.

  32. Lin L, Liang L, Jin L, Chen W. Attribute-aware convolutional neural networks for facial beauty prediction. In 28th International Joint Conference on Artificial Intelligence (IJCAI-19). 2019. https://doi.org/10.24963/ijcai.2019/119.

  33. Gan J, Xiang L, Zhai Y, Mai C, He G, Zeng J, Bai Z, Donida Labati R, Piuri V, Scotti F. 2M BeautyNet: facial beauty prediction based on multi-task transfer learning. IEEE Access. 2020;8:20245–56. https://doi.org/10.1109/access.2020.2968837.

    Article  Google Scholar 

  34. Anderson R, Gema AP, Suharjito, Isa SM. Facial attractiveness classification using deep learning. 2018 Indonesian Association for Pattern Recognition International Conference (INAPR). 2018. https://doi.org/10.1109/inapr.2018.8627004.

  35. Vahdati E, Suen CY. Facial beauty prediction from facial parts using multi-task and multi-stream convolutional neural networks. Intern J Pattern Recogniti Artif Intell. 2021;35(12). https://doi.org/10.1142/S0218001421600028.

  36. Xiao Q, Wu Y, Wang D, Yang Y, Jin X. Beauty3DFaceNet: deep geometry and texture fusion for 3D facial attractiveness prediction. Computers and Graphics (Pergamon). 2021;98:11–8. https://doi.org/10.1016/j.cag.2021.04.023.

    Article  Google Scholar 

  37. Bougourzi F, Dornaika F, Taleb-Ahmed A. Deep learning based face beauty prediction via dynamic robust losses and ensemble regression. Knowl-Based Systs. 2022;242. https://doi.org/10.1016/j.knosys.2022.108246.

  38. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y. Generative adversarial networks. In International Conference on Neural Information Processing Systems (NIPS 2014). 2014;pp. 2672–2680.

  39. Rosado P, Fernández R, Reverter F. GANs and artificial facial expressions in synthetic portraits. Big Data Cogn Comput. 2021;5:63. https://doi.org/10.3390/bdcc5040063.

    Article  Google Scholar 

  40. Kelly T, Guerrero P, Steed A, Wonka P, Mitra NJ. FrankenGAN. ACM Trans Graph. 2019;37(1):1. https://doi.org/10.1145/3272127.3275065.

    Article  Google Scholar 

  41. Dirvanauskas D, Maskeliūnas R, Raudonis V, Damaševičius R, Scherer R. HEMIGEN: human embryo image generator based on generative adversarial networks. Sensors. 2019;19(16). https://doi.org/10.3390/s19163578.

  42. Gary BH, Marwan M, Berg T, Learned-Miller E. Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Workshop on Faces in 'Real-Life' Images: Detection, Alignment, and Recognition, Marseille, France. 2008. 

  43. KING DE. Dlib-ml: a machine learning toolkit. Journal Mach Learn Res. 2009;vol. 10. pp. 1755–1758.

  44. Tero K, Miika A, Janne H, Samuli L, Jaakko L, Timo A. Training generative adversarial networks with limited data. In Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS'20). Curran Associates Inc., Red Hook, NY, USA. 2020;Article 1015, 12104–12114.

  45. Siahaan E, Redi JA, Hanjalic A. Beauty is in the scale of the beholder: comparison of methodologies for the subjective assessment of image aesthetic appeal. Sixth International Workshop on Quality of Multimedia Experience (QoMEX). 2014;2014:245–50. https://doi.org/10.1109/QoMEX.2014.6982326.

    Article  Google Scholar 

  46. Kingma DP, Ba J. Adam: a method for stochastic optimization. arXiv 2017. arXiv:1412.6980.

  47. Fan Y-Y, et al. Label distribution-based facial attractiveness computation by deep residual learning. IEEE Trans Multimedia. 2018;20(8):2196–208. https://doi.org/10.1109/TMM.2017.2780762.

    Article  Google Scholar 

  48. Lin L, Liang L, Jin L, Chen W. Attribute-aware convolutional neural networks for facial beauty prediction. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. 2019. https://doi.org/10.24963/ijcai.2019/119.

  49. Liang L, Lin L, Jin L, Xie D, Li M. SCUT-FBP5500: a diverse benchmark dataset for multi-paradigm facial beauty prediction, 2018 24th International Conference on Pattern Recognition (ICPR). 2018;pp. 1598–1603. https://doi.org/10.1109/ICPR.2018.8546038.

  50. Wong HK, Stephen ID, Keeble DRT. The own-race bias for face recognition in a multiracial society. Front Psychol 2020; (Vol. 11). https://doi.org/10.3389/fpsyg.2020.00208.

Download references

Author information

Authors and Affiliations

  1. Faculty of Informatics, Multimedia Engineering Department, Kaunas University of Technology, Kaunas, Lithuania

    Donatas Laurinavičius & Rytis Maskeliūnas

  2. Faculty of Applied Mathematics, Silesian University of Technology, Gliwice, Poland

    Robertas Damaševičius

Authors
  1. Donatas Laurinavičius
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rytis Maskeliūnas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Robertas Damaševičius
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Robertas Damaševičius.

Ethics declarations

Ethical Approval

This article does not contain any studies with human participants performed by any of the authors.

Conflict of Interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Laurinavičius, D., Maskeliūnas, R. & Damaševičius, R. Improvement of Facial Beauty Prediction Using Artificial Human Faces Generated by Generative Adversarial Network. Cogn Comput 15, 998–1015 (2023). https://doi.org/10.1007/s12559-023-10117-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12559-023-10117-8

Keywords

Search

Navigation