Skip to main content

Advertisement

Log in

Assessment of female facial beauty based on anthropometric, non-permanent and acquisition characteristics

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this work we study the interrelation between, on the one hand, subjective perception of female facial aesthetics, and on the other hand, selected objective parameters that include facial features, photo-quality, as well as non-permanent facial characteristics. This study seeks to provide insight on the role of this specific set of features in affecting the way humans perceive facial images. The approach is novel in that it jointly considers both previous results on photo quality and beauty assessment, as well as non-permanent facial characteristics and expressions. Based on 37 such objective parameters, we construct a metric that aims to quantify modifiable parameters for aesthetics enhancement, as well as tunes systems that would seek to predict the way humans perceive facial aesthetics. The proposed metric is evaluated on a face dataset, that includes images with variations in illumination, image quality, as well as age, ethnicity and expression. We show that our approach outperforms two state of the art beauty estimation metrics. In addition we apply the designed metric in three interesting datasets, where we assess beauty in images of females before and after plastic surgery, of females across time, as well as of females famous for their beauty. We conclude by giving insight towards beauty prediction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. Culture Shapes www.wired.com/wiredscience/2008/08/culture-shapes/

  2. Culture Shapes www.wired.com/wiredscience/2008/08/culture-shapes/

  3. For information on denotation of features and according X–values, please refer to Table 2

  4. 3 SVR has been used in similar problems, such as automated age estimation with a reportedly high performance in mapping of actual age to automatically extracted feature vectors [26].

  5. FG–NET dataset http://www.fgnet.rsunit.com/

  6. 5 For this experiment all values attached to non-permanent traits were artificially kept constant for “before surgery” and “after surgery” images.

References

  1. Aarabi P, Hughes D, Mohajer K, Emami M (2001) The automatic measurement of facial beauty. In: Proceedings of IEEE SMC

  2. Alley T, Cunningham M (1991) Averaged faces are attractive, but very attractive faces are not average. Psychol Sci 2:123–125

    Article  Google Scholar 

  3. Bhattacharya S, Sukthankar R, Shah M (2010) A framework for photo-quality assessment and enhancement based on visual aesthetics. In: Procedings of ACM MM

  4. Bottino A, Laurentini A (2010) The analysis of facial beauty: an ermerging area of research in pattern analysis. Lect Notes Comput Sci Image Anal Recogn:6111

  5. Braun C, Gruendl M, Marberger C, Scherber C (2001) Beautycheck - ursachen und folgen von attraktivitaet

  6. Buggio L, Vercellini P, Somigliana E, Vigano P, Frattaruolo MP, Fedele L (2012) “you are so beautiful”*: Behind women’s attractiveness towards the biology of reproduction: a narrative review. Gynecol Endocrinol 28(10):753–757

    Article  Google Scholar 

  7. Chang C-C, Lin C-J (2011) LIBSVM : a library for support vector machines. ACM Trans Int Syst Tech 2(27)

  8. Chang F, Chou C-H (2009) A bi-prototype theory of facial attractiveness. Neural Comput 21(3):890–910

    Article  Google Scholar 

  9. Chen C, Dantcheva A, Ross A (2013) Automatic facial makeup detection with application in face recognition. In: 2013 international conference on biometrics (ICB), pp 1–8

  10. Chen F, Zhang D (2010) A benchmark for geometric facial beauty study. Medical Biometrics 6165:21–32

    Article  Google Scholar 

  11. Chen C, Dantcheva A, Ross A (2014) Impact of facial cosmetics on automatic gender and age estimation algorithms. VISAPP’14

  12. Cheng B, Ni S, Yan B, Tian Q (2010) Learning to photograph. In: Proceedings of ACM MM

  13. Chiang W-C, Lin H-H, Huang C-S, Lo L-J, Wan S-Y (2014) The cluster assessment of facial attractiveness using fuzzy neural network classifier based on 3d moire features. Pattern Recogn 47(3):1249–1260

    Article  Google Scholar 

  14. Dantcheva A, Dugelay J-L (2011) Female facial aesthetics based on soft biometrics and photo-quality. In: Proceedings of ICME

  15. Dantcheva A, Dugelay J-L, Elia P (2010) Person recognition using a bag of facial soft biometrics (bofsb). In: 2010 IEEE international workshop on multimedia signal processing (MMSP), pp 511– 516

  16. Dantcheva A, Dugelay J, Elia P (2010) Soft biometrics systems: Reliability and asymptotic bounds. In: 2010 4th IEEE international conference on biometrics: theory applications and systems (BTAS), pp 1–6

  17. Dantcheva A, Dugelay J-L (2011) Frontal-to-side face re-identification based on hair, skin and clothes patches. In: 2011 8th IEEE international conference on advanced video and signal-based surveillance (AVSS), pp 309–313

  18. Dantcheva A, Chen C, Ross A (2012) Can facial cosmetics affect the matching accuracy of face recognition systems? In: IEEE international conference on biometrics: theory, applications and systems

  19. Dantcheva A, Singh A, Elia P, Dugelay J-L (2011) Search pruning in video surveillance systems: efficiency-reliability tradeoff. In: Proceedings of international conference on computer vision workshops

  20. (2013). Dating and rating webpage HOTorNOT webpage

  21. Davis BC, Lazebnik S (2008) Analysis of human attractiveness using manifold kernel regression. In: Proceedings of IEEE ICIP

  22. Ding L, Martinez AM (2008) Precise detailed detection of faces and facial features. In: Proceedings of CVPR

  23. Doczi G (2005) The power of limits: proportional harmonies in nature, art, and architecture. Shambhala Publications, Boston

    Google Scholar 

  24. Eisenthal Y, Dror G, Ruppin E (2006) Facial attractiveness: beauty and the machine. Neural Comput 18(1):119–142

    Article  Google Scholar 

  25. Eisental Y, Dror G, Leyvand T, Cohen-Or D, Ruppin E (2006) Facial attractiveness: beauty and the machine. Neural Comput 18(1):119–142

    Article  Google Scholar 

  26. Fisher ML, Voracek M (2006) The shape of beauty: determinants of female physical attractiveness. J Cosmet Dermatol 5:190–194

    Article  Google Scholar 

  27. Fink B, Grammer K, Matts PJ (2006) Visible skin color distribution plays a role in the perception of age, attractiveness, and health in female faces. Evol Hum Behav 27:433–442

    Article  Google Scholar 

  28. Fu Y, Guo G-D, Huang T (2010) Age synthesis and estimation via faces: a survey. IEEE Trans Pattern Anal Mach Intell 32(11):1955–1976

    Article  Google Scholar 

  29. Gao W, Cao B, Shan S, Chen X, Zhou D, Zhang X, Zhao D (2008) The cas-peal large-scale chinese face database and baseline evaluations. IEEE Trans Syst Man Cybernet (Part A) 38(1):149–161

    Article  Google Scholar 

  30. Gray D, Yu W. Xu K, Gong Y (2010) Predicting facial beauty without landmarks. In: Proceedings of ECCV

  31. Gunes H (2011) A survey of perception and computation of human beauty. In: Proceedings of J-HGBU ’11 joint ACM workshop on Human gesture and behavior understanding, pp 19–24

  32. Gunes H, Piccardi M, Jan T (2004) Comparative beauty classification for pre-surgery planning. In: Proceedings of SMC

  33. Guo J-M, Lin C-C, Wu M-F, Chang C-H, Lee H (2011) Complexity reduced face detection using probability-based face mask prefiltering and pixel-based hierarchical-feature adaboosting. IEEE Signal Processing Letters

  34. Irem Türkmen H, Kurt Z, Karsligil ME (2007) Global feature based female facial beauty decision system. In: Proceedings of EUSIPCO

  35. Jonas P (1976) Photographic composition simplified. Amphoto

  36. Ji HI, Kamachi M, Akamatsu S (2004) Analyses of facial attractiveness on feminised and juvenilised faces. Perception 33:135145

    Article  Google Scholar 

  37. Kagian A, Dror G, Leyvand T, Cohen-Or D, Ruppin E (2006) A humanlike predictor of facial attractiveness. In: Proceedings of NIPS, no 19, pp 674–683

  38. Kagian A, Dror G, Leyvand T, Meilijson I, Cohen-Or D, Ruppin E (2008) A machine learning predictor of facial attracitveness revealing human-like psychophysical biases. Vis Res 48(2):235– 243

    Article  Google Scholar 

  39. Kendall MG, Stuart A (1973) The advanced theory of statistics: inference and relationship, vol 2. Griffin

  40. Langlois JH, Roggman LA (1990) Attractive faces are only average. Psychol Sci 1:115–121

    Article  Google Scholar 

  41. Laurentini A, Bottino A (2014) Computer analysis of face beauty: a survey. Computer Vision and Image Understanding

  42. Lee L, Loewenstein G, Ariely D, Hong J, Young J (2008) If I’m not hot, are you hot or not? Physical attractiveness evaluations and dating preferences as a function of one’s own attractiveness. Psychol Sci 19(7):669–677

  43. Mao H, Jin L, Du M (2009) Automatic classification of chinese female facial beauty using support vector machine. In: Proceedings of IEEE SMC

  44. McKeen S (2006) A beauty fix plumps up psyche and overall health. The Edmonton Journal

  45. Mizumoto Y, Deguchi T, Fong KW (2009) Assessment of facial golden proportions among young japanese women. American journal of orthodontics and dentofacial orthopedics. Image Vis Comput 136:168–174

    Google Scholar 

  46. Moorthy A, Obrador P, Oliver N (2010) Towards computational models of the visual aesthetic appeal of consumer videos. In: Proceedings of ECCV

  47. Moorthy AK, Bovik AC (2009) A modular framework for constructing blind universal quality indices. IEEE Signal Processing Letters

  48. Moorthy AK, Bovik AC (2009) BIQI software release

  49. Obrador P, Schmidt-Hackenberg L, Oliver N (2010) The role of image composition in image aesthetics. In: Proceedings of IEEE ICIP, pp 3185–3188

  50. O’Toole AJ, Price T, Vetter T, Bartlett JC, Blanz V (1999) 3D shape an d2D surface textures of human faces: The role of “averages” in attractiveness and age. Image Vision Comput 18:9–19

    Article  Google Scholar 

  51. Parris C, Robinson J (1999) The bold and the beautiful according to plastic surgeons. Technical report, Dallas

  52. Perrett DI, May KA, Yoshikawa S (1994) Facial shape and judgements of female attractiveness. Nature 368:239–242

    Article  Google Scholar 

  53. Said CP, Todorov A (2011) A statistical model of facial attractiveness. Psychol Sci 22(9):1183–1190

    Article  Google Scholar 

  54. Savakis A, Etz S, Loui A (2000) Evaluation of image appeal in consumer photography. In: Proceedings of SPIE, pp 111–121

  55. Sheikh HR, Sabir MF, Bovik AC (2006) A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans Image Process 15(11):3440–3451

    Article  Google Scholar 

  56. Singh R, Vatsa M, Bhatt HS, Bharadwaj S, Noore A, Nooreyezdan SS (2010) Plastic surgery: a new dimension to face recognition. IEEE Trans Inf Foren Sec 5(3):441–448

    Article  Google Scholar 

  57. Sutic D, Breskovic I, Huic R, Jukic I (2010) Automatic evaluation of facial attractiveness. In: Proceedings of MIPRO

  58. (2014) Universal concepts of beauty. Prime, vol 4

  59. Vapnik V (2006) Estimation of Dependences Based on Empirical Data: Empirical Inference Science. Information Science and Statistics. Springer, Dordrecht

    Google Scholar 

  60. Voak I, Perrett D, Peirce J (1999) Computer graphic studies of the role of facial similarity in judgements of attractiveness. Curr Psychol 18(1):104-117

    Article  Google Scholar 

  61. Wang J, Gong Y, Gray D (2014) Female facial beauty attribute recognition and editing. In: Fu Y (ed) Human-Centered Social Media Analytics, pp 133–148. Springer International Publishing

  62. Wang Y, Dai Q, Feng R, Jiang Y-G (2013) Beauty is here: Evaluating aesthetics in videos using multimodal features and free training data. In: Proceedings of the 21st ACM International Conference on Multimedia, MM ’13, pages 369–372. ACM

  63. Wang Z, Bovik AC, Sheih HR, Simoncelli EP (2004) Image qulaity assessment: From error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  64. Wang Z, Sheikh HR, Bovik AC (2002) No-reference perceptual quality assessment of jpeg compressed images. In: Proceedings of IEEE ICIP

  65. (2012). Webpage on beautycheck. www.beautycheck.de

  66. Whitehill J, Movellan JR (2008) Personalized facial attractiveness prediction. In: Proceedings of IEEE FRG

  67. White R, Eden A, Maire M (2004) Automatic prediction of human attractiveness. uc berkely technical report

  68. Wu B, Ai H, Liu R (2004) Glasses detection by boosting simple wavelet features. In: Proceedings of ICPR

  69. Zhang D, Zhao Q, Chen F (2011) Quantitative analysis of human facial beauty using geometric features. Pattern Recog 44(4):940–950

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Antitza Dantcheva.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dantcheva, A., Dugelay, JL. Assessment of female facial beauty based on anthropometric, non-permanent and acquisition characteristics. Multimed Tools Appl 74, 11331–11355 (2015). https://doi.org/10.1007/s11042-014-2234-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2234-5

Keywords

Navigation