Abstract
In this work we study the interrelation between, on the one hand, subjective perception of female facial aesthetics, and on the other hand, selected objective parameters that include facial features, photo-quality, as well as non-permanent facial characteristics. This study seeks to provide insight on the role of this specific set of features in affecting the way humans perceive facial images. The approach is novel in that it jointly considers both previous results on photo quality and beauty assessment, as well as non-permanent facial characteristics and expressions. Based on 37 such objective parameters, we construct a metric that aims to quantify modifiable parameters for aesthetics enhancement, as well as tunes systems that would seek to predict the way humans perceive facial aesthetics. The proposed metric is evaluated on a face dataset, that includes images with variations in illumination, image quality, as well as age, ethnicity and expression. We show that our approach outperforms two state of the art beauty estimation metrics. In addition we apply the designed metric in three interesting datasets, where we assess beauty in images of females before and after plastic surgery, of females across time, as well as of females famous for their beauty. We conclude by giving insight towards beauty prediction.
Similar content being viewed by others
Notes
Culture Shapes www.wired.com/wiredscience/2008/08/culture-shapes/
Culture Shapes www.wired.com/wiredscience/2008/08/culture-shapes/
For information on denotation of features and according X–values, please refer to Table 2
3 SVR has been used in similar problems, such as automated age estimation with a reportedly high performance in mapping of actual age to automatically extracted feature vectors [26].
FG–NET dataset http://www.fgnet.rsunit.com/
5 For this experiment all values attached to non-permanent traits were artificially kept constant for “before surgery” and “after surgery” images.
References
Aarabi P, Hughes D, Mohajer K, Emami M (2001) The automatic measurement of facial beauty. In: Proceedings of IEEE SMC
Alley T, Cunningham M (1991) Averaged faces are attractive, but very attractive faces are not average. Psychol Sci 2:123–125
Bhattacharya S, Sukthankar R, Shah M (2010) A framework for photo-quality assessment and enhancement based on visual aesthetics. In: Procedings of ACM MM
Bottino A, Laurentini A (2010) The analysis of facial beauty: an ermerging area of research in pattern analysis. Lect Notes Comput Sci Image Anal Recogn:6111
Braun C, Gruendl M, Marberger C, Scherber C (2001) Beautycheck - ursachen und folgen von attraktivitaet
Buggio L, Vercellini P, Somigliana E, Vigano P, Frattaruolo MP, Fedele L (2012) “you are so beautiful”*: Behind women’s attractiveness towards the biology of reproduction: a narrative review. Gynecol Endocrinol 28(10):753–757
Chang C-C, Lin C-J (2011) LIBSVM : a library for support vector machines. ACM Trans Int Syst Tech 2(27)
Chang F, Chou C-H (2009) A bi-prototype theory of facial attractiveness. Neural Comput 21(3):890–910
Chen C, Dantcheva A, Ross A (2013) Automatic facial makeup detection with application in face recognition. In: 2013 international conference on biometrics (ICB), pp 1–8
Chen F, Zhang D (2010) A benchmark for geometric facial beauty study. Medical Biometrics 6165:21–32
Chen C, Dantcheva A, Ross A (2014) Impact of facial cosmetics on automatic gender and age estimation algorithms. VISAPP’14
Cheng B, Ni S, Yan B, Tian Q (2010) Learning to photograph. In: Proceedings of ACM MM
Chiang W-C, Lin H-H, Huang C-S, Lo L-J, Wan S-Y (2014) The cluster assessment of facial attractiveness using fuzzy neural network classifier based on 3d moire features. Pattern Recogn 47(3):1249–1260
Dantcheva A, Dugelay J-L (2011) Female facial aesthetics based on soft biometrics and photo-quality. In: Proceedings of ICME
Dantcheva A, Dugelay J-L, Elia P (2010) Person recognition using a bag of facial soft biometrics (bofsb). In: 2010 IEEE international workshop on multimedia signal processing (MMSP), pp 511– 516
Dantcheva A, Dugelay J, Elia P (2010) Soft biometrics systems: Reliability and asymptotic bounds. In: 2010 4th IEEE international conference on biometrics: theory applications and systems (BTAS), pp 1–6
Dantcheva A, Dugelay J-L (2011) Frontal-to-side face re-identification based on hair, skin and clothes patches. In: 2011 8th IEEE international conference on advanced video and signal-based surveillance (AVSS), pp 309–313
Dantcheva A, Chen C, Ross A (2012) Can facial cosmetics affect the matching accuracy of face recognition systems? In: IEEE international conference on biometrics: theory, applications and systems
Dantcheva A, Singh A, Elia P, Dugelay J-L (2011) Search pruning in video surveillance systems: efficiency-reliability tradeoff. In: Proceedings of international conference on computer vision workshops
(2013). Dating and rating webpage HOTorNOT webpage
Davis BC, Lazebnik S (2008) Analysis of human attractiveness using manifold kernel regression. In: Proceedings of IEEE ICIP
Ding L, Martinez AM (2008) Precise detailed detection of faces and facial features. In: Proceedings of CVPR
Doczi G (2005) The power of limits: proportional harmonies in nature, art, and architecture. Shambhala Publications, Boston
Eisenthal Y, Dror G, Ruppin E (2006) Facial attractiveness: beauty and the machine. Neural Comput 18(1):119–142
Eisental Y, Dror G, Leyvand T, Cohen-Or D, Ruppin E (2006) Facial attractiveness: beauty and the machine. Neural Comput 18(1):119–142
Fisher ML, Voracek M (2006) The shape of beauty: determinants of female physical attractiveness. J Cosmet Dermatol 5:190–194
Fink B, Grammer K, Matts PJ (2006) Visible skin color distribution plays a role in the perception of age, attractiveness, and health in female faces. Evol Hum Behav 27:433–442
Fu Y, Guo G-D, Huang T (2010) Age synthesis and estimation via faces: a survey. IEEE Trans Pattern Anal Mach Intell 32(11):1955–1976
Gao W, Cao B, Shan S, Chen X, Zhou D, Zhang X, Zhao D (2008) The cas-peal large-scale chinese face database and baseline evaluations. IEEE Trans Syst Man Cybernet (Part A) 38(1):149–161
Gray D, Yu W. Xu K, Gong Y (2010) Predicting facial beauty without landmarks. In: Proceedings of ECCV
Gunes H (2011) A survey of perception and computation of human beauty. In: Proceedings of J-HGBU ’11 joint ACM workshop on Human gesture and behavior understanding, pp 19–24
Gunes H, Piccardi M, Jan T (2004) Comparative beauty classification for pre-surgery planning. In: Proceedings of SMC
Guo J-M, Lin C-C, Wu M-F, Chang C-H, Lee H (2011) Complexity reduced face detection using probability-based face mask prefiltering and pixel-based hierarchical-feature adaboosting. IEEE Signal Processing Letters
Irem Türkmen H, Kurt Z, Karsligil ME (2007) Global feature based female facial beauty decision system. In: Proceedings of EUSIPCO
Jonas P (1976) Photographic composition simplified. Amphoto
Ji HI, Kamachi M, Akamatsu S (2004) Analyses of facial attractiveness on feminised and juvenilised faces. Perception 33:135145
Kagian A, Dror G, Leyvand T, Cohen-Or D, Ruppin E (2006) A humanlike predictor of facial attractiveness. In: Proceedings of NIPS, no 19, pp 674–683
Kagian A, Dror G, Leyvand T, Meilijson I, Cohen-Or D, Ruppin E (2008) A machine learning predictor of facial attracitveness revealing human-like psychophysical biases. Vis Res 48(2):235– 243
Kendall MG, Stuart A (1973) The advanced theory of statistics: inference and relationship, vol 2. Griffin
Langlois JH, Roggman LA (1990) Attractive faces are only average. Psychol Sci 1:115–121
Laurentini A, Bottino A (2014) Computer analysis of face beauty: a survey. Computer Vision and Image Understanding
Lee L, Loewenstein G, Ariely D, Hong J, Young J (2008) If I’m not hot, are you hot or not? Physical attractiveness evaluations and dating preferences as a function of one’s own attractiveness. Psychol Sci 19(7):669–677
Mao H, Jin L, Du M (2009) Automatic classification of chinese female facial beauty using support vector machine. In: Proceedings of IEEE SMC
McKeen S (2006) A beauty fix plumps up psyche and overall health. The Edmonton Journal
Mizumoto Y, Deguchi T, Fong KW (2009) Assessment of facial golden proportions among young japanese women. American journal of orthodontics and dentofacial orthopedics. Image Vis Comput 136:168–174
Moorthy A, Obrador P, Oliver N (2010) Towards computational models of the visual aesthetic appeal of consumer videos. In: Proceedings of ECCV
Moorthy AK, Bovik AC (2009) A modular framework for constructing blind universal quality indices. IEEE Signal Processing Letters
Moorthy AK, Bovik AC (2009) BIQI software release
Obrador P, Schmidt-Hackenberg L, Oliver N (2010) The role of image composition in image aesthetics. In: Proceedings of IEEE ICIP, pp 3185–3188
O’Toole AJ, Price T, Vetter T, Bartlett JC, Blanz V (1999) 3D shape an d2D surface textures of human faces: The role of “averages” in attractiveness and age. Image Vision Comput 18:9–19
Parris C, Robinson J (1999) The bold and the beautiful according to plastic surgeons. Technical report, Dallas
Perrett DI, May KA, Yoshikawa S (1994) Facial shape and judgements of female attractiveness. Nature 368:239–242
Said CP, Todorov A (2011) A statistical model of facial attractiveness. Psychol Sci 22(9):1183–1190
Savakis A, Etz S, Loui A (2000) Evaluation of image appeal in consumer photography. In: Proceedings of SPIE, pp 111–121
Sheikh HR, Sabir MF, Bovik AC (2006) A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans Image Process 15(11):3440–3451
Singh R, Vatsa M, Bhatt HS, Bharadwaj S, Noore A, Nooreyezdan SS (2010) Plastic surgery: a new dimension to face recognition. IEEE Trans Inf Foren Sec 5(3):441–448
Sutic D, Breskovic I, Huic R, Jukic I (2010) Automatic evaluation of facial attractiveness. In: Proceedings of MIPRO
(2014) Universal concepts of beauty. Prime, vol 4
Vapnik V (2006) Estimation of Dependences Based on Empirical Data: Empirical Inference Science. Information Science and Statistics. Springer, Dordrecht
Voak I, Perrett D, Peirce J (1999) Computer graphic studies of the role of facial similarity in judgements of attractiveness. Curr Psychol 18(1):104-117
Wang J, Gong Y, Gray D (2014) Female facial beauty attribute recognition and editing. In: Fu Y (ed) Human-Centered Social Media Analytics, pp 133–148. Springer International Publishing
Wang Y, Dai Q, Feng R, Jiang Y-G (2013) Beauty is here: Evaluating aesthetics in videos using multimodal features and free training data. In: Proceedings of the 21st ACM International Conference on Multimedia, MM ’13, pages 369–372. ACM
Wang Z, Bovik AC, Sheih HR, Simoncelli EP (2004) Image qulaity assessment: From error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Wang Z, Sheikh HR, Bovik AC (2002) No-reference perceptual quality assessment of jpeg compressed images. In: Proceedings of IEEE ICIP
(2012). Webpage on beautycheck. www.beautycheck.de
Whitehill J, Movellan JR (2008) Personalized facial attractiveness prediction. In: Proceedings of IEEE FRG
White R, Eden A, Maire M (2004) Automatic prediction of human attractiveness. uc berkely technical report
Wu B, Ai H, Liu R (2004) Glasses detection by boosting simple wavelet features. In: Proceedings of ICPR
Zhang D, Zhao Q, Chen F (2011) Quantitative analysis of human facial beauty using geometric features. Pattern Recog 44(4):940–950
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Dantcheva, A., Dugelay, JL. Assessment of female facial beauty based on anthropometric, non-permanent and acquisition characteristics. Multimed Tools Appl 74, 11331–11355 (2015). https://doi.org/10.1007/s11042-014-2234-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2234-5