Skip to main content
SpringerLink
Log in
Book cover

International Conference on Analysis of Images, Social Networks and Texts

AIST 2017: Analysis of Images, Social Networks and Texts pp 255–266Cite as

Floor-Ladder Framework for Human Face Beautification

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10716))

Abstract

In this paper, we propose a Floor-Ladder Framework (FLN) based on age evolution rules to generate beautified human faces. Beside the shape of faces, younger faces achieve more attractiveness. Thus we process the beautiful face by applying the reversed aging rules. Inspired by the layered optimization methods, the FLN adopts three floors and each floor contains two ladders: the Single Layer Older Neural Network (SLONN) and the extended Skull Model. The Peak Shift algorithm is designed to train the SLONN aiming to capture the reversed aging rules of the face skin. Due to the growth rules of the face shape, we extended the Skull Model by adding Marquardt Mask. Given the input portrait, our algorithm effectively produces a beautified human face without losing personal features.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Shu, X., Tang, J., Lai, H., et al.: Personalized age progression with aging dictionary. In: IEEE International Conference on Computer Vision (ICCV), pp. 3970–3978 (2015)

    Google Scholar 

  2. Kemelmachershlizerman, I., Suwajanakorn, S., Seitz, S.M.: Illumination-aware age progression. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3334–3341 (2014)

    Google Scholar 

  3. FG-NET Aging Database. http://sting.cycollege.ac.cy/alanitis/fgnetaging/

  4. Alley, T.R.: Social and Applied Aspects of Perceiving Faces. Lawrence Erlbaum Associates, Hillsdale (1988)

    Google Scholar 

  5. Yang, J., Price, B., Cohen, S., et al.: Object contour detection with a fully convolutional encoder-decoder network. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)

    Google Scholar 

  6. Chi, N.D., Luu, K., Quach, K.G., et al.: Beyond principal components: deep Boltzmann machines for face modeling. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4786–4794 (2015)

    Google Scholar 

  7. Chen, Y., Ding, S.H., Gan-Le, H.U., et al.: Facial beautification method based on age evolution. Comput. Aided Drafting Des. Manufact. 4, 7–13 (2013)

    Google Scholar 

  8. Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)

    Article  Google Scholar 

  9. Todd, J.T., Mark, L.S., Shaw, R.E., et al.: The perception of human growth. Sci. Am. 242(2), 132–144 (1980)

    Article  Google Scholar 

  10. Lanitis, A., Taylors, C.J., Cootes, T.F.: Toward automatic simulation of aging effects on face images. IEEE Trans. Pattern Anal. Mach. Intell. 24(24), 442–455 (2002)

    Article  Google Scholar 

  11. Sun, Y., Chen, Y., Wan, X., Tang, X.: Deep learning face representation by joint identification-verification. In: Advances in Neural Information Processing Systems (NIPS), pp. 1988–1996 (2014)

    Google Scholar 

  12. Yu, L., Michael, S.L.: Learning relaxed deep supervision for better edge detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)

    Google Scholar 

  13. Chi, N.D., Khoa, L., Kha, G.Q., et al.: Longitudinal face modeling via temporal deep restricted Boltzmann machines. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)

    Google Scholar 

  14. Timo, B., Stefanie, W.: A groupwise multilinear correspondence optimization for 3D faces. In: The IEEE International Conference on Computer Vision (ICCV), pp. 3604–3612 (2015)

    Google Scholar 

  15. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

  16. Zhang, Y., et al.: Improving object detection with deep convolutional networks via Bayesian optimization and structured prediction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 249–258 (2015)

    Google Scholar 

  17. Zhang, D., Zhao, Q., Chen, F.: Quantitative analysis of human facial beauty using geometric features. Pattern Recogn. 44(4), 940–950 (2011)

    Article  Google Scholar 

  18. Leyvand, T., Cohen, D., Dror, G., et al.: Data-driven enhancement of facial attractiveness. ACM Trans. Graph. (TOG) 27(3), 15–19 (2008)

    Article  Google Scholar 

  19. Li, J., Xiong, C., Liu, L., et al.: Deep face beautification. In: ACM International Conference on Multimedia, pp. 793–794 (2015)

    Google Scholar 

  20. Guo, D., Sim, T.: Digital face makeup by example. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2009)

    Google Scholar 

  21. Liu, L., Xu, H., Xing, S., et al.: Wow! You are so beautiful today! In: Proceedings of 21st ACM International Conference on Multimedia (MM), vol. 11, no. 1s, pp. 3–12 (2014)

    Google Scholar 

  22. Lee, J.Y., Kang, H.B.A.: New digital face makeup method. In: IEEE International Conference on Consumer Electronics (2016)

    Google Scholar 

  23. Wang, W., Cui, Z., Yan, Y., et al.: Recurrent face aging. In: IEEE Conference on Computer Vision and Pattern Recognition(CVPR) (2016)

    Google Scholar 

  24. Sethuram, A., Ricanel, K., Patterson, E.: A hierarchical approach to facial aging. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 100–107 (2010)

    Google Scholar 

  25. Liang, L., Jin, L., Li, X.: Facial skin beautification using adaptive region-aware masks. IEEE Trans. Cybern. 44(12), 2600–2612 (2014)

    Article  Google Scholar 

  26. Nouveaeu-Richard, S., de Lacharrie’re, O.: Skin aging: an exploratory research above the Chinese and European. In: China Cosmetic Academic Symposium (2006)

    Google Scholar 

  27. Liu, S., Ou, X., Qian, R., et al.: Makeup like a superstar: Deep Localized Makeup Transfer Network (2016)

    Google Scholar 

  28. Meitulnc, Meitupic (2014). http://xiuxiu.meitu.com/en/

  29. Lightroom Imagenomic, “Portraiture” (2015). http://imagenomic.com/pt.aspx

  30. Face variations by age. In: Network: Marquardt Beauty Analysis. http://www.beautyanalysis.com/beauty-and-you/face-variations-age/

  31. Cao, X., Wei, Y., Wen, F., et al.: Face alignment by explicit shape regression. In: CVPR (2016)

    Google Scholar 

  32. MORPH Database. http://www.faceaginggroup.com/morph/

  33. Zhu, S., Liu, S., Loy, C.C., Tang, X., et al.: Cascaded bi-network for face hallucination. In: ECCV (2016)

    Google Scholar 

Download references

Aknowledgments

This work is supported by the National Natural Science Foundation of China (No.61472245), and the Science and Technology Commission of Shanghai Municipality Program (No.16511101300).

Author information

Authors and Affiliations

  1. School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China

    Yulia Novskaya, Sun Ruoqi, Hengliang Zhu & Lizhuang Ma

Authors
  1. Yulia Novskaya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sun Ruoqi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hengliang Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lizhuang Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yulia Novskaya .

Editor information

Editors and Affiliations

  1. Eindhoven University of Technology, Eindhoven, The Netherlands

    Wil M.P. van der Aalst

  2. National Research University Higher School of Economics, Moscow, Russia

    Dmitry I. Ignatov

  3. Krasovsky Institute of Mathematics and Mechanics, Ekaterinburg, Russia

    Michael Khachay

  4. National Research University Higher School of Economics, Moscow, Russia

    Sergei O. Kuznetsov

  5. Skolkovo Institute of Science and Technology, Moscow, Russia

    Victor Lempitsky

  6. National Research University Higher School of Economics, Moscow, Russia

    Irina A. Lomazova

  7. Moscow State University, Moscow, Russia

    Natalia Loukachevitch

  8. LORIA, Campus Scientifique, Vandœuvre lès Nancy, France

    Amedeo Napoli

  9. University of Hamburg, Hamburg, Germany

    Alexander Panchenko

  10. University of Florida, Gainesville, Florida, USA

    Panos M. Pardalos

  11. National Research University Higher School of Economics, Nizhny Novgorod, Russia

    Andrey V. Savchenko

  12. Indiana University, Bloomington, Indiana, USA

    Stanley Wasserman

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Novskaya, Y., Ruoqi, S., Zhu, H., Ma, L. (2018). Floor-Ladder Framework for Human Face Beautification. In: van der Aalst, W., et al. Analysis of Images, Social Networks and Texts. AIST 2017. Lecture Notes in Computer Science(), vol 10716. Springer, Cham. https://doi.org/10.1007/978-3-319-73013-4_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73013-4_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73012-7

  • Online ISBN: 978-3-319-73013-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation