Skip to main content

The Development of an Augmented Virtuality for Interactive Face Makeup System

  • Conference paper
  • First Online:
Advances in Computer Entertainment Technology (ACE 2017)

Abstract

In this paper, we focus on developing an interactive face makeup system that allows the user to practice applying makeup on their face without using real makeup materials. In our system, feature points on the human face were tracked by Kinect and mapped to a 3D face model. Face textures were generated and mapped on the model by using UV mapping technique. The makeup tools were developed for providing tangible interactions to users. Users can perceive a realistic makeup feeling by using our makeup tools. When the user applies the makeup, the program will paint the color on a face model, which synchronized with the users’ movement in real-time. The system is evaluated by a subjective evaluation method. The result shows that our system can provide a new and attractive makeup experience to the users compared to other makeup applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Statista Inc.: Annual beauty-related content views on YouTube from 2009 to 2017 (in billions) (2017). https://www.statista.com/statistics/294655/youtube-monthly-beauty-content-views/

  2. Hidden in Makeup: Woman’s Statistics (2017). http://hiddeninmakeup.weebly.com/statistics.html

  3. Bermano, A.H., Billeter, M., Iwai, D., Grundhöfer, A.: Makeup lamps: live augmentation of human faces via projection. Comput. Graph. Forum 36(2), 311–323 (2017)

    Article  Google Scholar 

  4. Nakagawa, M., Tsukada, K., Siio, I.: Smart makeup system: supporting makeup using lifelog sharing. In: Proceedings of the 13th International Conference on Ubiquitous Computing, UbiComp 2011, New York, NY, USA, pp. 483–484. ACM (2011)

    Google Scholar 

  5. Hieda, N., Cooperstock, J.R.: sharedFace: interactive facial projection mapping. In: Proceedings of the 2015 Virtual Reality International Conference, VRIC 2015, New York, NY, USA, pp. 18:1–18:4. ACM (2015)

    Google Scholar 

  6. Impala, Inc. Beauty: IMAN Cosmetics, Virtual beauty application for cosmetic products recommendation (2015–2017). http://www.imancosmetics.com/beauty-app

  7. Iwabuchi, E., Nakagawa, M., Siio, I.: Smart makeup mirror: computer-augmented mirror to aid makeup application. In: Jacko, J.A. (ed.) HCI 2009. LNCS, vol. 5613, pp. 495–503. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02583-9_54

    Chapter  Google Scholar 

  8. Modiface Inc.: Modiface In-store AR mirrors (2017). http://modiface.com/

  9. Rahman, A.S.M.M., Tran, T.T., Hossain, S.A., Saddik, A.E.: Augmented rendering of makeup features in a smart interactive mirror system for decision support in cosmetic products selection. In: 2010 IEEE/ACM 14th International Symposium on Distributed Simulation and Real Time Applications, pp. 203–206, October 2010

    Google Scholar 

  10. de Almeida, D.R.O., Guedes, P.A., da Silva, M.M.O., Vieira e Silva, A.L.B., do Monte Lima, J.P.S., Teichrieb, V.: Interactive makeup tutorial using face tracking and augmented reality on mobile devices. In: Proceedings of the 2015 XVII Symposium on Virtual and Augmented Reality, SVR 2015, Washington, DC, USA, pp. 220–226. IEEE Computer Society (2015)

    Google Scholar 

  11. Nishimura, A., Siio, I.: iMake: computer-aided eye makeup. In: Proceedings of the 5th Augmented Human International Conference, AH 2014, New York, NY, USA, pp. 56:1–56:2. ACM (2014)

    Google Scholar 

  12. Microsoft: High definition face tracking (2017). https://msdn.microsoft.com/en-us/library/dn785525.aspx

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bantita Treepong .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Treepong, B., Wibulpolprasert, P., Mitake, H., Hasegawa, S. (2018). The Development of an Augmented Virtuality for Interactive Face Makeup System. In: Cheok, A., Inami, M., Romão, T. (eds) Advances in Computer Entertainment Technology. ACE 2017. Lecture Notes in Computer Science(), vol 10714. Springer, Cham. https://doi.org/10.1007/978-3-319-76270-8_43

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-76270-8_43

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-76269-2

  • Online ISBN: 978-3-319-76270-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics