Skip to main content

Advertisement

SpringerLink
Log in

Oxygenation absorption and light scattering driven facial animation of natural virtual human

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The color of skin is one of the key indicators of bodily change that affect facial expressions. The skin colour tenacity is majorly determined by the light effect and concentration from the chromophores inside skin and haemoglobin oxygenation in the blood. We did an extension work of previous researcher: Donner and Jensen approach to develop a realistic textured 3D facial animation model. Both surface and subsurface effect of light with the skin is considered. Six model parameters are used to control the amount of oxygenation, de-oxygenation, hemoglobin, melanin, oil and blend factor for different types of melanin in the skin in creating a perfect match. Pulse Oximetry and 3D skin analyzer are used to determine the correlation between blood oxygenation and basic natural emotional expressions. The multi-pole method for layered materials is applied to calculate the spectral diffusion profiles of two-layered skin in simulating the subsurface scattering. Torrance-Sparrow bidirectional reflectance distribution function (BRDF) is employed to simulate the light interaction with an oily skin surface stratum. Unity3D is exploited for shading programming to implement advanced real-time rendering. Five basic natural human facial emotive appearance such as angry, happy, neutral, sad and fear are simulated for Asian, European and Middle East male and female. It is suggested that our tailored approach may be helpful for the development of virtual reality and serious games application.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30
Fig. 31
Fig. 32
Fig. 33

Similar content being viewed by others

References

  1. Alaluf S et al (2001) Variation in melanin content and composition in type V and VI photoexposed and photoprotected human skin: the dominant role of DHI. Pigment Cell Res 14(5):337–347

    Article  Google Scholar 

  2. Alaluf S et al (2002) Ethnic variation in melanin content and composition in photoexposed and photoprotected human skin. Pigment Cell Res 15(2):112–118

    Article  Google Scholar 

  3. Alkawaz MH et al (2014) Realistic facial expression of virtual human based on color, sweat, and tears effects. Sci World J 2014:9

    Article  Google Scholar 

  4. Anderson R, Parrish JA (1981) The optics of human skin. J Investigat Dermatol 77(1)

  5. Apostolakis, KC, Daras P (2015) Natural user interfaces for virtual character full body and facial animation in immersive virtual worlds. Augment Virtual Reality, Springer 371–383

  6. Bashkatov A et al (2005) Optical properties of human skin, subcutaneous and mucous tissues in the wavelength range from 400 to 2000 nm. J Phys D Appl Phys 38(15):2543

    Article  Google Scholar 

  7. Bhat VS, Pujari JD (2013) Face detection system using HSV color model and morphing operations

  8. Chen TF et al (2015) Hyperspectral modeling of skin appearance. ACM Trans GrapH (TOG) 34(3):31

    Article  Google Scholar 

  9. Debevec PE, Ghosh A (2012) Practical modeling and acquisition of layered facial reflectance. Google Patents

  10. Debevec P et al. (2000) Acquiring the reflectance field of a human face. Proce 27th annual conference on Computer graphics and interactive techniques. 2000: ACM Press/Addison-Wesley Publishing Co.

  11. Debevec P et al. (2000) Acquiring the reflectance field of a human face. Proceedings of the 27th annual conference on computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co. 145–156

  12. Decaudin P et al. (2006) Virtual garments: a fully geometric approach for clothing design. Comput Graph Forum. Wiley Online Library

  13. Donald E et al (1999) Egan’s fundamentals of respiratory care. Mosby, St. Louis

    Google Scholar 

  14. Donner C, Jensen HW (2005) Light diffusion in multi-layered translucent materials. ACM Trans Graph (TOG). ACM

  15. Donner C, Jensen HW (2006) A spectral BSSRDF for shading human skin. Proc 17th Eurograph Conf Render Tech 409–417

  16. Donner C et al. (2008) A layered, heterogeneous reflectance model for acquiring and rendering human skin. ACM Trans Graph (TOG). ACM

  17. Faraway JJ (2004) Modeling continuous shape change for facial animation. Stat Comput 14(4):357–363

    Article  MathSciNet  Google Scholar 

  18. Fiske ST (2013) Social cognition: from brains to culture. Sage

  19. Ghosh A et al (2008) Practical modeling and acquisition of layered facial reflectance. ACM Trans Graph (TOG) 27(5):139

    Article  Google Scholar 

  20. Hanrahan P, Krueger W (1993) Reflection from layered surfaces due to subsurface scattering. Proc 20th Ann Conf Comput Graph Interact Tech. ACM

  21. Hansen MF et al (2010) 3D face reconstructions from photometric stereo using near infrared and visible light. Comput Vis Image Underst 114(8):942–951

    Article  Google Scholar 

  22. Hery C (2003) Implementing a skin BSSRDF (or several…). Siggraph 2005 Digital Face Cloning Course Notes 14

  23. Hudson DM (2006) Top shelf. Walch Publishing, Portland

    Google Scholar 

  24. Igarashi T, Nishino K, Nayar SK (2005) The appearance of human skin

  25. Igarashi T, Nishino K, Nayar SK (2007) The appearance of human skin: a survey. Found Trends Comput Graph Vis 3(1):1–95

    Article  Google Scholar 

  26. Iglesias‐Guitian JA et al. (2015) A biophysically‐based model of the optical properties of skin aging. Computer Graphics Forum. Wiley Online Library

  27. Ito S, Wakamatsu K (2003) Quantitative analysis of eumelanin and pheomelanin in humans, mice, and other animals: a comparative review. Pigment Cell Res 16(5):523–531

    Article  Google Scholar 

  28. Jacques S (1996) Origins of tissue optical properties in the UVA, visible, and NIR regions. OSA TOPS Adv Optic Imag Photon Migrat 2:364–369

    Google Scholar 

  29. Jacques S (1998) Skin optics. Oregon Med Laser Center News 1998(1):1–9

    MathSciNet  Google Scholar 

  30. Jacques and McAuliffe (1991) The melanosome: threshold temperature for explosive vaporization and internal absorption coefficient during pulsed laser irradiation. Photochem Photobiol 53(6):769–775

    Article  Google Scholar 

  31. Jensen HW, Buhler J. (2002) A rapid hierarchical rendering technique for translucent materials. ACM Trans Graph (TOG). ACM

  32. Jensen HW et al. (2001) A practical model for subsurface light transport. Proc 28th Ann Conf Comput Graph Interact Tech. ACM

  33. Jimenez J et al (2010) A practical appearance model for dynamic facial color. ACM Trans Graph 29(6):1–10

    Article  Google Scholar 

  34. Johns DPPR (2003) McGraw-Hill’s pocket guide to spirometry. McGraw-Hill, Roseville

    Google Scholar 

  35. Jue T, Masuda K (2013) Application of near infrared spectroscopy in biomedicine. Springer

  36. Kelleher JF (1989) Pulse oximetry. J Clin Monit 5(1):37–62

    Article  Google Scholar 

  37. Klehm O et al. (2015) Recent advances in facial appearance capture. Computer graphics forum: Wiley Online Library

  38. Krishnaswamy A, Baranoski GV (2004) A biophysically‐based spectral model of light interaction with human skin. Comput Graph Forum. Wiley Online Library

  39. Lauterbach C, Mo Q, Manocha D (2010) gProximity: hierarchical GPU‐based operations for collision and distance queries. Comput GrapH Forum. Wiley Online Library

  40. Li CC et al. (2014) Mater Chem A

  41. Litscher G et al. (2013) Acupressure at the meridian acupoint Xiyangguan (GB33) influences near-infrared spectroscopic parameters (Regional Oxygen Saturation) in deeper tissue of the knee in healthy volunteers. Evidence-Based Complement Alternat Med 2013

  42. Ma TY et al (2014) Graphitic carbon nitride nanosheet–carbon nanotube three‐dimensional porous composites as high‐performance oxygen evolution electrocatalysts. Angew Chem Int Ed 53(28):7281–7285

    Article  Google Scholar 

  43. Magnenat-Thalmann N et al. (2015) Context aware human-robot and human-agent interaction. 2015: Springer

  44. Marschner SR et al. (1999) Image-based BRDF measurement including human skin, in Rendering Techniques’ 99. Springer 131–144

  45. Martin L (1999) All you really need to know to interpret arterial blood gases. Lippincott Williams & Wilkins, Philadelphia

    Google Scholar 

  46. Meglinski IV, Matcher SJ (2002) Quantitative assessment of skin layers absorption and skin reflectance spectra simulation in the visible and near-infrared spectral regions. Physiol Meas 23(4):741

    Article  Google Scholar 

  47. Payne JP, Severinghaus JW (1986) Pulse oximetry. Springer

  48. Rabalais NN et al (2010) Dynamics and distribution of natural and human-caused hypoxia. Biogeosciences 7(2):585–619

    Article  Google Scholar 

  49. Ramirez G et al. (2014) Color analysis of facial skin: detection of emotional state. in Proc IEEE Conf Comput Vision Pattern Recognition Workshops

  50. Rowat AM, Dennis MS, Wardlaw JM (2006) Hypoxaemia in acute stroke is frequent and worsens outcome. Cerebrovasc Dis 21(3):166–172

    Article  Google Scholar 

  51. Saidi IS, Jacques SL, Tittel FK (1995) Mie and Rayleigh modeling of visible-light scattering in neonatal skin. Appl Opt 34(31):7410–7418

    Article  Google Scholar 

  52. Saneiro M et al. (2014) Towards emotion detection in educational scenarios from facial expressions and body movements through multimodal approaches. Sci World J 2014

  53. Sarna T, Swartz HA (1998) The physical properties of melanins. The Pigmentary System: Physiology and Pathophysiology, Second Edition 311–341

  54. Spott T et al. (1998) Application of optical diffusion theory to transcutaneous bilirubinometry. BiOS Europe’97. Int Soc Optics Photon

  55. Stam J (2001) An illumination model for a skin layer bounded by rough surfaces, in Rendering Techniques 2001. 2001, Springer 39–52

  56. Stamatas GN et al (2004) Non‐invasive measurements of skin pigmentation in situ. Pigment Cell Res 17(6):618–626

    Article  Google Scholar 

  57. Stephen ID et al (2009) Skin blood perfusion and oxygenation colour affect perceived human health. PLoS One 4(4):1

    Article  Google Scholar 

  58. Szeliski R (2010) Computer vision: algorithms and applications. Springer

  59. Tayal Y, Lamba R, Padhee S (2012) Automatic face detection using color based segmentation. Int J Sci Res Publ 2(6)

  60. Tsumura N, Haneishi H, Miyake Y (1999) Independent-component analysis of skin color image. JOSA A 16(9):2169–2176

    Article  Google Scholar 

  61. Tuchin VV, Tuchin V (2007) Tissue optics: light scattering methods and instruments for medical diagnosis. vol. 642. SPIE press, Bellingham

    Book  Google Scholar 

  62. Wakamatsu K et al (2006) Diversity of pigmentation in cultured human melanocytes is due to differences in the type as well as quantity of melanin. Pigment Cell Res 19(2):154–162

    Article  Google Scholar 

  63. Weyrich T et al. (2006) Analysis of human faces using a measurement-based skin reflectance model. ACM Trans Graph (TOG). ACM

  64. Wikipedia, Oxygen saturation in medicine. 2013(http://en.wikipedia.org/wiki/Oxygen_saturation_in_medicine)

  65. Zhang J et al (2010) Natural and human-induced hypoxia and consequences for coastal areas: synthesis and future development. Biogeosciences 7(5):1443–1467

    Article  Google Scholar 

  66. Zhou Z et al. (2016) Virtual facial reconstruction based on accurate registration and fusion of 3D facial and MSCT scans. J Orofacial Orthopedics/Fortschritte der Kieferorthopädie 1–8

Download references

Acknowledgments

Authors are grateful to Management and Science University, Selangor, Malaysia, UTM-Big Data Center, Universiti Teknologi Malaysia, Department of Information Technology, Faculty of Computing and Information Technology Rabigh, King Abdulaziz University, Jeddah, Kingdom of Saudi Arabia.

Author information

Authors and Affiliations

  1. Faculty of Information Sciences and Engineering, Management and Science University, B9, Seksyen 13, 40100, Shah Alam, Selangor, Malaysia

    Mohammed Hazim Alkawaz

  2. Department of Information Technology, Faculty of Computing and Information Technology Rabigh, King Abdulaziz University, Jeddah, Saudi Arabia

    Ahmad Hoirul Basori

  3. UTM-Big Data Center, Universiti Teknologi Malaysia, 81310, Johor Bahru, Johor, Malaysia

    Mohammed Hazim Alkawaz & Siti Zaiton Mohd Hashim

Authors
  1. Mohammed Hazim Alkawaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ahmad Hoirul Basori
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Siti Zaiton Mohd Hashim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammed Hazim Alkawaz.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alkawaz, M.H., Basori, A.H. & Mohd Hashim, S.Z. Oxygenation absorption and light scattering driven facial animation of natural virtual human. Multimed Tools Appl 76, 9587–9623 (2017). https://doi.org/10.1007/s11042-016-3564-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3564-2

Keywords

Search

Navigation