Skip to main content

Quantifying Hypomimia in Parkinson Patients Using a Depth Camera

  • Conference paper
  • First Online:
Pervasive Computing Paradigms for Mental Health (MindCare 2015)

Abstract

One of Parkinson’s disease early symptoms is called hypomimia (masked facies), and timely detection of this symptom could potentially assist early diagnosis. In this study we developed methods to automatically detect and assess the severity of hypomimia, using machine learning tools and a 3D sensor that allows for fairly accurate facial movements tracking. To evaluate our prediction of hypomimia score for participants not included in the training set, we computed the score’s correlation with hypomimia scores provided by 2 neurologists. The correlations in 4 conditions were 0.84, 0.69, 0.71, 0.70. This should be compared with the correlation between the somewhat subjectives scores of the two neurologists, which is 0.78. When training classifiers to discriminate between people who suffer from hypomimia and people who do not, the area under the curve of the corresponding Receiver Operating Characteristic curves in the same 4 conditions is \(0.90-0.99\). These encouraging results provide proof of concept that automatic evaluation of hypomimia can be sufficiently reliable to be useful for clinical early detection of Parkinson-related hypomimia.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Willis, W.A., Evanoff, B.A., Lian, M., Criswell, S.R., Racette, B.A.: Geographic and ethnic variation in parkinson disease: a population-based study of us medicare beneficiaries. Neuroepidemiology 34, 143–151 (2010)

    Article  Google Scholar 

  2. von Campenhausen, S., Bornschein, B., Wick, R., Bötzel, K., Sampaio, C., Poewe, W., Oertel, W., Siebert, U., Berger, K., Dodel, R.: Prevalence and incidence of parkinson’s disease in europe. Eu. Neuropsychopharmacol. 15, 473–490 (2005)

    Article  Google Scholar 

  3. Tsanas, A., Little, M.A., McSharry, P.E., Spielman, J., Ramig, L.O.: Novel speech signal processing algorithms for high-accuracy classification of parkinson’s disease. IEEE Trans. Biomed. Eng. 59, 1264–1271 (2012)

    Article  Google Scholar 

  4. Guo, P.-F., Bhattacharya, P., Kharma, N.: Advances in detecting parkinson’s disease. In: Zhang, D. (ed.) ICMB 2010. LNCS, vol. 6165, pp. 306–314. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  5. Rinn, W.E.: The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expressions. Psychol. Bull. 95, 52 (1984)

    Article  Google Scholar 

  6. Simons, G., Pasqualini, M.C.S., Reddy, V., Wood, J.: Emotional and nonemotional facial expressions in people with parkinson’s disease. J. Int. Neuropsychol. Soc. 10, 521–535 (2004)

    Article  Google Scholar 

  7. Katsikitis, M., Pilowsky, I.: A study of facial expression in parkinson’s disease using a novel microcomputer-based method. J. Neurol. Neurosurg. Psychiatr. 51, 362–366 (1988)

    Article  Google Scholar 

  8. Mergl, R., Mavrogiorgou, P., Hegerl, U., Juckel, G.: Kinematical analysis of emotionally induced facial expressions: a novel tool to investigate hypomimia in patients suffering from depression. J. Neurol. Neurosurg. Psychiatr. 76, 138–140 (2005)

    Article  Google Scholar 

  9. He, G.F., Kang, S.K., Song, W.C., Jung, S.T.: Real-time gesture recognition using 3d depth camera. In: 2011 IEEE 2nd International Conference on Software Engineering and Service Science (ICSESS), pp. 187–190. IEEE (2011)

    Google Scholar 

  10. Zhang, Z.: Microsoft kinect sensor and its effect. IEEE MultiMedia 19, 4–10 (2012)

    Article  Google Scholar 

  11. Ltkebohle, I.: BWorld Robot Control Software (2015) (online). http://www.faceshift.com. Accessed 11 June 2015

  12. Bouaziz, S., Wang, Y., Pauly, M.: Online modeling for realtime facial animation. ACM Trans. Graph. (TOG) 32, 40 (2013)

    Article  MATH  Google Scholar 

  13. Shalev-Shwartz, S., Ben-David, S.: Understanding Machine Learning: From Theory to Algorithms. Cambridge University Press, New York (2014)

    Book  MATH  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the Intel Collaborative Research Institute for Computational Intelligence (ICRI-CI), and the Gatsby Charitable Foundations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nomi Vinokurov .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Vinokurov, N., Arkadir, D., Linetsky, E., Bergman, H., Weinshall, D. (2016). Quantifying Hypomimia in Parkinson Patients Using a Depth Camera. In: Serino, S., Matic, A., Giakoumis, D., Lopez, G., Cipresso, P. (eds) Pervasive Computing Paradigms for Mental Health. MindCare 2015. Communications in Computer and Information Science, vol 604. Springer, Cham. https://doi.org/10.1007/978-3-319-32270-4_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-32270-4_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-32269-8

  • Online ISBN: 978-3-319-32270-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics