Karan Sikka
ABSTRACT
Pain assessment is vital for effective pain management in clinical settings. It is generally obtained via patient's self-report or observer's assessment. Both of these approaches suffer from several drawbacks such as unavailability of self-report, idiosyncratic use and observer bias. This work aims at developing automated machine learning based approaches for estimating pain in clinical settings. We propose to use facial expression information to accomplish current goals since previous studies have demonstrated consistency between facial behavior and experienced pain. Moreover, with recent advances in computer vision it is possible to design algorithms for identifying spontaneous expressions such as pain in more naturalistic conditions.
Our focus is towards designing robust computer vision models for estimating pain in videos containing patient's facial behavior. In this regard we discuss different research problem, technical approaches and challenges that needs to be addressed. In this work we particularly highlight the problem of predicting self-report measures of pain intensity since this problem is not only more challenging but also received less attention. We also discuss our efforts towards collecting an in-situ pediatric pain dataset for validating these approaches. We conclude the paper by presenting some results on both UNBC Mc-Master Pain dataset and pediatric pain dataset.
- Aggarwal, J., and Ryoo, M. S. Human activity analysis: A review. ACM Computing Surveys (CSUR) 43, 3 (2011), 16. Google Scholar
Digital Library
- Ashraf, A. B., Lucey, S., Cohn, J. F., Chen, T., Ambadar, Z., Prkachin, K. M., and Solomon, P. E. The painful face-pain expression recognition using active appearance models. Image and vision computing 27, 12 (2009), 1788--1796. Google ScholarDigital Library
- Bartlett, M. S., Littlewort, G. C., Frank, M. G., Lainscsek, C., Fasel, I., and Movellan, J. Recognizing facial expression: machine learning and application to spontaneous behavior. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, vol. 2, IEEE (2005), 568--573. Google ScholarDigital Library
- Bartlett, M. S., Littlewort, G. C., Frank, M. G., and Lee, K. Automatic decoding of facial movements reveals deceptive pain expressions. Current Biology 24, 7 (2014), 738--743.Google ScholarCross Ref
- Cohen, I., Sebe, N., Garg, A., Chen, L. S., and Huang, T. S. Facial expression recognition from video sequences: temporal and static modeling. Computer Vision and Image Understanding 91, 1 (2003), 160--187. Google ScholarDigital Library
- Craig, K. D. The facial expression of pain better than a thousand words? APS Journal 1, 3 (1992), 153--162.Google ScholarCross Ref
- Howard, R. F. Current status of pain management in children. Jama 290, 18 (2003), 2464--2469.Google ScholarCross Ref
- Huguet, A., Stinson, J. N., and McGrath, P. J. Measurement of self-reported pain intensity in children and adolescents. Journal of psychosomatic research 68, 4 (2010), 329--336.Google Scholar
- Kaltwang, S., Rudovic, O., and Pantic, M. Continuous pain intensity estimation from facial expressions. In Advances in Visual Computing. Springer, 2012, 368--377.Google Scholar
- Kaseweter, K. A., Drwecki, B. B., and Prkachin, K. M. Racial differences in pain treatment and empathy in a canadian sample. Pain Research & Management: The Journal of the Canadian Pain Society 17, 6 (2012), 381.Google Scholar
- Littlewort, G. C., Bartlett, M. S., Fasel, I., Susskind, J., and Movellan, J. Dynamics of facial expression extracted automatically from video. Image and Vision Computing 24, 6 (2006), 615--625. Google ScholarDigital Library
- Littlewort, G. C., Whitehill, J., Wu, T., Fasel, I., Frank, M., Movellan, J., and Bartlett, M. The computer expression recognition toolbox (cert). In Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, IEEE (2011), 298--305.Google ScholarCross Ref
- Littlewort, G. C., Whitehill, J., Wu, T.-F., Butko, N., Ruvolo, P., Movellan, J., and Bartlett, M. The motion in emotiona cert based approach to the fera emotion challenge. In Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, IEEE (2011), 897--902.Google Scholar
- Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., and Matthews, I. The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on, IEEE (2010), 94--101.Google ScholarCross Ref
- Lucey, P., Cohn, J. F., Prkachin, K. M., Solomon, P. E., and Matthews, I. Painful data: The unbc-mcmaster shoulder pain expression archive database. In Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, IEEE (2011), 57--64.Google ScholarCross Ref
- Lucey, P., Howlett, J., Cohn, J. F., Lucey, S., Sridharan, S., and Ambadar, Z. Improving pain recognition through better utilisation of temporal information. In AVSP (2008), 167--172.Google Scholar
- Prkachin, K. M., Berzins, S., and Mercer, S. R. Encoding and decoding of pain expressions: a judgement study. Pain 58, 2 (1994), 253--259.Google ScholarCross Ref
- Rudovic, O., Pavlovic, V., and Pantic, M. Automatic pain intensity estimation with heteroscedastic conditional ordinal random fields. In Advances in Visual Computing. Springer, 2013, 234--243.Google Scholar
- Savran, A., Sankur, B., and Taha Bilge, M. Regression-based intensity estimation of facial action units. Image and Vision Computing 30, 10 (2012), 774--784. Google ScholarDigital Library
- Sikka, K., Dhall, A., and Bartlett, M. Weakly supervised pain localization using multiple instance learning. In Automatic Face and Gesture Recognition (FG), 2013 10th IEEE International Conference and Workshops on, IEEE (2013), 1--8.Google ScholarCross Ref
- Solomon, P. Congruence between health professionals and patients pain ratings: a review of the literature. Scandinavian Journal of Caring Sciences 15, 2 (2001), 174--180.Google ScholarCross Ref
- Stinson, J. N., Kavanagh, T., Yamada, J., Gill, N., and Stevens, B. Systematic review of the psychometric properties, interpretability and feasibility of self-report pain intensity measures for use in clinical trials in children and adolescents. Pain 125, 1 (2006), 143--157.Google ScholarCross Ref
- Tomlinson, D., von Baeyer, C. L., Stinson, J. N., and Sung, L. A systematic review of faces scales for the self-report of pain intensity in children. Pediatrics (2010), peds'2010.Google Scholar
- Turk, D. C., and Melzack, R. Handbook of pain assessment. Guilford Press, 2011.Google Scholar
- von Baeyer, C. L., and Spagrud, L. J. Systematic review of observational (behavioral) measures of pain for children and adolescents aged 3 to 18 years. Pain 127, 1 (2007), 140--150.Google ScholarCross Ref
- Wu, T., Bartlett, M. S., and Movellan, J. R. Facial expression recognition using gabor motion energy filters. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on, IEEE (2010), 42--47.Google ScholarCross Ref
- Zhao, G., and Pietikainen, M. Dynamic texture recognition using local binary patterns with an application to facial expressions. Pattern Analysis and Machine Intelligence, IEEE Transactions on 29, 6 (2007), 915--928. Google ScholarDigital Library
- Zhou, H., Roberts, P., and Horgan, L. Association between self-report pain ratings of child and parent, child and nurse and parent and nurse dyads: meta-analysis. Journal of Ddvanced Nursing 63, 4 (2008), 334--342.Google Scholar
Index Terms
- Facial Expression Analysis for Estimating Pain in Clinical Settings
Recommendations
Faces of pain: automated measurement of spontaneousallfacial expressions of genuine and posed pain
ICMI '07: Proceedings of the 9th international conference on Multimodal interfacesWe present initial results from the application of an automated facial expression recognition system to spontaneous facial expressions of pain. In this study, 26 participants were videotaped under three experimental conditions: baseline, posed pain, and ...
Recognizing Action Units for Facial Expression Analysis
Most automatic expression analysis systems attempt to recognize a small set of prototypic expressions, such as happiness, anger, surprise, and fear. Such prototypic expressions, however, occur rather infrequently. Human emotions and intentions are more ...
FENP: A Database of Neonatal Facial Expression for Pain Analysis
In this article, we introduce a new neonatal facial expression database for pain analysis. This database, called facial expression of neonatal pain (FENP), contains 11,000 neonatal facial expression images associated with 106 Chinese neonates from two ...
Comments