skip to main content
10.1145/2468356.2468431acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
poster

Leveraging visual feedback from social signal processing to enhance clinicians' nonverbal skills

Published: 27 April 2013 Publication History

Abstract

Nonverbal communication between patients and clinicians affects the delivery of empathic patient-centered care and patient outcomes. To be effective communicators, clinicians must appropriately encode, decode, and regulate nonverbal cues, such as speech rate, pitch, facial expression, and body language. Yet, few efforts to develop tools for enhancing clinician communication have focused on nonverbal aspects of the clinical encounter. To address this gap, we describe a novel solution that both uses social signal processing technology (SSP) to capture nonverbal cues in real time and displays instant visual feedback. In this paper, we examine the theoretical underpinnings of nonverbal cues and their critical role in clinical encounters. We then describe opportunities for capturing nonverbal cues with SSP and explore visual designs for feeding back those social signals to enhance clinicians' nonverbal communication.

References

[1]
Buller, D.B., Street, R.L. Physician-patient relationships. In R.S. Feldman (Ed.), Applications of nonverbal theories and research. London, Psychology Press, 1992.
[2]
Burgoon, J.K., Guerrero, L.K., Floyd, K. Nonverbal Communication. Saddle River, NJ, Pearson, 2010.
[3]
Byun, B., Awasthi, A., Chou, P. A., Kapoor, A., Lee, B., Czerwinski, M. Honest signals in video conferencing. Proc. IEEE ICME, (2011), 1--6.
[4]
Cegala, D.J., Broz, S.L. Physician communication skills training: a review of theoretical, background, objectives, and skills. Med Educ, 36 (2002), 1004--16.
[5]
D'Agostino, T.A., Bylund, C.L. The nonverbal accommodation analysis system (NAAS): Initial application and evaluation. Patient Educ Couns 85, 1 (2011), 33--9.
[6]
Dickson, D.A., Hargie, O., Morrow, N.C. Communication skills training for health professionals. London, Nelson Thornes, 2003.
[7]
DiMatteo, M.R., Taranta. T., Friedman, H.S., Prince L.M. Predicting patient satisfaction from physicians' nonverbal communication skills. Med Care 19, 4 (1980), 173--87.
[8]
Hall J.A., Harrigan, J.A., Rosenthal, R. Nonverbal behavior in clinician-patient interaction. Appl Prev Psych 4 (1995), 21--37.
[9]
Hojat, M. Empathy in clinical care: antecedents, development, measurement, and outcomes. New York, Springer, 2007.
[10]
Kiesler, D.J., Auerbach, S.M. Integrating measurement of control and affiliation in studies of physician-patient interaction: The interpersonal circumplex. Soc Sci Med 57, 9 (2003), 1707--22.
[11]
Kim T., Chang A., Holland L., Pentland, A.S. Meeting Mediator: enhancing group collaboration using sociometric feedback. Proc. ACM Conference on Computer-supported Cooperative Work, (2008), 457--66
[12]
Martin, L., Friedman, H.S. Nonverbal communication in health care (pp. 3--16). In Riggio, R.E. & Feldman, R.S. (Eds.) Applications of nonverbal communication. London, Lawrence Erlbaum, 2005.
[13]
Mast, M.S., Hall J.A., Roter, D.L. Caring and dominance affect participants' perceptions and behaviors during a virtual medical visit. J Gen Intern Med 23, 5 (2008), 523--7.
[14]
Pentland, A. Honest signals: How they shape our world. Cambridge: MIT Press, 2008.
[15]
Roter, D., Larson, S. The Roter Interaction Analysis System: utility and flexibility for analysis of medical interactions. Patient Educ Couns 46, 4 (2002), 243251.
[16]
Street, R.L., Makoul, G., Arora, N.K., Epstein R.M. How does communication heal? Pathways linking clinician-patient communication to health outcomes. Patient Educ Couns 74, 3 (2009), 295--301.
[17]
Sturm, J., Herwijnen, O.H., Eyck A., Terken, J. Influencing social dynamics in meetings through a peripheral display. Proc. IEEE ICME, (2007), 263--70.
[18]
Vinciarelli. A., Pantic, M. Social signal processing: Survey of an emerging domain. Image and Vision Computing 27, 12 (2009), 1743--59.
[19]
Zolnierek, K.B., DiMatteo, M.R. Physician communication and patient adherence to treatment: A meta-analysis. Med Care 47, 8 (2009), 826--34.

Cited By

View all
  • (2024)ConverSearch: Supporting Experts in Human Behavior Analysis of Conversational Videos with a Multimodal Scene Search ToolACM Transactions on Interactive Intelligent Systems10.1145/370901215:1(1-31)Online publication date: 23-Dec-2024
  • (2022)Empathic and Empathetic Systematic Review to Standardize the Development of Reliable and Sustainable Empathic SystemsSensors10.3390/s2208304622:8(3046)Online publication date: 15-Apr-2022
  • (2018)Real-time Feedback on Nonverbal Clinical CommunicationMethods of Information in Medicine10.3414/ME13-02-003353:05(389-405)Online publication date: 20-Jan-2018
  • Show More Cited By

Index Terms

  1. Leveraging visual feedback from social signal processing to enhance clinicians' nonverbal skills

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems
      April 2013
      3360 pages
      ISBN:9781450319522
      DOI:10.1145/2468356
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 27 April 2013

      Check for updates

      Author Tags

      1. nonverbal communication
      2. patient-clinician communication
      3. social signal processing

      Qualifiers

      • Poster

      Conference

      CHI '13
      Sponsor:

      Acceptance Rates

      CHI EA '13 Paper Acceptance Rate 630 of 1,963 submissions, 32%;
      Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)21
      • Downloads (Last 6 weeks)5
      Reflects downloads up to 20 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)ConverSearch: Supporting Experts in Human Behavior Analysis of Conversational Videos with a Multimodal Scene Search ToolACM Transactions on Interactive Intelligent Systems10.1145/370901215:1(1-31)Online publication date: 23-Dec-2024
      • (2022)Empathic and Empathetic Systematic Review to Standardize the Development of Reliable and Sustainable Empathic SystemsSensors10.3390/s2208304622:8(3046)Online publication date: 15-Apr-2022
      • (2018)Real-time Feedback on Nonverbal Clinical CommunicationMethods of Information in Medicine10.3414/ME13-02-003353:05(389-405)Online publication date: 20-Jan-2018
      • (2015)Social Sensing for PsychologyCurrent Directions in Psychological Science10.1177/096372141456081124:2(154-160)Online publication date: 6-Apr-2015
      • (2013)A Pilot Study about Military Users and Information SystemsProceedings of the 2013 International Conference on Social Computing10.1109/SocialCom.2013.136(892-895)Online publication date: 8-Sep-2013

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media