skip to main content
10.1145/3281151.3281159acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

Effects of face and voice deformation on participant emotion in video-mediated communication

Published:16 October 2018Publication History

ABSTRACT

This research investigates the effectiveness of speech audio and facial image deformation tools that make conversation participants appear more positive. By conducting an experiment, we revealed that participants' feelings became more positive when using the deformation tools, and this caused conversations to be more active. It was also found that voice deformation was equally effective compared to a combination of voice and facial image deformations. Moreover, participants were more likely to activate the tool as a listener and with a less positive feeling. Finally, we discuss how these findings can be applied to design a remote communication support system that helps to shift a conversation to a positive mood.

References

  1. Ana Paiva, Iolanda Leite, Hana Boukricha, and Ipke Wachsmuth. 2017. Empathy in Virtual Agents and Robots: A Survey. ACM Trans. Interact. Intell. Syst. 7, 3, Article 11 (September 2017), 40 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Hess, U., and Fischer, A. (Eds.). 2016. Emotional Mimicry in Social Context (Studies in Emotion and Social Interaction). Cambridge University Press.Google ScholarGoogle Scholar
  3. Keita Suzuki, Masanori Yokoyama, Shigeo Yoshida, Takayoshi Mochizuki, Tomohiro Yamada, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2017. FaceShare: Mirroring with Pseudo-Smile Enriches Video Chat Communications. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). 5313--5317. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Laurel D. Riek, Philip C. Paul, and Peter Robinson. 2010. When my robot smiles at me: Enabling Human-Robot Rapport via Real-Time Head Gesture Mimicry. Journal on Multimodal User Interfaces. 3, 1, (March 2010), 99--108.Google ScholarGoogle ScholarCross RefCross Ref
  5. Timothy W. Bickmore and Rosalind W. Picard. 2005. Establishing and Maintaining Long-Term Human-Computer Relationships. ACM Transactions on Computer-Human Interaction (TOCHI) 12, 2 (2005), 293--327. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Christine Lisetti, Reza Amini, Ugan Yasavur, and Naphtali Rishe. 2013. I Can Help You Change! An Empathic Virtual Agent Delivers Behavior Change Health Interventions. ACM Transactions on Management of Information Systems 4, 4, Article 19 (December. 2013), 28 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Jean Costa, Malte F. Jung, Mary Czerwinski, François Guimbretiére, Trinh Le, and Tanzeem Choudhury. 2018. Regulating Feelings During Interpersonal Conflicts by Changing Voice Self-perception. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18), Paper 631, 13 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Malte F. Jung, Nikolas Martelaro, and Pamela J. Hinds. 2015. Using Robots to Moderate Team Conflict: The Case of Repairing Violations. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI '15), 229--236. Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    ICMI '18: Proceedings of the 20th International Conference on Multimodal Interaction: Adjunct
    October 2018
    62 pages
    ISBN:9781450360029
    DOI:10.1145/3281151

    Copyright © 2018 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 16 October 2018

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article

    Acceptance Rates

    Overall Acceptance Rate453of1,080submissions,42%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader