Jieun Kim
Woochan Kim
ABSTRACT
Active use of voice assistant highlights the importance of interpersonal relationships with the conversational voice agent. When the agent evaluates a user's task performance, empathic feedback is needed to prevent the user's negative feelings. Voice reflects emotions through its nonverbal voice features that can either strengthen or lessen the feeling of empathy. Our study investigated the effect of nonverbal vocal cues in speech interaction on the user's perception toward the agent. 39 university students participated in the experiment, and MANOVA was tested to analyze their responses regarding intimacy, similarity, connectedness, enjoyment, and ease of use. The study result showed that using nonverbal vocal cues on empathic feedback contributes to establishing an interpersonal relationship with the agent, which gives implications to the fields of human-centered agent design.
- Ritu Agarwal and Elena Karahanna. 2000. Time flies when you're having fun: Cognitive absorption and beliefs about information technology usage. MIS quarterly (2000), 665--694.Google Scholar
Digital Library
- Marti J Anderson. 2001. A new method for non-parametric multivariate analysis of variance. Austral ecology 26, 1 (2001), 32--46.Google Scholar
- Russell Beale and Chris Creed. 2009. Affective interaction: How emotional agents affect users. International journal of human-computer studies 67, 9 (2009), 755--776.Google ScholarDigital Library
- Timothy Bickmore and Daniel Schulman. 2007. Practical approaches to comforting users with relational agents. In CHI'07 extended abstracts on Human factors in computing systems. ACM, 2291--2296.Google ScholarDigital Library
- Timothy Bickmore, Daniel Schulman, and Langxuan Yin. 2010. Maintaining engagement in long-term interventions with relational agents. Applied Artificial Intelligence 24, 6 (2010), 648--666.Google ScholarDigital Library
- Timothy W Bickmore and Rosalind W Picard. 2005. Establishing and maintaining long-term human-computer relationships. ACM Transactions on Computer-Human Interaction (TOCHI) 12, 2 (2005), 293--327.Google ScholarDigital Library
- Mimi Bong. 2004. Academic motivation in self-efficacy, task value, achievement goal orientations, and attributional beliefs. The Journal of Educational Research 97, 6 (2004), 287--298.Google ScholarCross Ref
- Arifa Bunglowala and Aaquil Bunglowala. 2015. Nonverbal communication: An integral part of teaching learning process. International Journal of Research in Advent Technology (2015), 371--375.Google Scholar
- Judee K Burgoon. 1980. Nonverbal communication research in the 1970s: An overview. Annals of the International Communication Association 4, 1 (1980), 179--197.Google ScholarCross Ref
- Judee K Burgoon, David B Buller, Jerold L Hale, and Mark A de Turck. 1984. Relational messages associated with nonverbal behaviors. Human Communication Research 10, 3 (1984), 351--378.Google ScholarCross Ref
- Donn Byrne. 1961. Interpersonal attraction and attitude similarity. The Journal of Abnormal and Social Psychology 62, 3 (1961), 713.Google ScholarCross Ref
- Dan S Chiaburu and Sophia V Marinova. 2005. What predicts skill transfer? An exploratory study of goal orientation, training self-efficacy and organizational supports. International journal of training and development 9, 2 (2005), 110--123.Google ScholarCross Ref
- John O Greene and Brant Raney Burleson. 2003. Handbook of communication and social interaction skills. Psychology Press.Google Scholar
- Neha Gupta. 2013. Effective body language in organizations. IUP Journal of Soft Skills 7, 1 (2013), 35.Google Scholar
- Timothy G Hegstrom. 1979. Message impact: What percentage is nonverbal? Western Journal of Communication (includes Communication Reports) 43, 2 (1979), 134--142.Google Scholar
- Joris H Janssen, Wijnand A Ijsselsteijn, and Joyce HDM Westerink. 2014. How affective technologies can influence intimate interactions and improve social connectedness. International Journal of Human-Computer Studies 72, 1 (2014), 33--43.Google ScholarDigital Library
- Mark L Knapp and John Augustine Daly. 2002. Handbook of interpersonal communication. Sage.Google Scholar
- Michael W Kraus. 2017. Voice-only communication enhances empathic accuracy. American Psychologist 72, 7 (2017), 644.Google ScholarCross Ref
- Jean-Philippe Laurenceau, Lisa Feldman Barrett, and Paula R Pietromonaco. 1998. Intimacy as an interpersonal process: The importance of self-disclosure, partner disclosure, and perceived partner responsiveness in interpersonal exchanges. Journal of personality and social psychology 74, 5 (1998), 1238.Google ScholarCross Ref
- James C McCroskey, Virginia P Richmond, and John A Daly. 1975. The development of a measure of perceived homophily in interpersonal communication. Human Communication Research 1, 4 (1975), 323--332.Google ScholarCross Ref
- Monica McHenry, Patricia A Parker, Walter F Baile, and Renato Lenzi. 2012. Voice analysis during bad news discussion in oncology: reduced pitch, decreased speaking rate, and nonverbal communication of empathy. Supportive Care in Cancer 20, 5 (2012), 1073--1078.Google ScholarCross Ref
- Clifford Nass and Li Gong. 2000. Speech interfaces from an evolutionary perspective. Commun. ACM 43, 9 (2000), 36--43.Google ScholarDigital Library
- Hien Nguyen and Judith Masthoff. 2009. Designing empathic computers: the effect of multimodal empathic feedback using animated agent. In Proceedings of the 4th International Conference on Persuasive Technology. ACM, 7.Google ScholarDigital Library
- Jeff S Philpott. 1983. The relative contribution to meaning of verbal and nonverbal channels of communication: A meta-analysis. Unpublished master's thesis, University of Nebraska, Lincoln (1983).Google Scholar
- Rosalind W Picard and Jonathan Klein. 2002. Computers that recognise and respond to user emotion: theoretical and practical implications. Interacting with computers 14, 2 (2002), 141--169.Google Scholar
- Byron Reeves and Clifford Ivar Nass. 1996. The media equation: How people treat computers, television, and new media like real people and places. Cambridge university press.Google ScholarDigital Library
- Harry T Reis and Phillip Shaver. 1988. Intimacy as an interpersonal process. Handbook of personal relationships (1988).Google Scholar
- Helen Riess and Gordon Kraft-Todd. 2014. EMPATHY: A tool to enhance nonverbal communication between clinicians and their patients. Academic Medicine 89, 8 (2014), 1108--1112.Google ScholarCross Ref
- Alfred P Rovai. 2002. Development of an instrument to measure classroom community. The Internet and Higher Education 5, 3 (2002), 197--211.Google ScholarCross Ref
- Eliot R Smith and Diane M Mackie. 2005. Aggression, hatred, and other emotions. On the nature of prejudice: Fifty years after Allport (2005), 361--376.Google Scholar
- Viswanath Venkatesh, Cheri Speier, and Michael G Morris. 2002. User acceptance enablers in individual decision making about technology: Toward an integrated model. Decision sciences 33, 2 (2002), 297--316.Google Scholar
- Nigel Ward. 2000. The challenge of non-lexical speech sounds. In Sixth International Conference on Spoken Language Processing.Google ScholarCross Ref
- Nigel Ward. 2006. Non-lexical conversational sounds in American English. Pragmatics & Cognition 14, 1 (2006), 129--182.Google ScholarCross Ref
Index Terms
- "I Can Feel Your Empathic Voice": Effects of Nonverbal Vocal Cues in Voice User Interface
Recommendations
Measuring Variations of Voice Source and Vocal Tract Characteristics from Korean Emotional Voice
ISDA '06: Proceedings of the Sixth International Conference on Intelligent Systems Design and Applications - Volume 02We explored the voice source and vocal tract characteristics of emotional speech to estimate the voice quality. Emotional speech data used was collected from the actors. Speech materials consist of 10 sentences from 3 male and 3 female speakers in 6 ...
Exploring Effects of Conversational Fillers on User Perception of Conversational Agents
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsThrough technological advancements in various areas of our lives, Conversational Agents progressed in their human-likeness. In the field of HCI, however, the use of conversational fillers (e.g., "um," "uh," etc.) by Conversational Agents have not been ...
Users' perceptions of empathic dialogue cues: A data-driven approach to provide tailored empathy
IVA '18: Proceedings of the 18th International Conference on Intelligent Virtual AgentsUnderstanding how and in what circumstances users respond to different verbal expressions of empathy will be important for designing Intelligent Virtual Agents able to influence the emotions and intrinsic motivations of users. We report a study to teach ...
Comments