skip to main content
10.1145/3171221.3171258acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
research-article

Getting to Know Each Other: The Role of Social Dialogue in Recovery from Errors in Social Robots

Published: 26 February 2018 Publication History

Abstract

This work explores the extent to which social dialogue can mitigate (or exacerbate) the loss of trust caused when robots make conversational errors. Our study uses a NAO robot programmed to persuade users to agree with its rankings on two tasks. We perform two manipulations: (1) The timing of conversational errors - the robot exhibited errors either in the first task, the second task, or neither; (2) The presence of social dialogue - between the two tasks, users either engaged in a social dialogue with the robot or completed a control task. We found that the timing of the errors matters: replicating previous research, conversational errors reduce the robot's influence in the second task, but not on the first task. Social dialogue interacts with the timing of errors, acting as an intensifier: social dialogue helps the robot recover from prior errors, and actually boosts subsequent influence; but social dialogue backfires if it is followed by errors, because it extends the period of good performance, creating a stronger contrast effect with the subsequent errors. The design of social robots should therefore be more careful to avoid errors after periods of good performance than early on in a dialogue.

Supplementary Material

MP4 File (fp1126.mp4)

References

[1]
Kanda, T., Shiomi, M., Miyashita, Z., Ishiguro, H. & Hagita, N. A Communication Robot in a Shopping Mall. IEEE Trans. Robot. 26, 897--913 (2010).
[2]
Wang, Y., Khooshabeh, P. & Gratch, J. Looking real and making mistakes. in International Workshop on Intelligent Virtual Agents, 339--348, (Springer, 2013).
[3]
Blascovich, J. & McCall, C. Social Influence in Virtual Environments. in The Oxford handbook of media psychology, 305--315 (Oxford University Press, 2013).
[4]
Desai, M., Medvedev, M., Vázquez, M., McSheehy, S., Gadea-Omelchenko, S., Bruggeman, C., Steinfeld, A., & Yanco, H. Effects of changing reliability on trust of robot systems. in Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction - HRI '12 73 (ACM Press, 2012).
[5]
Desai, M., Kaniarasu, P., Medvedev, M., Steinfeld, A. & Yanco, H. Impact of robot failures and feedback on real-time trust. Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction, 251--258 (2013).
[6]
Wiegmann, D. A., Rich, A. & Zhang, H. Automated diagnostic aids: The effects of aid reliability on users? trust and reliance. Theor. Issues Ergon. Sci., 2, 352--367 (2001).
[7]
Melson, G. F., Kahn, Jr., P. H., Beck, A. & Friedman, B. Robotic Pets in Human Lives: Implications for the Human-Animal Bond and for Human Relationships with Personified Technologies. J. Soc. Issues, 65, 545--567 (2009).
[8]
Sundar, S. S., Jung, E. H., Waddell, T. F. & Kim, K. J. Cheery companions or serious assistants? Role and demeanor congruity as predictors of robot attraction and use intentions among senior citizens. Int. J. Hum. Comput. Stud., 97, 88--97 (2017).
[9]
Kanda, T., Hirano, T., Eaton, D. & Ishiguro, H. PPerson Identification and Interaction of Social Robots by Using Wireless Tags. in IEEE International Conference on Intelligent Robots and Systems, 2, 1657--1664 (2003).
[10]
Sumioka H. Wada Y., Ishiguro H. Teachers' Impressions on Robots for Therapeutic Applications. JSAI International Symposium on Artificial Intelligence. (Springer, 2015).
[11]
Bogue, R. Domestic robots: Has their time finally come? Ind. Robot An Int. J., 44, 129--136 (2017).
[12]
Tickle-Degnen, L., Scheutz, M. & Arkin, R. C. Collaborative Robots in Rehabilitation for Social Self-Management of Health. (2014).
[13]
Kojima, K., Karasawa, T., Kozuki, T., Kuroiwa, E., Yukizaki, S., Iwaishi, S., Ishikawa, T., Koyama, R., Noda, S., Sugai, F., & Nozawa, S. Development of life-sized high-power humanoid robot JAXON for real-world use. in 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), 838--843 (IEEE, 2015).
[14]
Cassell, J. & Bickmore, T. Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents. User Model. User-adapt. Interact., 13, 89--132 (2003).
[15]
Traum, D., Swartout, W., Marsella, S. & Gratch, J. Fight, flight, or negotiate: Believable strategies for conversing under crisis. Proc. Intell. Virtual Agents, 52--64 (2005).
[16]
Manuvinakurike, R., Velicer, W. F. & Bickmore, T. W. Automated indexing of Internet stories for health behavior change: weight loss attitude pilot study. J. Med. Internet Res., 16, e285 (2014).
[17]
Hiraoka, T., Neubig, G., Sakti, S., Toda, T. & Nakamura, S. Reinforcement Learning of Cooperative Persuasive Dialogue Policies using Framing. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, 1706--1717 (2014).
[18]
Hancock, P.A., Billings, D.R., Schaefer, K.E., Chen, J.Y., De Visser, E.J., & Parasuraman, R. A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction. J. Hum. Factors Ergon. Soc., 53, 517--527 (2011).
[19]
Salem, M., Lakatos, G., Amirabdollahian, F. & Dautenhahn, K. Would You Trust a (Faulty) Robot? in Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction - HRI '15, 141--148 (ACM Press, 2015).
[20]
Ham, J. & Midden, C. J. H. A persuasive robot to stimulate energy conservation: the influence of positive and negative social feedback and task similarity on energy-consumption behavior. Int. J. Soc. Robot., 6, 163--171 (2014).
[21]
Goetz, J., Kiesler, S. & Powers, A. Matching robot appearance and behavior to tasks to improve human-robot cooperation. in The 12th IEEE International Workshop on Robot and Human Interactive Communication, 55--60 (IEEE, 2003).
[22]
Siegel, M., Breazeal, C. & Norton, M. I. Persuasive robotics: The influence of robot gender on human behavior. in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2563--2568 (IEEE, 2009).
[23]
Ham, J., Bokhorst, R., Cuijpers, R., van der Pol, D. & Cabibihan, J.-J. Making robots persuasive: the influence of combining persuasive strategies (gazing and gestures) by a storytelling robot on its persuasive power. in International conference on social robotics, 71--83 (Springer, 2011).
[24]
Lee, S. A. & Liang, Y. The role of reciprocity in verbally persuasive robots. Cyberpsychology, Behav. Soc. Netw., 19, 524--527 (2016).
[25]
Lopez, A., Ccasane, B., Paredes, R. & Cuellar, F. Effects of Using Indirect Language by a Robot to Change Human Attitudes. in Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction - HRI '17, 193--194 (ACM Press, 2017).
[26]
Chidambaram, V., Chiang, Y.-H. & Mutlu, B. Designing persuasive robots. in Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction - HRI '12 293 (ACM Press, 2012).
[27]
Krämer, N., Karacora, B., Lucas, G. M., Dehghani, M., Rüther, G., & Gratch, J. Closing the gender gap in STEM with friendly male instructors? On the effects of rapport behavior and gender of a virtual agent in an instructional interaction. Comput. Educ., 99, 1--13 (2016).
[28]
Tickle-Degnen, L. & Rosenthal, R. The nature of rapport and its nonverbal correlates. Psychol. Inq., 1, 285--293 (1990).
[29]
Gremler, D. D. & Gwinner, K. P. Customer-Employee Rapport in Service Relationships. J. Serv. Res., 3, 82--104 (2000).
[30]
Gfeller, J. D., Lynn, S. J. & Pribble, W. E. Enhancing hypnotic susceptibility: Interpersonal and rapport factors. J. Pers. Soc. Psychol., 52, 586 (1987).
[31]
Carey, J. C., Stanley, D. A. & Biggers, J. Peak alert time and rapport between residence hall roommates. J. Coll. Stud. Dev. (1988).
[32]
Fuchs, D. Examiner Familiarity Effects on Test Performance. Topics Early Child. Spec. Educ., 7, 90--104 (1987).
[33]
Burns, M. Rapport and relationships: The basis of child care. J. Child Care (1984).
[34]
Mutlu, B. & Forlizzi, J. Robots in organizations. in Proceedings of the 3rd international conference on Human robot interaction - HRI '08, 287 (ACM Press, 2008).
[35]
Azhar, M. Q. Toward an argumentation-based dialogue framework for human-robot collaboration. in Proceedings of the 14th ACM international conference on Multimodal interaction, 305 (ACM Press, 2012).
[36]
Clear, T., Daniels, M., Clear, T. & Daniels, M. A cyber-icebreaker for an effective virtual group? in Proceedings of the 6th annual conference on Innovation and technology in computer science education, 33, 121--124 (ACM Press, 2001).
[37]
Mitchell, S. K. & Shepard M. Building Social Presence through Engaging Online Instructional Strategies. in Student-Teacher Interaction in Online Learning Environments, 133--156 (2015).
[38]
Risvik, L. L. Framework for the Design and Evaluation of Icebreakers in Group Work. Master's Thesis. (2014).
[39]
Inaguma, H., Inoue, K., Nakamura, S., Takanashi, K. & Kawahara, T. Prediction of ice-breaking between participants using prosodic features in the first meeting dialogue. in Proceedings of the 2nd Workshop on Advancements in Social Signal Processing for Multimodal Interaction, 11--15 (ACM Press, 2016).
[40]
Sidner, C. L., Kidd, C. D., Lee, C. & Lesh, N. Where to look: a study of human-robot engagement. in Proceedings of the 9th international conference on Intelligent user interfaces, 78--84 (ACM, 2004).
[41]
Gockley, R., Bruce, A., Forlizzi, J., Michalowski, M., Mundell, A., Rosenthal, S., Sellner, B., Simmons, R., Snipes, K., Schultz, A.C., & Wang, J. Designing robots for long-term social interaction. in IEEE/RSJ International Conference on Intelligent Robots and Systems, 1338--1343 (IEEE, 2005).
[42]
Moon, Y. & Youngme. The effects of distance in local versus remote human-computer interaction. in Proceedings of the SIGCHI conference on Human factors in computing systems, 103--108 (ACM Press, 1998).
[43]
Khooshabeh, P., McCall, C., Gandhe, S., Gratch, J. & Blascovich, J. Does it matter if a computer jokes. in CHI'11 Extended Abstracts on Human Factors in Computing Systems, 77--86 (ACM, 2011).
[44]
Ramachandran, D. & Canny, J. The persuasive power of human-machine dialogue. in International Conference on Persuasive Technology, 189--200 (Springer, 2008).
[45]
Kelley, J. F. An iterative design methodology for user-friendly natural language office information applications. ACM Trans. Inf. Syst., 2, 26--41 (1984).
[46]
Artstein, R., Traum, D., Boberg, J., Gainer, A., Gratch, J., Johnson, E., Leuski, A., & Nakano, M. Listen to My Body: Does Making Friends Help Influence People? Proceedings of the Thirtieth International Florida Artificial Intelligence Research Society Conference, 430--435. (2017).
[47]
Von der Pütten, A. M., Krämer, N. C., Gratch, J. & Kang, S.-H. It doesn't matter what you are!? Explaining social effects of agents and avatars. Comput. Human Behav., 26, 1641--1650 (2010).
[48]
Sherman, S. J., Ahlm, K., Berman, L. & Lynn, S. Contrast effects and their relationship to subsequent behavior. J. Exp. Soc. Psychol., 14, 340--350 (1978).
[49]
Nuñez, T. R., Prynda, K., Bergmann, & K. Von der Pütten, A. M. Computers Aligning to Their Users: Lexical Alignment in Human-Agent-Interaction and Its Psychological Effects. Virtual Social Interaction Workshop. (2017).

Cited By

View all
  • (2025)Breaking down barriersInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103403194:COnline publication date: 1-Feb-2025
  • (2024)Do Humans Trust Robots that Violate Moral Trust?ACM Transactions on Human-Robot Interaction10.1145/365199213:2(1-30)Online publication date: 14-Jun-2024
  • (2024)Augmenting Human Teams with Robots in Knowledge Work Settings: Insights from the LiteratureACM Transactions on Human-Robot Interaction10.1145/364988413:2(1-34)Online publication date: 14-Jun-2024
  • Show More Cited By

Index Terms

  1. Getting to Know Each Other: The Role of Social Dialogue in Recovery from Errors in Social Robots

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    HRI '18: Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction
    February 2018
    468 pages
    ISBN:9781450349536
    DOI:10.1145/3171221
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 February 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. errors
    2. influence
    3. rapport
    4. social dialogue
    5. social robots

    Qualifiers

    • Research-article

    Conference

    HRI '18
    Sponsor:

    Acceptance Rates

    HRI '18 Paper Acceptance Rate 49 of 206 submissions, 24%;
    Overall Acceptance Rate 268 of 1,124 submissions, 24%

    Upcoming Conference

    HRI '25
    ACM/IEEE International Conference on Human-Robot Interaction
    March 4 - 6, 2025
    Melbourne , VIC , Australia

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)99
    • Downloads (Last 6 weeks)16
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Breaking down barriersInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103403194:COnline publication date: 1-Feb-2025
    • (2024)Do Humans Trust Robots that Violate Moral Trust?ACM Transactions on Human-Robot Interaction10.1145/365199213:2(1-30)Online publication date: 14-Jun-2024
    • (2024)Augmenting Human Teams with Robots in Knowledge Work Settings: Insights from the LiteratureACM Transactions on Human-Robot Interaction10.1145/364988413:2(1-34)Online publication date: 14-Jun-2024
    • (2024)Power in Human-Robot InteractionProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634949(269-282)Online publication date: 11-Mar-2024
    • (2023)"Enjoy, but Moderately!": Designing a Social Companion Robot for Social Engagement and Behavior Moderation in Solitary Drinking ContextProceedings of the ACM on Human-Computer Interaction10.1145/36100287:CSCW2(1-24)Online publication date: 4-Oct-2023
    • (2023)A Study on Customer’s Perception of Robot Nonverbal Communication Skills in a Service Environment2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309634(301-306)Online publication date: 28-Aug-2023
    • (2023)Continuous Error Timing in Automation: The Peak-End Effect on Human-Automation TrustInternational Journal of Human–Computer Interaction10.1080/10447318.2023.2223954(1-13)Online publication date: 20-Jun-2023
    • (2022)Who's Laughing NAO?Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3523760.3523804(313-322)Online publication date: 7-Mar-2022
    • (2022)Designing Man’s New Best Friend: Enhancing Human-Robot Dog Interaction through Dog-Like Framing and AppearanceSensors10.3390/s2203128722:3(1287)Online publication date: 8-Feb-2022
    • (2022)The Influence of Robots’ Fairness on Humans’ Reward-Punishment Behaviors and Trust in Human-Robot Cooperative TeamsHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/0018720822113327266:4(1103-1117)Online publication date: 11-Oct-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media