skip to main content
10.1145/3419249.3420170acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnordichiConference Proceedingsconference-collections
short-paper

Tell Me More: Transparency and Time-Fillers to Optimize Chatbots’ Waiting Time Experience

Published: 26 October 2020 Publication History

Abstract

In customer-chatbot conversations, the agents regularly come to their limit, which requires to hand over the request to a human service representative. In the case of unmanaged handovers, customers encounter huge uncertainty while waiting and are often left alone with unsatisfied service inquiries. The waiting time (and service experience) might result in frustration and potential loss of the customer. In this paper, we discuss results from a study aimed at turning chatbot handover routines into positive experiences. In a lab study with (n=28) participants, we compared two handover types that utilized the concepts of time fillers and time and queue information with a baseline handover without such countermeasures. Our results, based on subjective waiting experience, service quality, as well as user experience and affect confirm that digital enterprises have to provide maximum transparency to customers, e.g., details about waiting time and queue status. In addition, they might use “time-fillers’’ in waiting situations to further improve customer satisfaction.

References

[1]
Jenet Manyi Agbor. 2011. The Relationship between Customer Satisfaction and Service Quality : A Study of Three Service Sectors in Umeå.
[2]
Digitas North America and Harris Poll. 2016. Chatbots: A Guide for Brands. (2016). https://www.slideshare.net/DigitasLBi_US/chatbots-a-guide-for-brands
[3]
Zahra Ashktorab, Mohit Jain, Q. Vera Liao, and Justin D. Weisz. 2019. Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, Article 254, 12 pages. https://doi.org/10.1145/3290605.3300484
[4]
Siddhartha Asthana, Pushpendra Singh, and Parul Gupta. 2015. Survival Analysis: Objective Assessment of Wait Time in HCI. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 367–376. https://doi.org/10.1145/2702123.2702428
[5]
Daniel Baier, Alexandra Rese, and Maximilian Röglinger. 2018. Conversational User Interfaces for Online Shops? A Categorization of Use Cases. In International Conference on Information Systems (2018). ICIS 2018, San Francisco, USA, 18. https://www.fim-rc.de/Paperbibliothek/Veroeffentlicht/822/wi-822.pdf
[6]
Samuel Bell, Clara Wood, and Advait Sarkar. 2019. Perceptions of Chatbots in Therapy. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). ACM, New York, NY, USA, Article LBW1712, 6 pages. https://doi.org/10.1145/3290607.3313072
[7]
Petter Bae Brandtzaeg and Asbjørn Følstad. 2018. Chatbots: Changing User Needs and Motivations. Interactions 25, 5 (Aug. 2018), 38–43. https://doi.org/10.1145/3236669
[8]
Ziv Carmon and Daniel Kahneman. 1996. The Experienced Utility of Queuing: Experience Profiles and Retrospective Evaluations of Simulated Queues.
[9]
Mark M. Davis and Janelle Heineke. 1998. How Disconfirmation, Perception and Actual Waiting Times Impact Customer Satisfaction. International Journal of Service Industry Management 9, 1 (1998), 64–73. https://doi.org/10.1108/09564239810199950
[10]
Mark M. Davis and Thomas E. Vollmann. 1990. A Framework for Relating Waiting Time and Customer Satisfaction in a Service Operation. Journal of Services Marketing 4, 1 (1990), 61–69. https://doi.org/10.1108/EUM0000000002506
[11]
A. Elmorshidy. 2011. Benefits Analysis of Live Customer Support Chat in E-commerce Websites: Dimensions of a New Success Model for Live Customer Support Chat. In 2011 10th International Conference on Machine Learning and Applications and Workshops, Vol. 2. IEEE, Honolulu, Hawaii, 325–329.
[12]
Asbjørn Følstad and Petter Bae Brandtzæg. 2017. Chatbots and the new world of HCI. interactions 24, 4 (2017), 38–42.
[13]
Asbjørn Følstad, Petter Bae Brandtzaeg, Tom Feltwell, Effie L-C. Law, Manfred Tscheligi, and Ewa A. Luger. 2018. SIG: Chatbots for Social Good. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). ACM, New York, NY, USA, Article SIG06, 4 pages. https://doi.org/10.1145/3170427.3185372
[14]
Peter Fröhlich. 2005. Dealing with System Response Times in Interactive Speech Applications. In CHI ’05 Extended Abstracts on Human Factors in Computing Systems (Portland, OR, USA) (CHI EA ’05). Association for Computing Machinery, New York, NY, USA, 1379–1382. https://doi.org/10.1145/1056808.1056921
[15]
Asbjørn Følstad, Cecilie Bertinussen Nordheim, and Cato Alexander Bjørkli. 2018. What Makes Users Trust a Chatbot for Customer Service? An Exploratory Interview Study. In Internet Science (2018) (Lecture Notes in Computer Science), Svetlana S. Bodrunova (Ed.). Springer International Publishing, St. Petersburg, Russia, 194–208. https://doi.org/10.1007/978-3-030-01437-7_16
[16]
Claire Gelinas-Chebat, Alexander Vaninski, Pierre Filiatrault, and Jean-Charles Chebat. 1995. The Impact of Mood on Time Perception, Memorization, and Acceptance of Waiting. Genetic, Social, and General Psychological Monographs 4 (1995), 13–424.
[17]
Ulrich Gnewuch, Stefan Morana, and Alexander Maedche. 2017. Towards Designing Cooperative and Social Conversational Agents for Customer Service. In Proceedings of the International Conference on Information Systems (ICIS) 2017 (2017-12). Association for Information Systems, Seoul, South Korea, 15.
[18]
Chris Harrison, Brian Amento, Stacey Kuznetsov, and Robert Bell. 2007. Rethinking the Progress Bar. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (Newport, Rhode Island, USA) (UIST ’07). Association for Computing Machinery, New York, NY, USA, 115–118. https://doi.org/10.1145/1294211.1294231
[19]
Marc Hassenzahl, Sarah Diefenbach, and Anja Göritz. 2010. Needs, affect, and interactive products – Facets of user experience. Interacting with Computers 22, 5 (04 2010), 353–362. https://doi.org/10.1016/j.intcom.2010.04.002 arXiv:https://academic.oup.com/iwc/article-pdf/22/5/353/1997205/iwc22-0353.pdf
[20]
A. Hinz. 2000. Psychologie Der Zeit. Waxmann, Münster; New York; München; Berlin. https://books.google.de/books?id=BV6P5yhuJtwC
[21]
Jacob Hornik. 1984. Subjective vs. Objective Time Measures: A Note on the Perception of Time in Consumer Behavior. Journal of Consumer Research 11, 1 (1984), 615. https://doi.org/10.1086/208998
[22]
Jacob Hornik and Dan Zakay. 1996. Psychological Time: The Case of Time and Consumer Behaviour. Time & Society 5, 3 (1996), 385–397. https://doi.org/10.1177/0961463X96005003007 arXiv:https://doi.org/10.1177/0961463X96005003007
[23]
Mark B. Houston, Lance A. Bettencourt, and Sutha Wenger. 1998. The Relationship between Waiting in a Service Queue and Evaluations of Service Quality: A Field Theory Perspective. Psychology &amp; Marketing 15, 8 (1998), 735-753. https://doi.org/10.1002/(SICI)1520-6793(199812)15:8<735::AID-MAR2>3.0.CO;2-9
[24]
Michael K. Hui and David K. Tse. 1996. What to Tell Consumers in Waits of Different Lengths: An Integrative Model of Service Evaluation. Journal of Marketing 60, 2 (1996), 81–90. jstor:1251932
[25]
Michael K. Hui and Lianxi Zhou. 1996. How Does Waiting Duration Information Influence Customers’ Reactions to Waiting for Services?1. Journal of Applied Social Psychology 26, 19 (1996), 1702–1717. https://doi.org/10.1111/j.1559-1816.1996.tb00093.x
[26]
Mohit Jain, Pratyush Kumar, Ramachandra Kota, and Shwetak N. Patel. 2018. Evaluating and Informing the Design of Chatbots. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS ’18). Association for Computing Machinery, New York, NY, USA, 895–906. https://doi.org/10.1145/3196709.3196735
[27]
Titta Jylkäs, Mikko Henrikki Äijälä, Tytti Marianne Vuorikari, and Vésaal Rajab. 2018. AI Assistants as Non-Human Actors in Service Design. In Next Wave: The 21st Dmi: Academic Design Management Conference Proceedings (2018-07). Design Management Institute, London, UK, 1436–1444. https://lacris.ulapland.fi/en/publications/ai-assistants-as-nonhuman-actors-in-service-design(bc93bc22-a028-4e5e-8ff1-1b46976937da).html
[28]
Dr Julian M Kawohl and Stefanie Haß. 2018. Customer Service 4.0 - Wie gut sind Chatbots?https://www.heise.de/downloads/18/2/5/4/1/3/4/2/Studie_chatbots.pdf
[29]
Robert Kusber. 2017. Chatbots – Conversational UX Platforms. In Innovationen und Innovationsmanagement in der Finanzbranche, Remigiusz Smolinski, Moritz Gerdes, Martin Siejka, and Mariusz C Bodek (Eds.). Springer Fachmedien Wiesbaden, Wiesbaden, Germany, 231–244.
[30]
Minha Lee, Sander Ackermans, Nena van As, Hanwen Chang, Enzo Lucas, and Wijnand IJsselsteijn. 2019. Caring for Vincent: A Chatbot for Self-Compassion. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, Article 702, 13 pages. https://doi.org/10.1145/3290605.3300932
[31]
David H. Maister and Harvard Business School. 1985. The Psychology of Waiting Lines. https://davidmaister.com/wp-content/themes/davidmaister/pdf/PsycholgyofWaitingLines751.pdf
[32]
Rory McElearney. 2017. What’s With All The Crappy Chatbots?https://disruptionhub.com/whats-crappy-chatbots/
[33]
Michael McTear, Zoraida Callejas, and David Griol. 2016. The Conversational Interface. Springer International Publishing, Cham. https://doi.org/10.1007/978-3-319-32967-3
[34]
Robert J. Moore, Raphael Arar, Guang-Jie Ren, and Margaret H. Szymanski. 2017. Conversational UX Design. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI EA ’17). Association for Computing Machinery, New York, NY, USA, 492–497. https://doi.org/10.1145/3027063.3027077
[35]
Nira Munichor and Anat Rafaeli. 2007. Numbers or Apologies? Customer Reactions to Telephone Waiting Time Fillers.Journal of Applied Psychology 92, 2 (2007), 511–518. https://doi.org/10.1037/0021-9010.92.2.511
[36]
Brad A Myers. 1985. The importance of percent-done progress indicators for computer-human interfaces. ACM SIGCHI Bulletin 16, 4 (1985), 11–17.
[37]
Cecilie Bertinussen Nordheim. 2018. Trust in Chatbots for Customer Service. https://www.duo.uio.no/bitstream/handle/10852/63498/CecilieBertinussenNordheim_masteroppgaveV18.pdf?sequence=1&isAllowed=y
[38]
Donald A. Norman. 2008. THE PSYCHOLOGY OF WAITING LINES. http://www.jnd.org/ms/Norman%20The%20Psychology%20of%20Waiting%20Lines.pdf
[39]
Achim Oßwald, Fachhochschule, and Studiengang Bibliotheks- und Informationswissenschaft. 2011. MALIS-Praxisprojekte 2011: Projektberichte aus dem berufsbegleitenden Masterstudiengang Bibliotheks- und Informationswissenschaft der Fachhochschule Köln. Dinges & Frick, Wiesbaden. http://www.b-i-t-online.de/daten/BIT_Innovativ_35_MaLIS.pdf OCLC: 845012766.
[40]
A. Poleshova. 2017. Chatbots - Gründe der Nutzung in Deutschland 2017 | Umfrage. https://de.statista.com/statistik/daten/studie/797057/umfrage/gruende-der-nutzung-von-chatbots-in-deutschland/
[41]
Ad Pruyn and Ale Smidts. 1998. Effects of Waiting on the Satisfaction with the Service: Beyond Objective Time Measures. International Journal of Research in Marketing 15, 4 (1998), 321–334. https://doi.org/10.1016/S0167-8116(98)00008-1
[42]
Nicole M. Radziwill and Morgan C. Benton. 2017. Evaluating Quality of Chatbots and Intelligent Conversational Agents. arxiv:1704.04579 [cs.CY]
[43]
Steven R. Rick, Aaron Paul Goldberg, and Nadir Weibel. 2019. SleepBot: Encouraging Sleep Hygiene Using an Intelligent Chatbot. In Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion (Marina del Ray, California) (IUI ’19). ACM, New York, NY, USA, 107–108. https://doi.org/10.1145/3308557.3308712
[44]
Szymon Rozga. 2018. Human Handoff. Apress, Berkeley, CA, 547–570. https://doi.org/10.1007/978-1-4842-3540-9_12
[45]
Sherry Ruan, Liwei Jiang, Justin Xu, Bryce Joe-Kun Tham, Zhengneng Qiu, Yeshuang Zhu, Elizabeth L. Murnane, Emma Brunskill, and James A. Landay. 2019. QuizBot: A Dialogue-based Adaptive Learning System for Factual Knowledge. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, Article 357, 13 pages. https://doi.org/10.1145/3290605.3300587
[46]
Kennon M Sheldon, Andrew J Elliot, Youngmee Kim, and Tim Kasser. 2001. What is satisfying about satisfying events? Testing 10 candidate psychological needs.Journal of personality and social psychology 80, 2(2001), 325.
[47]
Efraim Turban, Jon Outland, David King, Jae Kyu Lee, Ting-Peng Liang, and Deborrah C. Turban. 2018. Intelligent (Smart) E-Commerce. Springer International Publishing, Cham, 249–283. https://doi.org/10.1007/978-3-319-58715-8_7
[48]
Elen Veenpere. 2017. Customer Service Glossary: Words and Phrases to Know. https://www.groovehq.com/support/customer-service-glossary
[49]
D. Watson, L. A. Clark, and A. Tellegen. 1988. Development and Validation of Brief Measures of Positive and Negative Affect: The PANAS Scales. Journal of Personality and Social Psychology 54, 6(1988), 1063–1070. 3397865
[50]
Anbang Xu, Zhe Liu, Yufan Guo, Vibha Sinha, and Rama Akkiraju. 2017. A New Chatbot for Customer Service on Social Media. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3506–3510. https://doi.org/10.1145/3025453.3025496
[51]
Zhilin Yang, Minjoon Jun, and Robin T. Peterson. 2004. Measuring Customer Perceived Online Service Quality: Scale Development and Managerial Implications. International Journal of Operations & Production Management 24, 11(2004), 1149–1174. https://doi.org/10.1108/01443570410563278
[52]
Jennifer Zamora. 2017. I’m Sorry, Dave, I’m Afraid I Can’t Do That: Chatbot Perception and Expectations. In Proceedings of the 5th International Conference on Human Agent Interaction (Bielefeld, Germany) (HAI ’17). Association for Computing Machinery, New York, NY, USA, 253–260. https://doi.org/10.1145/3125739.3125766

Cited By

View all
  • (2024)A Multilayer Architecture towards the Development and Distribution of Multimodal Interface Applications on the EdgeSensors10.3390/s2416519924:16(5199)Online publication date: 11-Aug-2024
  • (2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
  • (2024)Explaining the Wait: How Justifying Chatbot Response Delays Impact User TrustProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665550(1-16)Online publication date: 8-Jul-2024
  • Show More Cited By

Index Terms

  1. Tell Me More: Transparency and Time-Fillers to Optimize Chatbots’ Waiting Time Experience
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      NordiCHI '20: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society
      October 2020
      1177 pages
      ISBN:9781450375795
      DOI:10.1145/3419249
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 26 October 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Chatbots
      2. conversational agents
      3. conversational breakdown
      4. customer service
      5. handover
      6. service design

      Qualifiers

      • Short-paper
      • Research
      • Refereed limited

      Conference

      NordiCHI '20
      NordiCHI '20: Shaping Experiences, Shaping Society
      October 25 - 29, 2020
      Tallinn, Estonia

      Acceptance Rates

      NordiCHI '20 Paper Acceptance Rate 89 of 399 submissions, 22%;
      Overall Acceptance Rate 379 of 1,572 submissions, 24%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)81
      • Downloads (Last 6 weeks)11
      Reflects downloads up to 10 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)A Multilayer Architecture towards the Development and Distribution of Multimodal Interface Applications on the EdgeSensors10.3390/s2416519924:16(5199)Online publication date: 11-Aug-2024
      • (2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
      • (2024)Explaining the Wait: How Justifying Chatbot Response Delays Impact User TrustProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665550(1-16)Online publication date: 8-Jul-2024
      • (2024)Reconfiguring the Customer Service Domain: Perspectives of Managers, Conversational Designers, and Human Agents on Human–Chatbot CollaborationInternational Journal of Innovation and Technology Management10.1142/S021987702450028721:04Online publication date: 26-Feb-2024
      • (2024)How an Android Expresses “Now Loading…”: Examining the Properties of Thinking FacesInternational Journal of Social Robotics10.1007/s12369-024-01163-916:8(1861-1877)Online publication date: 5-Aug-2024
      • (2024)Tax and Welfare Chatbots Used by Young Adults with Dyslexia: A Usability StudyUniversal Access in Human-Computer Interaction10.1007/978-3-031-60875-9_23(337-352)Online publication date: 1-Jun-2024
      • (2023)Enhancing conversational agents for successful operation: A multi-perspective evaluation approach for continuous improvementElectronic Markets10.1007/s12525-023-00662-333:1Online publication date: 5-Aug-2023
      • (2022)Understanding User Perceptions of Response Delays in Crowd-Powered Conversational SystemsProceedings of the ACM on Human-Computer Interaction10.1145/35557656:CSCW2(1-42)Online publication date: 11-Nov-2022
      • (2022)How HCI Adopts Service DesignProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502128(1-14)Online publication date: 29-Apr-2022
      • (2022)Don’t Throw It Over the Fence! Toward Effective Handover from Conversational Agents to Service EmployeesHuman-Computer Interaction. User Experience and Behavior10.1007/978-3-031-05412-9_36(531-545)Online publication date: 16-Jun-2022
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media