skip to main content
10.1145/3500868.3559476acmconferencesArticle/Chapter ViewAbstractPublication PagescscwConference Proceedingsconference-collections
extended-abstract

Action-a-Bot: Exploring Human-Chatbot Conversations for Actionable Instruction Giving and Following

Published: 08 November 2022 Publication History

Abstract

Conversation serves as one critical mechanism for knowledge-sharing and instruction-giving in collaborative work. Conversation allows people to take turns to make contributions, plan joint actions, align shared understanding of work status and resolve action failure. However, when such collaboration involves non-human AI actors like chatbots, there is a lack of understanding of how human participants may respond to the chatbot’s prompts and guidance, and whether the interaction can similarly improve the actionability of instructions given to people. In this study, we prototyped a chatbot system, ActionaBot for providing task instructions to novice workers, and conducted an initial study to explore its effects on procedural instruction giving and following. Our results indicate that, novices although might perceive instructions to be inactionable due to prior experience and how instructions were authored, they were able to follow conversational guidance and willing to adapt to the chatbot through turn-taking to calibrate working states back-and-forth. Besides, users’ awareness of the work status increased with the conversational prompts from the chatbot.

References

[1]
John Bowers and John Churcher. 1988. Local and global structuring of computer mediated communication: Developing linguistic perspectives on CSCW in COSMOS. In Proceedings of the 1988 ACM conference on Computer-supported cooperative work. 125–139.
[2]
Barry Brown and Marek Bell. 2004. CSCW at play: ’there’as a collaborative virtual environment. In Proceedings of the 2004 ACM conference on Computer supported cooperative work. 350–359.
[3]
Mark Buckley and Magdalena Wolska. 2008. A classification of dialogue actions in tutorial dialogue. In Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008). 73–80.
[4]
Jean Carletta, Amy Isard, Stephen Isard, Jacqueline C Kowtko, Gwyneth Doherty-Sneddon, and Anne H Anderson. 1997. The reliability of a dialogue structure coding scheme.(1997).
[5]
Herbert H Clark and Susan E Brennan. 1991. Grounding in communication.(1991).
[6]
Herbert H Clark and Catherine R Marshall. 1981. Definite knowledge and mutual knowledge. (1981).
[7]
John Corner 1996. The art of record: A critical introduction to documentary. Manchester University Press.
[8]
National Research Council 2000. How people learn: Brain, mind, experience, and school: Expanded edition. National Academies Press.
[9]
Peggy A Ertmer and Timothy J Newby. 1996. The expert learner: Strategic, self-regulated, and reflective. Instructional science 24, 1 (1996), 1–24.
[10]
Darren Gergle, Robert E Kraut, and Susan R Fussell. 2013. Using visual information for grounding and awareness in collaborative tasks. Human–Computer Interaction 28, 1 (2013), 1–39.
[11]
Arthur C Graesser, Natalie K Person, and Joseph P Magliano. 1995. Collaborative dialogue patterns in naturalistic one-to-one tutoring. Applied cognitive psychology 9, 6 (1995), 495–522.
[12]
James A Jones, Mary Jean Harrold, and John Stasko. 2002. Visualization of test information to assist fault localization. In Proceedings of the 24th International Conference on Software Engineering. ICSE 2002. IEEE, 467–477.
[13]
Dimosthenis Kontogiorgos and Joakim Gustafson. 2021. Measuring collaboration load with pupillary responses-implications for the design of instructions in task-oriented hri. Frontiers in Psychology(2021), 2355.
[14]
Susan E McDaniel, Gary M Olson, and Joseph C Magee. 1996. Identifying and analyzing multiple threads in computer-mediated and face-to-face conversations. In Proceedings of the 1996 ACM conference on Computer supported cooperative work. 39–47.
[15]
Alexander Nakhimovsky. 1988. Aspect, aspectual class, and the temporal structure of narrative. Computational Linguistics 14, 2 (1988), 29–43.
[16]
Massimo Poesio and David R Traum. 1997. Conversational actions and discourse situations. Computational intelligence 13, 3 (1997), 309–347.
[17]
Dragos-Paul Pop and Adam Altar. 2014. Designing an MVC model for rapid web application development. Procedia Engineering 69(2014), 1172–1179.
[18]
Dave Raggett, Arnaud Le Hors, Ian Jacobs, 1999. HTML 4.01 Specification. W3C recommendation 24(1999).
[19]
Harvey Sacks, Emanuel A Schegloff, and Gail Jefferson. 1978. A simplest systematics for the organization of turn taking for conversation. In Studies in the organization of conversational interaction. Elsevier, 7–55.
[20]
Nancy P Scheel and Robert C Branch. 1993. The role of conversation and culture in the systematic design of instruction. Educational technology(1993), 7–18.
[21]
Emanuel A Schegloff. 2000. Overlapping talk and the organization of turn-taking for conversation. Language in society 29, 1 (2000), 1–63.
[22]
Robert C Stalnaker. 1978. Assertion. In Pragmatics. Brill, 315–332.
[23]
Lucy A Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge university press.
[24]
Jens Voegler, Jens Bornschein, and Gerhard Weber. 2014. Markdown–A simple syntax for transcription of accessible study materials. In International Conference on Computers for Handicapped Persons. Springer, 545–548.
[25]
Naomi Yamashita, Rieko Inaba, Hideaki Kuzuoka, and Toru Ishida. 2009. Difficulties in establishing common ground in multiparty groups using machine translation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 679–688.

Cited By

View all
  • (2023)Collaborating with a Text-Based Chatbot: An Exploration of Real-World Collaboration Strategies Enacted during Human-Chatbot InteractionsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580995(1-17)Online publication date: 19-Apr-2023

Index Terms

  1. Action-a-Bot: Exploring Human-Chatbot Conversations for Actionable Instruction Giving and Following

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CSCW'22 Companion: Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing
    November 2022
    318 pages
    ISBN:9781450391900
    DOI:10.1145/3500868
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 November 2022

    Check for updates

    Author Tags

    1. chatbot
    2. how-to tutorials
    3. instruction-following
    4. instruction-giving

    Qualifiers

    • Extended-abstract
    • Research
    • Refereed limited

    Conference

    CSCW '22
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

    Upcoming Conference

    CSCW '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)88
    • Downloads (Last 6 weeks)8
    Reflects downloads up to 14 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Collaborating with a Text-Based Chatbot: An Exploration of Real-World Collaboration Strategies Enacted during Human-Chatbot InteractionsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580995(1-17)Online publication date: 19-Apr-2023

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media