Abstract
People indispensably use instructions shared by one another to work on unfamiliar tasks in daily or professional life. However, personally shared tutorials are often based on personal experiences and represent a collective overview of past encounters, which can be misaligned with the specific work context during the re-enacting time. Drawing inspiration from the effective dynamics observed in conversational instruction-giving and -following between experts and novices, we propose a chatbot system that delivers archived how-to tutorials by providing necessary information in a just-in-time manner, tailored to the needs of the instruction-follower. Our aim is to transform unaided instruction reading activities into conversational instruction-following experiences. We implemented a chatbot system and evaluated it through a between subject study. The results demonstrate a promise of leveraging human-chatbot interaction to support actionable instruction-following.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
11 males, 14 females, and 1 unknown.
- 7.
Researchers addressed logistic questions while avoiding affecting users’ behaviors.
- 8.
Cronbach’s alpha reported earlier indicates the reliability to derive an average score.
- 9.
Some factors that can cause failure include skipping steps, missing information, execution errors, and other related issues.
- 10.
LMER(actionability_score \(\sim \) assistance_level \(+\) computer_skill_level \(+\) (1 \(\Vert \) uuid)).
- 11.
LMER(situational_awareness \(\sim \) conversational_instruction_following_assistance_level + computer_skill_level + \(1 \Vert uuid\) ), we exclude interaction variable between instruction following condition and computer skill level due to loss of freedom.
References
Bransford, J.D., Brown, A.L., Cocking, R.R.: How people learn: brain, mind, experience, and school. National Academy Press (1999)
Carletta, J., Isard, A., Isard, S., Kowtko, J.C., Doherty-Sneddon, G., Anderson, A.H.: The reliability of a dialogue structure coding scheme (1997)
Chang, M., Lafreniere, B., Kim, J., Fitzmaurice, G., Grossman, T.: Workflow graphs: a computational model of collective task strategies for 3D design software. In: Graphics Interface 2020 (2020)
Clark, H.H., Wilkes-Gibbs, D.: Referring as a collaborative process. Cognition 22(1), 1–39 (1986)
Hinds, P.J., Patterson, M., Pfeffer, J.: Bothered by abstraction: the effect of expertise on knowledge transfer and subsequent novice performance. J. Appl. Psychol. 86(6), 1232 (2001)
Kelleher, C., Pausch, R.: Stencils-based tutorials: design and evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 541–550 (2005)
Köbis, N., Bonnefon, J.F., Rahwan, I.: Bad machines corrupt good morals. Nat. Hum. Behav. 5(6), 679–685 (2021)
Kraut, R.E., Fussell, S.R., Siegel, J.: Situational awareness and conversational grounding in collaborative bicycle repair (2001)
Kraut, R.E., Fussell, S.R., Siegel, J.: Visual information as a conversational resource in collaborative physical tasks. Hum.-Comput. Interact. 18(1–2), 13–49 (2003)
Rae, L.: Knowledge sharing and the virtual organization: meeting 21st century challenges. Thunderbird Int. Business Rev. 40(5), 525–540 (1998)
Salas, E., Prince, C., Baker, D.P., Shrestha, L.: Situation awareness in team performance: implications for measurement and training. Situational Awareness, pp. 63–76 (2017)
Scheel, N.P., Branch, R.C.: The role of conversation and culture in the systematic design of instruction. Educational Technology, pp. 7–18 (1993)
Shoemaker, S.J., Wolf, M.S., Brach, C.: Development of the patient education materials assessment tool (pemat): a new measure of understandability and actionability for print and audiovisual patient information. Patient Educ. Couns. 96(3), 395–403 (2014)
Speggiorin, A., Dalton, J., Leuski, A.: TaskMAD: a platform for multimodal task-centric knowledge-grounded conversational experimentation. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 3240–3244 (2022)
Suchman, L., Blomberg, J., Orr, J.E., Trigg, R.: Reconstructing technologies as social practice. In: The Anthropology of Organisations, pp. 431–447. Routledge (2017)
Wikiversity: computer skills/proficient/databases – wikiversity (2019). https://en.wikiversity.org/w/index.php?title=Computer_Skills/Proficient/Databases &oldid=1987634. Accessed 20 Mar 2019
Zack, M.H.: Managing codified knowledge. Sloan Manag. Rev. 40(4), 45–58 (1999)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zhu, Q., Lee, YC., Wang, HC. (2023). Support How-To Instruction Following via Conversational Agent. In: Takada, H., Marutschke, D.M., Alvarez, C., Inoue, T., Hayashi, Y., Hernandez-Leo, D. (eds) Collaboration Technologies and Social Computing. CollabTech 2023. Lecture Notes in Computer Science, vol 14199. Springer, Cham. https://doi.org/10.1007/978-3-031-42141-9_19
Download citation
DOI: https://doi.org/10.1007/978-3-031-42141-9_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42140-2
Online ISBN: 978-3-031-42141-9
eBook Packages: Computer ScienceComputer Science (R0)