Abstract
In this paper, we summarize the initial results of a field test with the ChiM (Chatbot in the Museum) system, a conversational user interface for the museum. The system contains a Natural Language Understanding (NLU) component that translates the user input into intentions and produces a multimodal (mainly spoken and textual) output. Museum visitors can use the system to freely ask questions about the exhibits in the exhibition. We conducted a field test with 140 participants in the Städel Museum, Frankfurt, and recorded over 4600 interactions between the participants and the system. After the test, participants gave their perceived feedback on the user experience (UX) and completed a custom system-specific questionnaire. We exploratively analyzed the feedback. The results show an overall medium UX for the system. We assume that the NLU component must be improved. Participants who rarely or never use audio guides rate the pragmatic quality (PQ) of the system significantly better than people who often or always use audio guides. People who rated the speech quality of the system as good also rated the attractiveness of the system significantly better than people who rated the speech quality as bad. In our future work, we will deepen the UX analysis and further put focus on recorded interaction data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Varitimiadis, S., Kotis, K., Pittou, D., Konstantakis, G.: Graph-based conversational AI: towards a distributed and collaborative multi-chatbot approach for museums. Appl. Sci. 11(19), 9160 (2021)
Ping! Die Museumsapp. https://www.landesmuseum.de/digital/apps-und-podcasts/ping. Accessed 25 Oct 2022
Barth, F., Candello, H., Cavalin, P., Pinhanez, C.: Intentions, meanings, and whys: designing content for voice-based conversational museum guides. In: Proceedings of the 2nd Conference on Conversational User Interfaces, pp. 1–8 (2020)
Gaia, G., Boiano, S., Borda, A.: Engaging museum visitors with AI: the case of chatbots. In: Giannini, T., Bowen, J.P. (eds.) Museums and digital culture. SSCC, pp. 309–329. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-97457-6_15
Koroteev, M.V.: BERT: a review of applications in natural language processing and understanding. arXiv preprint arXiv:2103.11943 (2021)
Zaman, M.M.U., Schaffer, S., Scheffler, T.: Factoid and open-ended question answering with BERT in the museum domain. In: Proceedings of the Conference on Digital Curation Technologies. Conference on Digital Curation Technologies (QURATOR-2021). CEUR Workshop Proceedings (2021)
Zaman, M.M.U., Schaffer, S., Scheffler, T.: Comparing BERT with an intent based question answering setup for open-ended questions in the museum domain. In: 32. Konferenz Elektronische Sprachsignalverarbeitung. Elektronische Sprachsignalverarbeitung. Elektronische Sprachsignalverarbeitung (ESSV-2021). TUDpress, Dresden (2021)
Schaffer, S., Ruß, A., Sasse, M.L., Schubotz, L., Gustke, O.: Questions and answers: important steps to let AI chatbots answer questions in the museum. In: Wölfel, M., Bernhardt, J., Thiel, S. (eds.) ArtsIT 2021. LNICST, vol. 422, pp. 346–358. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-95531-1_24
Ruß, A.: MMIR framework: multimodal mobile interaction and rendering. In: GI-Jahrestagung, pp. 2702–2713 (2013)
Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: ein fragebogen zur messung wahrgenommener hedonischer und pragmatischer qualität. In: In: Szwillus, G., Ziegler, J. (eds.) Mensch & Computer 2003. Berichte des German Chapter of the ACM, vol. 57, pp. 187–196. Vieweg+ Teubner Verlag, Berlin (2003). https://doi.org/10.1007/978-3-322-80058-9_19
Acknowledgment
This research is funded by the German Federal Ministry of Economics and Climate Protection (BMWK) project ToHyVe.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Schaffer, S., Ruß, A., Gustke, O. (2023). User Experience of a Conversational User Interface in a Museum. In: Brooks, A.L. (eds) ArtsIT, Interactivity and Game Creation. ArtsIT 2022. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 479. Springer, Cham. https://doi.org/10.1007/978-3-031-28993-4_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-28993-4_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-28992-7
Online ISBN: 978-3-031-28993-4
eBook Packages: Computer ScienceComputer Science (R0)