Abstract
A natural way for humans to build an opinion on a topic is through the gathering and exchange of new arguments. Speech interfaces for argumentative dialogue systems (ADS) are rather scarce and quite complex. To provide a more natural and intuitive interface, we include an adaption of a recently introduced natural language understanding (NLU) framework tailored to argumentative tasks into a complete end-to-end ADS. Within this paper we investigate the influence of two different input/output modalities (speech/speech and drop-down menu/text) and discuss issues and problems we encountered in a user study with 202 participants using our ADS.
This work has been funded by the DFG within the project “BEA - Building Engaging Argumentation”, Grant no. 313723125, as part of the Priority Program “Robust Argumentation Machines (RATIO)” (SPP-1999).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
https://idebate.org/debatabase (last accessed 23th February 2022).
Material reproduced from www.iedebate.org with the permission of the International Debating Education Association. Copyright © 2005 International Debate Education Association. All Rights Reserved.
- 2.
https://pypi.org/project/SpeechRecognition/, last accessed 19.09.2022.
- 3.
Such questionnaires can be used to evaluate the quality of speech-based services.
References
Abro, W.A., Aicher, A., Rach, N., Ultes, S., Minker, W., Qi, G.: Natural language understanding for argumentative dialogue systems in the opinion building domain. Knowl.-Based Syst. 242, 108318 (2022), ISSN 0950–7051. https://www.sciencedirect.com/science/article/pii/S0950705122001149
Aicher, A., Rach, N., Minker, W., Ultes, S.: Opinion building based on the argumentative dialogue system BEA. In: Marchi, E., Siniscalchi, S.M., Cumani, S., Salerno, V.M., Li, H. (eds.) Increasing Naturalness and Flexibility in Spoken Dialogue Interaction. LNEE, vol. 714, pp. 307–318. Springer, Singapore (2021). https://doi.org/10.1007/978-981-15-9323-9_27
Amgoud, L., Ben-Naim, J.: Evaluation of arguments from support relations: axioms and semantics. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence, IJCAI-16, pp. 900–906 (2016). https://www.ijcai.org/Proceedings/16/Papers/132.pdf
Amgoud, L., Ben-Naim, J.: Weighted bipolar argumentation graphs: axioms and semantics. In: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI-18, pp. 5194–5198 (2018)
Bechhofer, S.: Owl: Web ontology language. In: Encyclopedia of Database Systems, pp. 2008–2009, Springer, Boston (2009). https://doi.org/10.1007/978-0-387-39940-9_1073
Chalaguine, L., Hunter, A.: Addressing popular concerns regarding COVID-19 vaccination with natural language argumentation dialogues. In: Vejnarová, J., Wilson, N. (eds.) ECSQARU 2021. LNCS (LNAI), vol. 12897, pp. 59–73. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-86772-0_5
Chalaguine, L.A., Hunter, A.: A persuasive chatbot using a crowd-sourced argument graph and concerns. In: COMMA (2020)
Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics, Minneapolis (2019)
Fazzinga, B., Galassi, A., Torroni, P.: An argumentative dialogue system for COVID-19 vaccine information. In: Baroni, P., Benzmüller, C., Wáng, Y.N. (eds.) CLAR 2021. LNCS (LNAI), vol. 13040, pp. 477–485. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-89391-0_27
Hadoux, E., Hunter, A., Polberg, S.: Strategic argumentation dialogues for persuasion: framework and experiments based on modelling the beliefs and concerns of the persuadee. Argum. Comput. 14, 1–53 (2022). https://doi.org/10.3233/AAC-210005
Le, D.T., Nguyen, C.T., Nguyen, K.A.: Dave the debater: a retrieval-based and generative argumentative dialogue agent. In: Proceedings of the 5th Workshop on Argument Mining, pp. 121–130 (2018). https://www.aclweb.org/anthology/W18-5215
McKnight, P.E., Najab, J.: Mann-Whitney U Test, pp. 1–1. American Cancer Society (2010). ISBN 9780470479216
P.851, I.T.R.: Subjective quality evaluation of telephone services based on spoken dialogue systems (11/2003). International Telecommunication Union (Nov 2003)
Rach, N., Langhammer, S., Minker, W., Ultes, S.: Utilizing argument mining techniques for argumentative dialogue systems. In: Proceedings of the 9th International Workshop On Spoken Dialogue Systems (IWSDS) (May 2018)
Rakshit, G., Bowden, K.K., Reed, L., Misra, A., Walker, M.A.: Debbie, the debate bot of the future. In: Advanced Social Interaction with Agents - 8th International Workshop on Spoken Dialog Systems, pp. 45–52 (2017)
Rosenfeld, A., Kraus, S.: Strategical argumentative agent for human persuasion. In: ECAI’16, pp. 320–328 (2016)
Saha, T., Saha, S., Bhattacharyya, P.: Towards sentiment-aware multi-modal dialogue policy learning. Cogn. Comput, pp. 1–15 (11 2020)
Slonim, N., et al.: An autonomous debating system. Nature 591(7850), 379–384 (2021)
Stab, C., Gurevych, I.: Annotating argument components and relations in persuasive essays. In: COLING, pp. 1501–1510 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Aicher, A., Hillmann, S., Michael, T., Möller, S., Minker, W., Ultes, S. (2023). Evaluating a Spoken Argumentative Dialogue System. In: Coman, A., Vasilache, S. (eds) Social Computing and Social Media. HCII 2023. Lecture Notes in Computer Science, vol 14026. Springer, Cham. https://doi.org/10.1007/978-3-031-35927-9_29
Download citation
DOI: https://doi.org/10.1007/978-3-031-35927-9_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-35926-2
Online ISBN: 978-3-031-35927-9
eBook Packages: Computer ScienceComputer Science (R0)