Abstract
The Information Retrieval community has made strides in developing neural rankers, which have show strong retrieval effectiveness on large-scale gold standard datasets. The focus of existing neural rankers has primarily been on measuring the relevance of a document or passage to the user query. However, other considerations such as the convincingness of the content are not taken into account when retrieving content. We present a large gold standard dataset, referred to as CoRe, which focuses on enabling researchers to explore the integration of the concepts of convincingness and relevance to allow for the retrieval of relevant yet persuasive content. Through extensive experiments on this dataset, we report that there is a close association between convincingness and relevance that can have practical value in how convincing content are presented and retrieved in practice.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Change my view (cmv) (2018). https://www.reddit.com/r/changemyview/wiki/deltasystem/
Chakrabarty, T., Hidey, C., Muresan, S., McKeown, K., Hwang, A.: AMPERSAND: argument mining for PERSuAsive oNline discussions. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 2933–2943. Association for Computational Linguistics, Hong Kong, China, November 2019. https://doi.org/10.18653/v1/D19-1291, https://aclanthology.org/D19-1291
Cheng, L., Wu, T., Bing, L., Si, L.: Argument pair extraction via attention-guided multi-layer multi-cross encoding. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 6341–6353 (2021)
Dayter, D., Messerli, T.C.: Persuasive language and features of formality on the r/changemyview subreddit. Internet Pragmatics 5(1), 165–195 (2022)
Dumani, L., Schenkel, R.: Quality-aware ranking of arguments. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management, pp. 335–344 (2020)
Dutta, S., Das, D., Chakraborty, T.: Changing views: Persuasion modeling and argument extraction from online discussions. Inf. Process. Manage. 57(2), 102085 (2020)
Gao, J., Xiong, C., Bennett, P., Craswell, N.: Neural approaches to conversational information retrieval. arXiv preprint arXiv:2201.05176 (2022)
Habernal, I., Gurevych, I.: Which argument is more convincing? analyzing and predicting convincingness of web arguments using bidirectional lstm. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1589–1599 (2016)
Johnson, J., Douze, M., Jégou, H.: Billion-scale similarity search with GPUs. IEEE Trans. Big Data 7(3), 535–547 (2019)
Karpukhin, V., et al.: Dense passage retrieval for open-domain question answering. arXiv preprint arXiv:2004.04906 (2020)
Lin, J., Nogueira, R., Yates, A.: Pretrained transformers for text ranking: bert and beyond. Synth. Lect. Hum. Lang. Technol. 14(4), 1–325 (2021)
Lugini, L., Litman, D.: Contextual argument component classification for class discussions. arXiv e-prints pp. arXiv-2102 (2021)
Maio, G.R., Hahn, U., Frost, J.M., Kuppens, T., Rehman, N., Kamble, S.: Social values as arguments: similar is convincing. Front. Psychol. 5, 829 (2014)
Reimers, N., Gurevych, I.: Sentence-bert: sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084 (2019)
Simpson, E., Gurevych, I.: Finding convincing arguments using scalable bayesian preference learning. Trans. Assoc. Comput. Linguist. 6, 357–371 (2018)
Stab, C., Gurevych, I.: Parsing argumentation structures in persuasive essays. Comput. Linguist. 43(3), 619–659 (2017)
Tan, C., Niculae, V., Danescu-Niculescu-Mizil, C., Lee, L.: Winning arguments: interaction dynamics and persuasion strategies in good-faith online discussions. In: Proceedings of the 25th International Conference on World Wide Web, pp. 613–624 (2016)
Trabelsi, A., Zaiane, O.R.: Finding arguing expressions of divergent viewpoints in online debates. In: Proceedings of the 5th Workshop on Language Analysis for Social Media (LASM), pp. 35–43 (2014)
Tran, N., Litman, D.: Multi-task learning in argument mining for persuasive online discussions. In: Proceedings of the 8th Workshop on Argument Mining, pp. 148–153 (2021)
Vecchi, E.M., Falk, N., Jundi, I., Lapesa, G.: Towards argument mining for social good: a survey. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 1338–1352 (2021)
Wachsmuth, H., Stein, B., Ajjour, Y.: “Pagerank” for argument relevance. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pp. 1117–1127 (2017)
Wei, Z., Liu, Y., Li, Y.: Is this post persuasive? ranking argumentative comments in online forum. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 195–200 (2016)
Xiong, L., et al.: Approximate nearest neighbor negative contrastive learning for dense text retrieval. CoRR abs/2007.00808 (2020). https://arxiv.org/abs/2007.00808
Yang, W., Zhang, H., Lin, J.: Simple applications of BERT for ad hoc document retrieval. CoRR abs/1903.10972 (2019). http://arxiv.org/abs/1903.10972
Yu, S., Liu, Z., Xiong, C., Feng, T., Liu, Z.: Few-shot conversational dense retrieval. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 829–838 (2021)
Zeng, J., Li, J., He, Y., Gao, C., Lyu, M., King, I.: What Changed Your Mind: The Roles of Dynamic Topics and Discourse in Argumentation Process, p. 1502–1513. Association for Computing Machinery, New York, NY, USA (2020), https://doi.org/10.1145/3366423.3380223
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Salamat, S., Arabzadeh, N., Bigdeli, A., Seyedsalehi, S., Zihayat, M., Bagheri, E. (2023). Don’t Raise Your Voice, Improve Your Argument: Learning to Retrieve Convincing Arguments. In: Kamps, J., et al. Advances in Information Retrieval. ECIR 2023. Lecture Notes in Computer Science, vol 13981. Springer, Cham. https://doi.org/10.1007/978-3-031-28238-6_50
Download citation
DOI: https://doi.org/10.1007/978-3-031-28238-6_50
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-28237-9
Online ISBN: 978-3-031-28238-6
eBook Packages: Computer ScienceComputer Science (R0)