Skip to main content
SpringerLink
Log in

Voice Your Opinion! Young Voters’ Usage and Perceptions of a Text-Based, Voice-Based and Text-Voice Combined Conversational Agent Voting Advice Application (CAVAA)

  • Conference paper
  • First Online:
Chatbot Research and Design (CONVERSATIONS 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13815))

Included in the following conference series:

  • 1063 Accesses

Abstract

Conversational Agent Voting Advice Applications (CAVAAs) are chatbot-based information retrieval systems for citizens who aim to inform themselves about the political issues at stake in times of political elections. Previous studies investigating these relatively young tools primarily focused on the effects of CAVAAs that include a text-based chatbot. In order to further optimize their design, current research compared the effects of CAVAAs with a text, voice, and combined chatbot. In an experimental lab study among young voters (N = 60) these three modalities have been compared on usage measures (the amount of information retrieved from the chatbot, and miscommunication), evaluation measures (ease of use, usefulness, and enjoyment), and political measures (perceived and factual political knowledge). Results show that the three CAVAA modalities score equally high on political measures and the perception of enjoyment. At the same time, the textual and combined CAVAA outperform the voice CAVAA on several aspects: the voice CAVAA received lower ease of use and usefulness scores, respondents requested less additional information, and they experienced more miscommunication when interacting with the voice chatbot. Analyses of the usage data also indicate that in the combined condition users hardly use the voice-option and instead almost exclusively rely on text-functionalities like clicking on suggestion buttons. This seems to suggest that using voice is too much of an effort for CAVAA users; we therefore recommend the usage of text-bots in this specific usage context.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Data collection was initiated prior to final approval, following liaising with the ethics board.

References

  1. Ahn, T., Ryu, S., Ahn, T., Ryu, S., Han, I.: The impact of Web quality and playfulness on user acceptance of online retailing. Inf. Manage. 44(3), 263–275 (2007). https://doi.org/10.1016/j.im.2006.12.008

    Article  Google Scholar 

  2. Angga, P.A., Fachri, W.E., Elevanita, A., Agushinta, R.D.: Design of chatbot with 3D avatar, voice interface, and facial expression. In: 2015 International Conference on Science in Information Technology (ICSITech), pp. 326–330. IEEE, October 2015

    Google Scholar 

  3. Ashktorab, Z., Jain, M., Liao, Q.V., Weisz, J.D.: Resilient chatbots: Repair strategy preferences for conversational breakdowns. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–12, May 2019

    Google Scholar 

  4. Bohus, D., Rudnicky, A.: Sorry and i didn’t catch that! An investigation of non- understanding errors and recovery strategies. In: Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue, pp. 128–143, September 2005

    Google Scholar 

  5. Cho, E., Molina, M.D., Wang, J.: The effects of modality, device, and task differences on perceived human likeness of voice-activated virtual assistants. Cyberpsychol. Behav. Soc. Netw. 22(8), 515–520 (2019)

    Article  Google Scholar 

  6. De Graaf, J.: The irresistible rise of Stemwijzer. In: Cedroni, L., Garzia, D. (eds.) Voting Advice Applications in Europe: The State of the Art, pp. 35–46. Scriptaweb, Napoli (2010)

    Google Scholar 

  7. Direct Research: De Nationale Voice Monitor 2021 (2021). https://www.directresearch.nl/blogs/de-nationale-voice-monitor-2021/. Accessed 8 Feb 2022

  8. Følstad, A., et al.: Future directions for chatbot research: an interdisciplinary research agenda. Computing 103(12), 2915–2942 (2021). https://doi.org/10.1007/s00607-021-01016-7

    Article  Google Scholar 

  9. Fryer, L.K., Ainley, M., Thompson, A., Gibson, A., Sherlock, Z.: Stimulating and sustaining interest in a language course: an experimental comparison of Chatbot and Human task partners. Comput. Hum. Behav. 75, 461–468 (2017)

    Article  Google Scholar 

  10. Garzia, D., Marschall, S.: Voting advice applications under review: the state of research. Int. J. Electron. Govern. 5(3–4), 203–222 (2012)

    Article  Google Scholar 

  11. Gemenis, K., Rosema, M.: Voting advice applications and electoral turnout. Elect. Stud. 36, 281–289 (2014)

    Article  Google Scholar 

  12. Goodhue, D.L., Thompson, R.L.: Task-technology fit and individual performance. MIS Q. 19(2), 213 (1995). https://doi.org/10.2307/249689

    Article  Google Scholar 

  13. Kamoen, N., Holleman, B.: I don’t get it. Response difficulties in answering political attitude statements in Voting Advice Applications. Surv. Res. Methods. 11(2), 125–140 (2017). https://doi.org/10.18148/srm/2017.v11i2.6728

  14. Kamoen, N., Liebrecht, C.: I need a CAVAA: how conversational agent voting advice applications (CAVAAs) affect users’ political knowledge and tool experience. Front. Artif. Intell. 5, 835505 (2022). https://doi.org/10.3389/frai.2022.835505

  15. Kamoen, N., McCartan, T., Liebrecht, C.: Conversational agent voting advice applications: a comparison between a structured, semi-structured, and non-structured chatbot design for communicating with voters about political issues. In: Følstad, A., et al. (eds.) Chatbot Research and Design: 5th International Workshop, CONVERSATIONS 2021, Virtual Event, November 23–24, 2021, Revised Selected Papers, pp. 160–175. Springer International Publishing, Cham (2022). https://doi.org/10.1007/978-3-030-94890-0_10

    Chapter  Google Scholar 

  16. Kanda, T., Hirano, T., Eaton, D., Ishiguro, H.: Interactive robots as social partners and peer tutors for children: a field trial. Human-Comput. Interact. 19(1–2), 61–84 (2004)

    Article  Google Scholar 

  17. Kim, Y., Lee, H.: The rise of chatbots in political campaigns: the effects of conversational agents on voting intention Int. J. Human–Comput. Interact. 1–12 (2022).https://doi.org/10.1080/10447318.2022.2108669

  18. Kocielnik, R., Avrahami, D., Marlow, J., Lu, D., Hsieh, G.: Designing for workplace reflection: a chat and voice-based conversational agent. In: Proceedings of the 2018 Designing Interactive Systems Conference, pp. 881–894, June 2018

    Google Scholar 

  19. Krouwel, A., Vitiello, T., Wall, M.: The practicalities of issuing vote advice: a new methodology for profiling and matching. Int. J. Electron. Govern. 5(3–4), 223–243 (2012)

    Article  Google Scholar 

  20. Le Bigot, L., Jamet, E., Rouet, J.-F., Amiel, V.: Mode and modal transfer effects on performance and discourse organization with an information retrieval dialogue system in natural language. Comput. Hum. Behav. 22, 467–500 (2006)

    Article  Google Scholar 

  21. Lee, M.K., Cheung, C.M., Chen, Z.: Acceptance of Internet-based learning medium: the role of extrinsic and intrinsic motivation. Inf. Manage. 42(8), 1095–1104 (2005)

    Article  Google Scholar 

  22. Liebrecht, C., Kamoen, N.: ‘Hey Siri, wat is de hondenbelasting?’: Voicebots en tekstbots in een politieke context. Tekstblad 27(1), 22–24 (2022)

    Google Scholar 

  23. McLean, G., Osei-Frimpong, K.: Hey Alexa… examine the variables influencing the use of artificial intelligent in-home voice assistants. Comput. Hum. Behav. 99, 28–37 (2019)

    Article  Google Scholar 

  24. Nass, C.I., Brave, S.: Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship. MIT Press, Cambridge (2005)

    Google Scholar 

  25. Pal, D., Arpnikanondt, C., Funilkul, S., Chutimaskul, W.: The adoption analysis of voice-based smart Iot products. IEEE Internet Things J. 7(11), 10852–10867 (2020)

    Article  Google Scholar 

  26. Riefle, L., Brand, A., Mietz, J., Rombach, L., Szekat, C., Benz, C.: What fits Tim might not fit Tom: Exploring the impact of user characteristics on users’ experience with conversational interaction modalities. In: Wirtschaftsinformatik 2022 Proceedings, vol. 13 (2022)

    Google Scholar 

  27. Rzepka, C., Berger, B., Hess, T.: Voice assistant vs. chatbot: examining the fit between conversational agents’ interaction modalities and information search tasks. Inf. Syst. Front. 24(3), 839–856 (2022)

    Google Scholar 

  28. Schroeder, J., Schroeder, M.: Trusting in machines: how mode of interaction affects willingness to share personal information with machines. In: Proceedings of the 51st Hawaii International Conference on System Sciences, Hawaii, USA (2018)

    Google Scholar 

  29. Shulman, H.C., Sweitzer, M.D.: Advancing framing theory: designing an equivalency frame to improve political information processing. Hum. Commun. Res. 44(2), 155–175 (2018). https://doi.org/10.1093/hcr/hqx006

    Article  Google Scholar 

  30. Sundar, S.S.: The MAIN model: a heuristic approach to understanding technology effects on credibility. In: Metzger, M.J., Flanagin, A.J. (Eds.). Digital Media, Youth, and Credibility. The John D. and Catherine T. MacArthur Foundation Series on Digital Media and Learning, pp. 73–100. The MIT Press, Cambridge (2008). https://doi.org/10.1162/dmal.9780262562324.073

  31. Van Camp, K., Lefevere, J., Walgrave, S.: The content and formulation of statements in voting advice applications. In: Garzia, D., Marschall, S., (eds.) Matching Voters with Parties and Candidates. Voting Advice Applications in Comparative Perspective, pp. 11–32. ECPR Press, Colchester (2014)

    Google Scholar 

  32. Xu, J.D., Benbasat, I., Cenfetelli, R.T.: The nature and consequences of trade-off transparency in the context of recommendation agents. MIS Q. 38, 379–406 (2014)

    Article  Google Scholar 

  33. Yang, H., Lee, H.: Understanding user behavior of virtual personal assistant devices. IseB 17(1), 65–87 (2018). https://doi.org/10.1007/s10257-018-0375-1

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Tilburg University’s Fund (project number ESF2021–2) for the financial support to develop the CAVAAs. A summary of the results of this study has also been published in the Dutch popular-scientific magazine Tekstblad [22].

Author information

Authors and Affiliations

  1. Tilburg School of Humanities and Digital Sciences, Department of Communication and Cognition, Tilburg University, Tilburg, The Netherlands

    Christine Liebrecht, Naomi Kamoen & Celine Aerts

Authors
  1. Christine Liebrecht
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Naomi Kamoen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Celine Aerts
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Christine Liebrecht .

Editor information

Editors and Affiliations

  1. SINTEF, Oslo, Norway

    Asbjørn Følstad

  2. University of Amsterdam, Amsterdam, The Netherlands

    Theo Araujo

  3. CERTH-ITI, Thessaloniki, Greece

    Symeon Papadopoulos

  4. Durham University, Durham, UK

    Effie L.-C. Law

  5. University of Edinburgh, Edinburgh, UK

    Ewa Luger

  6. University of Agder, Grimstad, Norway

    Morten Goodwin

  7. University of Oslo, Oslo, Norway

    Petter Bae Brandtzaeg

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liebrecht, C., Kamoen, N., Aerts, C. (2023). Voice Your Opinion! Young Voters’ Usage and Perceptions of a Text-Based, Voice-Based and Text-Voice Combined Conversational Agent Voting Advice Application (CAVAA). In: Følstad, A., et al. Chatbot Research and Design. CONVERSATIONS 2022. Lecture Notes in Computer Science, vol 13815. Springer, Cham. https://doi.org/10.1007/978-3-031-25581-6_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-25581-6_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-25580-9

  • Online ISBN: 978-3-031-25581-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation