Skip to main content
SpringerLink
Log in

Assessing the Reusability of Design Principles in the Realm of Conversational Agents

  • Conference paper
  • First Online:
The Transdisciplinary Reach of Design Science Research (DESRIST 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13229))

Abstract

Conversational Agents (CAs) provide the means to foster user experience design through seizing their interaction capability, knowledgeability, and human-like behavior. To support practice and academia in designing CAs, IS researchers have been creating design knowledge in the form of design principles (DPs) guided by the Design Science paradigm. However, scientific literature in this vein is dispersed and lacks an axis of cohesion and transferability to sustained practice usage. This raises the question of reusability of design principles in the realm of CAs. Therefore, in this study, we conduct a Systematic Literature Review to retrieve and assess design principles of existing design science papers dealing with CAs with regard to their reusability. Our findings indicate that the Design Science community, in our case in the domain of CAs, seems to face challenges in creating reusable design principles. We discuss this observation and provide avenues on how to move forward.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Change history

  • 25 May 2022

    In an older version of chapter 10, there was an orthographical error in name of an author. “Dominic Siemon” was corrected to “Dominik Siemon”.

    In an older version of chapter 20, there was an error in the affiliation of a co-author. This has been corrected to “IG&H”.

References

  1. McTear, M., Callejas, Z., Griol, D.: Conversational interfaces: devices, wearables, virtual agents, and robots. In: The Conversational Interface, pp. 283–308. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-32967-3_13

    Chapter  Google Scholar 

  2. Pfeuffer, N., Benlian, A., Gimpel, H., Hinz, O.: Anthropomorphic information systems. Bus. Inf. Syst. Eng. 61, 523–533 (2019)

    Article  Google Scholar 

  3. McLean, G., Osei-Frimpong, K.: Hey alexa… examine the variables influencing the use of artificial intelligent in-home voice assistants. Comput. Hum. Behav. 99, 28–37 (2019)

    Article  Google Scholar 

  4. Feine, J., Gnewuch, U., Morana, S., Maedche, A.: A taxonomy of social cues for conversational agents. Int. J. Hum. Comput. Stud. 132, 138–161 (2019)

    Article  Google Scholar 

  5. Gregor, S., Hevner, A.R.: Positioning and presenting design science research for maximum impact. MIS Quarterly 37(2), 337–355 (2013). https://doi.org/10.25300/MISQ/2013/37.2.01

    Article  Google Scholar 

  6. Diederich, S., Brendel, A.B., Morana, S., Kolbe, L.: On the design of and interaction with conversational agents: an organizing and assessing review of human-computer interaction research. J. Assoc. Inf. Syst. 23(1), 96–138 (2022). https://doi.org/10.17705/1jais.00724

    Article  Google Scholar 

  7. Elshan, E., Zierau, N., Engel, C., Janson, A., Leimeister, J.M.: Understanding the design elements affecting user acceptance of intelligent agents: past, present and future. Inf. Syst. Front. (2022). https://doi.org/10.1007/s10796-021-10230-9

    Article  Google Scholar 

  8. Brandtzaeg, P.B., Følstad, A.: Why people use chatbots. In: International Conference on Internet Science, pp. 377–392. Springer (2017)

    Google Scholar 

  9. Jain, M., Kumar, P., Kota, R., Patel, S.N.: Evaluating and informing the design of chatbots. In: Proceedings of the 2018 Designing Interactive Systems Conference, pp. 895–906 (2018)

    Google Scholar 

  10. Iivari, J., Hansen, M.R.P., Haj-Bolouri, A.: A Framework for light reusability evaluation of design principles in design science research. In: 13th International Conference on Design Science Research and Information Systems and Technology: Designing for a Digital and Globalized World (2018)

    Google Scholar 

  11. Iivari, J., Hansen, M.R.P., Haj-Bolouri, A.: A proposal for minimum reusability evaluation of design principles. Eur. J. Inf. Syst. 0, 1–18. https://doi.org/10.1080/0960085X.2020.1793697

  12. Cronholm, S., Göbel, H.: Guidelines supporting the formulation of design principles. In: Australasian Conference on Information Systems 2018. University of Technology, Sydney (2018). https://doi.org/10.5130/acis2018.ak

    Chapter  Google Scholar 

  13. Maedche, A., et al.: Advanced user assistance systems. Bus. Inf. Syst. Eng. 58, 367–370 (2016). https://doi.org/10.1007/s12599-016-0444-2

    Article  Google Scholar 

  14. Knote, R., Janson, A., Söllner, M., Leimeister, J.M.: Value co-creation in smart services: a functional affordances perspective on smart personal assistants. SSRN Electron. J. (2020). https://doi.org/10.2139/ssrn.3923706

    Article  Google Scholar 

  15. Jalaliniya, S., Pederson, T.: Designing wearable personal assistants for surgeons: An egocentric approach. IEEE Pervasive Comput. 14, 22–31 (2015)

    Article  Google Scholar 

  16. Nordheim, C.B., Følstad, A., Bjørkli, C.A.: An initial model of trust in chatbots for customer service—findings from a questionnaire study. Interact. Comput. 31, 317–335 (2019)

    Article  Google Scholar 

  17. Zierau, N., Elshan, E., Visini, C., Janson, A.: A review of the empirical literature on conversational agents and future research directions (2020)

    Google Scholar 

  18. Janssen, A., Passlcik, D., Rodrıguez Cardona, D.: Virtual assistance in any context – a taxonomy of design elements for. business and information systems engineering 62 (2020)

    Google Scholar 

  19. Chakrabarti, C., Luger, G.F.: Artificial conversations for customer service chatter bots: architecture, algorithms, and evaluation metrics. Expert Syst. Appl. 42, 6878–6897 (2015)

    Article  Google Scholar 

  20. Hevner, A., Prat, N., Comyn-Wattiau, I., Akoka, J.: A pragmatic approach for identifying and managing design science research goals and evaluation criteria (2018)

    Google Scholar 

  21. Baskerville, R., et al.: Design science research contributions: finding a balance between artifact and theory. J. Assoc. Inf. Syst. 19, 3 (2018)

    Google Scholar 

  22. Gregor, S., Kruse, L., Seidel, S.: Research perspectives: the anatomy of a design principle. J. Assoc. Inf. Syst. 21, 1622–1652 (2020). https://doi.org/10.17705/1jais.00649

    Article  Google Scholar 

  23. Purao, S., Kruse, L.C., Maedche, A.: The origins of design principles: where do… they all come from? In: Hofmann, S., Müller, O., Rossi, M. (eds.) Designing for Digital Transformation. Co-Creating Services with Citizens and Industry: 15th International Conference on Design Science Research in Information Systems and Technology, DESRIST 2020, Kristiansand, Norway, December 2–4, 2020, Proceedings, pp. 183–194. Springer International Publishing, Cham (2020). https://doi.org/10.1007/978-3-030-64823-7_17

    Chapter  Google Scholar 

  24. Engel, C., Leicht, N., Ebel, P.: The imprint of design science in information systems research: an empirical analysis of the AIS senior scholars’ basket (2019)

    Google Scholar 

  25. Sturm, B., Sunyaev, A.: A Good Beginning makes a good ending: incipient sources of knowledge in design science research (2019)

    Google Scholar 

  26. Jones, D., Gregor, S.: The anatomy of a design theory. J. Assoc. Inf. Syst. 8(5), 312–335 (2007). https://doi.org/10.17705/1jais.00129

    Article  Google Scholar 

  27. Sein, M.K., et al.: Action design research. MIS Quarterly, 37–56 (2011)

    Google Scholar 

  28. Knote, R., et al.: From requirement to design patterns for ubiquitous computing applications. In: Proceedings of the 21st European Conference on Pattern Languages of Programs, pp. 1–11 (2016)

    Google Scholar 

  29. Kruse, L.C., Seidel, S., Purao, S.: Making use of design principles. In: International Conference on Design Science Research in Information System and Technology, pp. 37–51. Springer (2016)

    Google Scholar 

  30. Chandra Kruse, L., Purao, S., Seidel. S.: How designers use design principles: design behaviors and application modes. J. Assoc. Inf. Syst. (Forthcoming.)

    Google Scholar 

  31. Wieringa, R.: Design science as nested problem solving, pp. 1–12 (2009)

    Google Scholar 

  32. Baskerville, R., Pries-Heje, J.: Explanatory design theory. Bus. Inf. Syst. Eng. 2, 271–282 (2010). https://doi.org/10.1007/s12599-010-0118-4

    Article  Google Scholar 

  33. Fischer, C., Winter, R., Wortmann, F.: Design theory. Bus. Inf. Syst. Eng. 2, 387–390 (2010)

    Article  Google Scholar 

  34. Lukyanenko, R., Parsons, J.: Research perspectives: design theory indeterminacy: what is it, how can it be reduced, and why did the polar bear drown? J. Assoc. Inf. Syst. 21(5), 1343–1369 (2020). https://doi.org/10.17705/1jais.00639

    Article  Google Scholar 

  35. Webster, J., Watson, R.T.: Analyzing the past to prepare for the future: writing a literature review. MIS Quarterly, xiii–xxiii (2002)

    Google Scholar 

  36. Vom Brocke, J., et al.: Standing on the shoulders of giants: challenges and recommendations of literature search in information systems research. CAIS 37, 9 (2015)

    Google Scholar 

  37. Levy, Y., Ellis, T.J.: A systems approach to conduct an effective literature review in support of information systems research. Informing Science: The International Journal of an Emerging Transdiscipline 9, 181–212 (2006). https://doi.org/10.28945/479

    Article  Google Scholar 

  38. Rosemann, M., Vessey, I.: Toward improving the relevance of information systems research to practice: the role of applicability checks. Mis Quarterly, 1–22 (2008)

    Google Scholar 

  39. Lechler, R., Stöckli, E., Rietsche, R., Uebernickel, F.: Looking beneath the tip of the iceberg: the two-sided nature of chatbots and their roles for digital feedback exchange (2019)

    Google Scholar 

  40. Wambsganss, T., et al.: Designing a conversational agent as a formative course evaluation tool. In: WI2020 Zentrale Tracks, pp. 1234–1249. GITO Verlag (2020). https://doi.org/10.30844/wi_2020_k7-wambsganss

    Chapter  Google Scholar 

  41. Winkler, R., Roos, J.: Bringing AI into the classroom: designing smart personal assistants as learning tutors (2019)

    Google Scholar 

  42. Gnewuch, U., Morana, S., Heckmann, C., Maedche, A.: Designing conversational agents for energy feedback. In: Chatterjee, S., Dutta, K., Sundarraj, R.P. (eds.) Designing for a Digital and Globalized World, pp. 18–33. Springer International Publishing, Cham (2018). https://doi.org/10.1007/978-3-319-91800-6_2

    Chapter  Google Scholar 

  43. Chen, Z., Lu, Y., Nieminen, M.P., Lucero, A.: Creating a Chatbot for and with migrants: chatbot personality drives co-design activities. In: Proceedings of the 2020 ACM Designing Interactive Systems Conference, pp. 219–230 (2020)

    Google Scholar 

  44. Ahmad, R., Siemon, D., Fernau, D., Robra-Bissantz, S.: Introducing “Raffi”: a personality adaptive conversational agent. In: PACIS, pp. 28 (2020)

    Google Scholar 

  45. Elshan, E., Ebel, P.: Let’s team up: designing conversational agents as teammates (2020)

    Google Scholar 

  46. Strohmann, T., et al.: Virtual moderation assistance: creating design guidelines for virtual assistants supporting creative workshops. In: PACIS, pp. 80 (2018)

    Google Scholar 

  47. Meier, P., et al.: FeelFit-design and evaluation of a conversational agent to enhance health awareness. In: ICIS (2019)

    Google Scholar 

  48. Gnewuch, U., Morana, S., Maedche, A.: Towards designing cooperative and social conversational agents for customer service (2017)

    Google Scholar 

  49. Hevner, A.R.: A three cycle view of design science research. Scand. J. Inf. Syst. 19, 4 (2007)

    Google Scholar 

  50. Tavanapour, N., Poser, M., Bittner, E.A.C.: Supporting the idea generation process in citizen participation – toward an interactive system with a conversational agent as facilitator. 18 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of St. Gallen, 9000, St. Gallen, Switzerland

    Edona Elshan, Christian Engel & Philipp Ebel

  2. LUT University, 53850, Lappeenranta, Finland

    Dominik Siemon

Authors
  1. Edona Elshan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christian Engel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Philipp Ebel
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dominik Siemon
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Edona Elshan .

Editor information

Editors and Affiliations

  1. Victoria University of Wellington, Wellington, New Zealand

    Andreas Drechsler

  2. University of Pretoria, Pretoria, South Africa

    Aurona Gerber

  3. University of South Florida, Tampa, FL, USA

    Alan Hevner

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Elshan, E., Engel, C., Ebel, P., Siemon, D. (2022). Assessing the Reusability of Design Principles in the Realm of Conversational Agents. In: Drechsler, A., Gerber, A., Hevner, A. (eds) The Transdisciplinary Reach of Design Science Research. DESRIST 2022. Lecture Notes in Computer Science, vol 13229. Springer, Cham. https://doi.org/10.1007/978-3-031-06516-3_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06516-3_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06515-6

  • Online ISBN: 978-3-031-06516-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation