Skip to main content

Developing a Maturity Assessment Tool to Enable the Management of Artificial Intelligence for Organizations

  • Conference paper
  • First Online:
Advanced Information Systems Engineering Workshops (CAiSE 2023)

Abstract

Maturity Models (MMs) are a popular method to support Information Technology (IT) management. In recent years, several industry-specific Artificial Intelligence (AI) MMs were developed to support AI Management as part of the IT management in organizations. While the development of these AI MMs follows widely standardized procedures and therefore is sufficiently addressed in scientific discourse, a lack of attention toward their practical application can be seen. Therefore, this paper proposes a technical prototype for a generic web-based maturity assessment tool for AI management. Overall, a design science-oriented research procedure with a Systematic Literature Review, the design of Graphical User Interfaces (GUIs), the development of a web-based tool, and evaluations with Cognitive Walkthroughs and Personas are conducted. The results indicate that the development of a web tool is an innovative and promising way of applying AI MMs. This work contributes to the current body of knowledge in Information Systems Engineering research by providing a first technical prototype for a web-based maturity assessment tool for AI Management.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Becker, J., Knackstedt, R., Pöppelbuß, J.: Developing maturity models for IT management. Bus. Inf. Syst. Eng. 1(3), 213–222 (2009)

    Article  Google Scholar 

  2. Zhang, D., et al..: The AI Index 2022 Annual Report (2022)

    Google Scholar 

  3. CMMI Product Team: CMMI® for Development, Version 1.3., Pittsburgh (2010)

    Google Scholar 

  4. Mettler, T.: Maturity assessment models: a design science research approach. Int. J. Soc. Syst. Sci. 3(1/2), 81–98 (2011)

    Google Scholar 

  5. Fukas, P.: The management of artificial intelligence: developing a framework based on the artificial intelligence maturity principle. In: Van Looy, A., Weber, B., and Rosemann, M. (eds.) Doctoral Consortium Papers Presented at the 34th International Conference on Advanced Information Systems Engineering (CAiSE 2022), pp. 19–27. Leuven (2022)

    Google Scholar 

  6. Hevner, A.R., March, S.T., Park, J., Ram, S.: Design science in information systems research. Manag. Inf. Syst. Q. 28, 75–105 (2004)

    Article  Google Scholar 

  7. Fukas, P., Rebstadt, J., Remark, F., Thomas, O.: Developing an Artificial Intelligence Maturity Model for Auditing. In: ECIS 2021 Research Papers, 133. Marrakesch (online) (2021)

    Google Scholar 

  8. Peffers, K., Tuunanen, T., Rothenberger, M.A., Chatterjee, S.: A design science research methodology for information systems research. J. Manag. Inf. Syst. 24(3), 45–77 (2007)

    Article  Google Scholar 

  9. Figma: Figma: Nothing great is made alone. https://www.figma.com/. Accessed 2023/04/20

  10. Moser, C.: User Experience Design. Springer, Berlin (2012)

    Book  Google Scholar 

  11. Wang, X.: Design and evaluation of intelligent menu interface through cognitive walkthrough procedure and automated logging for management information system. In: Shen, W., Yong, J., Yang, Y., Barthès, J.-P., Luo, J. (eds.) CSCWD 2007. LNCS, vol. 5236, pp. 408–418. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-92719-8_37

    Chapter  Google Scholar 

  12. Paternò, F.: Model-Based Design and Evaluation of Interactive Applications. Springer, London (2000)

    Book  MATH  Google Scholar 

  13. Chauhan, R.K., Singh, I.: Latest research and development on software testing techniques and tools. Int. J. Curr. Eng. Technol. 4(4), 2368–2372 (2014)

    Google Scholar 

  14. Friess, E.: Personas in heuristic evaluation: an exploratory study. IEEE Trans. Prof. Commun. 58(2), 176–191 (2015)

    Article  Google Scholar 

  15. Chisnell, D.E., Redish, J.C., Lee, A.: New heuristics for understanding older adults as web users. Tech. Commun. 53(1), 39–59 (2006)

    Google Scholar 

  16. Frehe, V., Stiel, F., Teuteberg, F.: A Maturity model and web application for environmental management benchmarking. In: AMCIS 2014 Proceedings, pp. 1–14. Savannah (2014)

    Google Scholar 

  17. Krivograd, N., Fettke, P.: Development of a generic tool for the application of maturity models - results from a design science approach. In: Sprague, R.H. (eds.) Proceedings of the Annual Hawaii International Conference on System Sciences, pp. 4326–4335. IEEE, Washington, D.C. (2012)

    Google Scholar 

  18. ISO: ISO/IEC CD 42001. https://www.iso.org/standard/81230.html. Accessed 2023/04/20

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Philipp Fukas .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Fukas, P., Bozkurt, A., Lenz, N., Thomas, O. (2023). Developing a Maturity Assessment Tool to Enable the Management of Artificial Intelligence for Organizations. In: Ruiz, M., Soffer, P. (eds) Advanced Information Systems Engineering Workshops. CAiSE 2023. Lecture Notes in Business Information Processing, vol 482. Springer, Cham. https://doi.org/10.1007/978-3-031-34985-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-34985-0_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-34984-3

  • Online ISBN: 978-3-031-34985-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics