Abstract
Research in design science has always acknowledged the need for evaluating its knowledge outcomes, with particular emphasis on assessing the efficacy and utility of the artifacts produced. However, the need to demonstrate the validity of the research process and outcomes has not received as much attention. This research examines scientific approaches to validity and their applicability to, and use in, design science. To do so, we assembled an extensive data set of research validities articles from various disciplines, as well as design science articles. We then examined the use of validity concepts in these articles and how these concepts could be employed to describe what validity means for design science research. The result is a design science research validity framework to guide how validity can become an integral aspect of design science research.
Authorship order beyond the first three authors was determined through a random draw.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Goes, P.B.: Editor’s comments: design science research in top information systems journals. MIS Q. 38(1), iii–viii (2014)
Rai, A., et al.: Diversity of design science contributions. MIS Q. 41(1), iii–xviii (2017)
vom Brocke, J., Winter, R., Hevner, A., Maedche, A.: Accumulation and evolution of design knowledge in design science research: a journey through time and space. J. Assoc. Inf. Syst. (2020)
Hevner, A., March, S., Park, J., Ram, S.: Design science in information systems research. MIS Q. 28(1), 75–105 (2004)
Gregor, S., Hevner, A.R.: Positioning and presenting design science research for maximum impact. MIS Q. 37(2), 337–355 (2013)
Lindzey, G., Gilbert, D., Fiske, S.T.: The Handbook of Social Psychology. Oxford University Press, Oxford (1998)
Baskerville, R., Kaul, M., Storey, V.C.: Genres of inquiry in design-science research: justification and evaluation of knowledge production. MIS Q. 39(3), 541–564 (2015)
Boudreau, M.-C., Gefen, D., Straub, D.W.: Validation in information systems research: a state-of-the-art assessment. MIS Q. 25(1), 1–16 (2001)
Straub, D., Boudreau, M.-C., Gefen, D.: Validation guidelines for IS positivist research. Commun. Assoc. Inf. Syst. 13(24), 380–427 (2004)
Nunamaker Jr., J.F., Applegate, L.M., Konsynski, B.R.: Facilitating group creativity: experience with a group decision support system. J. Manag. Inf. Syst. 3(4), 5–19 (1987)
Abbasi, A., Albrecht, C., Vance, A., Hansen, J.: Metafraud: a meta-learning framework for detecting financial fraud. Mis Q. 1293–1327 (2012)
Reinecke, K., Bernstein, A.: Knowing what a user likes: a design science approach to interfaces that automatically adapt to culture. Mis Q. 427–453 (2013)
Offermann, P., Blom, S., Schönherr, M., Bub, U.: Artifact types in information systems design science–a literature review. In: International Conference on Design Science Research in Information Systems, pp. 77–92 (2010)
Baskerville, R., Baiyere, A., Gregor, S., Hevner, A., Rossi, M.: Design science research contributions: finding a balance between artifact and theory. J. Assoc. Inf. Syst. 19(5), 358–376 (2018)
Venable, J., Pries-Heje, J., Baskerville, R.: FEDS: a framework for evaluation in design science research. Eur. J. Inf. Syst. 25(1), 77–89 (2016)
Prat, N., Comyn-Wattiau, I., Akoka, J.: A taxonomy of evaluation methods for information systems artifacts. J. Manag. Inf. Syst. 32(3), 229–267 (2015)
Cleven, A., Gubler, P., Hüner, K.M.: Design alternatives for the evaluation of design science research artifacts. In: International Conference on Design Science Research in Information Systems and Technology, pp. 1–8 (2009)
Tremblay, M., Vander Meer, D., Beck, R.: The effects of the quantification of faculty productivity: perspectives from the design science research community. Commun. Assoc. Inf. Syst. 43(1), 625–661 (2018). https://doi.org/10.17705/1cais.04334
Engel, C., Leicht, N., Ebel, P.: The imprint of design science in information systems research: an empirical analysis of the AIS senior scholars’ basket. In: International Conference on Information Systems, Munich, Germany, pp. 1–10 (2019)
Lukyanenko, R., Evermann, J., Parsons, J.: Instantiation validity in IS design research. In: Tremblay, M.C., VanderMeer, D., Rothenberger, M., Gupta, A., Yoon, V. (eds.) DESRIST 2014. LNCS, vol. 8463, pp. 321–328. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-06701-8_22
Lukyanenko, R., Parsons, J.: Design theory indeterminacy: what is it, how can it be reduced, and why did the polar bear drown?. J. Assoc. Inf. Syst. Forthcoming
Miah, S.J., Gammack, J.G., McKay, J.: A metadesign theory for tailorable decision support. J. Assoc. Inf. Syst. 20(5), 4 (2019)
Lukyanenko, R., Parsons, J., Samuel, B.M.: Representing instances: the case for reengineering conceptual modeling grammars. Eur. J. Inf. Syst. 28(1), 68–90 (2019). https://doi.org/10.1080/0960085X.2018.1488567
Recker, J.: Toward a design theory for green information systems. Presented at the 2016 49th Hawaii International Conference on System Sciences (HICSS), pp. 4474–4483 (2016)
American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational, and Psychological Testing (US), Standards for educational and psychological testing. Amer Educational Research Assn (2014)
Lowry, P.B., et al.: Evaluating journal quality and the association for information systems senior scholars’ journal basket via bibliometric measures: do expert journal assessments add value? MIS Q. 993–1012 (2013)
Simon, H.A.: The Sciences of the Artificial. MIT Press, Mass (1996)
March, S.T., Smith, G.F.: Design and natural science research on information technology. Decis. Support Syst. 15(4), 251–266 (1995)
Gregor, S., Jones, D.: The anatomy of design theory. J. Assoc. Inf. Syst. 8(5), 312–335 (2007)
Markus, M.L., Majchrzak, A., Gasser, L.: A design theory for systems that support emergent knowledge processes. MIS Q. 179–212 (2002)
Schmitz, K., Veda C. S.: Empirical test guidelines for content validity: wash, rinse, and repeat until clean. Commun. Assoc. Inf. Syst. (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Larsen, K.R. et al. (2020). Validity in Design Science Research. In: Hofmann, S., Müller, O., Rossi, M. (eds) Designing for Digital Transformation. Co-Creating Services with Citizens and Industry. DESRIST 2020. Lecture Notes in Computer Science(), vol 12388. Springer, Cham. https://doi.org/10.1007/978-3-030-64823-7_25
Download citation
DOI: https://doi.org/10.1007/978-3-030-64823-7_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64822-0
Online ISBN: 978-3-030-64823-7
eBook Packages: Computer ScienceComputer Science (R0)