Abstract
Research Question (RQ) Scoping refers to defining and refining a research question before conducting research. This step is crucial for ensuring the relevance and focus of the study, particularly in Design Science Research (DSR), where problems and solutions develop gradually. Literature reviews are a traditional method for comprehending the problem and determining key questions; however, they can be time-consuming and not worth it at the onset when lashing out in the dark. NLP chatbots such as ChatGPT can serve as a cost-effective alternative to clearing the way due to their capability to interact with users in a natural language-based manner and provide intuitive responses. The requirements for RQ Scoping extend beyond conversational support to include a framework for a sustained and iterative scoping process. An inquiry framework is necessary to guide and assist students and supervisors in fully harnessing the potential of NLP chatbots. This work incorporates ChatGPT into an inquiry framework for RQ Scoping, with mind maps as the visualization and the 5 Why technique as the inquiry strategy. Contributions include Design Principles, an IT artifact, and a Technology Acceptance Model evaluation (n = 9). Regarding perceived usefulness, the results indicate agreement on the intervention’s effectiveness in maintaining focus. However, there is less enthusiasm for mind maps as a communication tool. Perceived ease of use was also positive but revealed concerns about the query templates used by the framework.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
Chatin is a portmanteau of CHAtgpt-powered INquiry. The term is informally used as a friendly nickname in Spanish.
- 3.
- 4.
- 5.
Figure 3’s any_scoping[previously issued] event accounts for any event in the Scoping state that has already been issued once.
References
Andersen, B., Fagerhaug, T.: Root Cause Analysis. ASQ Quality Press (2006). https://psnet.ahrq.gov/primers/primer/10/root-cause-analysis
Buzan, T.: Mind maps at work: How to be the best at your job and still have time to play. HarperCollins UK (2004)
Cahan, P., Treutlein, B.: A conversation with ChatGPT on the role of computational systems biology in stem cell research. Stem Cell Rep. 18(1), 1–2 (2023)
Chang, K.E., Sung, Y.T., Lee, C.L.: Web-based collaborative inquiry learning. J. Comput. Assist. Learn. 19(1), 56–69 (2003)
Cochrane, L.: Is ChatGPT Manipulating You? (Or Are You Manipulating It?). https://logancochrane.com/blog/is-chatgpt-manipulating-you-or-are-you-manipulating-it
Enholm, I.M., Papagiannidis, E., Mikalef, P., Krogstie, J.: Artificial intelligence and business value: a literature review. Inf. Syst. Front. 24(5), 1709–1734 (2022)
Firat, M.: How ChatGPT can transform autodidactic experiences and open education? (2023). https://doi.org/10.31219/osf.io/9ge8m
Følstad, A., et al.: Future directions for chatbot research: an interdisciplinary research agenda. Computing 103(12), 2915–2942 (2021). https://doi.org/10.1007/s00607-021-01016-7
García-Martínez, I., Fernández-Batanero, J.M., Fernández-Cerero, J., León, S.P.: Analysing the impact of artificial intelligence and computational sciences on student performance: systematic review and meta-analysis. J. New Approach. Educ. Res. 12(1), 171–197 (2023)
Hassan, N.R.: Constructing the right disciplinary is questions. In: AMCIS 2017 (2017)
Hattie, J.A., Donoghue, G.M.: Learning strategies: a synthesis and conceptual model. NPJ Sci. Learn. 1(1), 1–13 (2016)
Johannesson, P., Perjons, E.: An Introduction to Design Science. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10632-8
Pedaste, M., et al.: Phases of inquiry-based learning: definitions and the inquiry cycle. Educ. Res. Rev. 14, 47–61 (2015)
Qadir, J.: Engineering education in the era of chatgpt: promise and pitfalls of generative AI for education. TechRxiv. Preprint (2022). https://doi.org/10.36227/techrxiv.21789434.v1
Quintana, C., et al.: A scaffolding design framework for software to support science inquiry. In: The Journal of the Learning Sciences, pp. 337–386. Psychology Press (2018)
Rai, A.: Avoiding type III errors: formulating is research problems that matter (2017)
Rizzo, G., Pietrolucci, M.E., Capponi, A., Mappa, I.: Exploring the role of artificial intelligence in the study of fetal heart. Int. J. Cardiovasc. Imaging 38(5), 1017–1019 (2022)
Schweder, S., Raufelder, D.: Examining positive emotions, autonomy support and learning strategies: self-directed versus teacher-directed learning environments. Learning Environ. Res. 25(2), 507–522 (2022)
Turner, M., Kitchenham, B., Brereton, P., Charters, S., Budgen, D.: Does the technology acceptance model predict actual use? A systematic literature review. Inf. Softw. Technol. 52(5), 463–479 (2010)
Van Joolingen, W.R., De Jong, T.: Design and implementation of simulation-based discovery environments: the smisle solution. J. Artif. Intell. Educ. 7, 253–276 (1996)
Walton, D.: Abductive Reasoning. University of Alabama Press, Tuscaloosa (2014)
Wieringa, R.J.: Design Science Methodology for Information Systems and Software Engineering. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-43839-8
Windschitl, M.: Inquiry projects in science teacher education: what can investigative experiences reveal about teacher thinking and eventual classroom practice? Sci. Educ. 87(1), 112–143 (2003)
Zhai, X.: ChatGPT user experience: implications for education. SSRN (2022). https://doi.org/10.2139/ssrn.4312418
Zion, M.: On line forums as a ‘rescue net’ in an open inquiry process. Int. J. Sci. Math. Educ. 6(2), 351–375 (2008). https://doi.org/10.1007/s10763-006-9051-x
Acknowledgements
Research supported by MCIN/AEI/10.13039/501100011033/FEDER, UE and the “European Union NextGenerationEU/PRTR” under contract PID2021-125438OB-I00. Xabier Garmendia enjoys a grant from the University of the Basque Country - PIF20/236.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Díaz, O., Garmendia, X., Contell, J.P., Pereira, J. (2023). Inquiry Frameworks for Research Question Scoping in DSR: A Realization for ChatGPT. In: Gerber, A., Baskerville, R. (eds) Design Science Research for a New Society: Society 5.0. DESRIST 2023. Lecture Notes in Computer Science, vol 13873. Springer, Cham. https://doi.org/10.1007/978-3-031-32808-4_19
Download citation
DOI: https://doi.org/10.1007/978-3-031-32808-4_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-32807-7
Online ISBN: 978-3-031-32808-4
eBook Packages: Computer ScienceComputer Science (R0)