Abstract
Driven by our technologically advanced workplaces and the surge in demand for proficiency in the computing disciplines, it is becoming imperative to provide computational thinking (CT) opportunities to all students. One approach for making computing accessible and relevant to learning and problem-solving in K-12 environments is to integrate it with existing Science, Technology, Engineering, and Math (STEM) curricula. However, novice student learners may face several difficulties in trying to learn STEM and computing concepts simultaneously. To address some of these difficulties, we present a systematic approach to learning STEM and CT by designing and developing domain-specific modeling languages (DSMLs) to aid students in their model building and problem-solving processes. The paper discusses a theoretical framework and the design principles for developing DSMLs, which is implemented as a four-step process. We apply the four-step process in three domains: Physics, Marine Biology, and Earth Science to demonstrate its generality, and then perform case studies to show how the DSMLs impact student learning and model building. We conclude with a discussion of our findings and then present directions for future work.
Similar content being viewed by others
References
Araujo, I., Veit, E., & Moreira, M. (2008). Physics students' performance using computational modelling activities to improve kinematics graphs interpretation. Computers and Education, 50(4), 1128–1140.
Basu, S., Biswas, G., & Kinnebrew, J. S. (2016a). Using multiple representations to simultaneously learn computational thinking and middle school science. In Proceedings of the thirtieth AAAI conference on artificial intelligence (pp. 3705–3711). Arizona, USA: Phoenix.
Basu, S., Biswas, G., & Kinnebrew, J. S. (2017). Learner modeling for adaptive scaffolding in a computational thinking-based science learning environment. User Modeling and User-Adapted Interaction, 27(1), 5–53.
Basu, S., Biswas, G., Sengupta, P., Dickes, A., Kinnebrew, J. S., & Clark, D. (2016b). Identifying middle school students’ challenges in computational thinking-based science learning. Research and Practice in Technology Enhanced Learning, 11(1), 1–35.
Basu, S., Dickes, A., Kinnebrew, J. S., Sengupta, P., & Biswas, G. (2013). CTSiM: A computational thinking environment for learning science through simulation and modeling. In Proceedings of the 5th international conference on computer supported education (pp. 369–378). Germany: Aachen.
Basu, S., McElhaney, K., Grover, S., Harris, C., & Biswas, G. (2018). A principled approach to designing assessments that integrate science and computational thinking. In Proceedings of the 13th international conference of the learning sciences (pp. 384–391). London, England.
Bau, D., Gray, J., Kelleher, C., Sheldon, J., & Turbak, F. (2017). Learnable programming: Blocks and beyond. Communications of the ACM, 60(6), 72–80.
Berland, M., Martin, T., Benton, T., Smith, C. P., & Davis, D. (2013). Using learning analytics to understand the learning pathways of novice programmers. Journal of the Learning Sciences., 22(4), 564–599.
Biswas, G., Baker, R. S., & Paquette, L. (2018). Data mining methods for assessing self-regulated learning. In D. H. Schunk & J. A. Greene (Eds.), Educational psychology handbook series. Handbook of self-regulation of learning and performance (p. 388–403). Routledge/Taylor & Francis Group.
Blikstein, P., Worsley, M., Piech, C., Sahami, M., Cooper, S., & Koller, D. (2014). Programming pluralism: Using learning analytics to detect patterns in the learning of computer programming. Journal of the Learning Sciences, 23(4), 561–599.
Bredeweg, B., Liem, J., Beek, W., Linnebank, F., Gracia, J., Lozano, E., Wißner, M., Bühling, R., Salles, P., Noble, R., Zitek, A., Borisova, P., & Mioduser, D. (2013). DynaLearn – An intelligent learning environment for learning conceptual knowledge. AI Magazine, 34(4), 46–65. https://doi.org/10.1609/aimag.v34i4.2489.
Brennan, K., & Resnick, M. (2012). New frameworks for studying and assessing the development of computational thinking. Paper presented at annual American Educational Research Association meeting. BC, Canada: Vancouver.
Brodie, M. L., Mylopoulos, J., & Schmidt J. W. (Eds.). (2012). On conceptual modelling: Perspectives from artificial intelligence, databases, and programming languages. Springer Science & Business Media.
Brown, N. C., Mönig, J., Bau, A., & Weintrop, D. (2016, February). Panel: Future directions of block-based programming. In Proceedings of the 47th ACM technical symposium on computing science education (pp. 315–316).
CCSSO. (2011). The common core state standards for mathematics. Retrieved February 1, 2020, from http://www.corestandards.org/wp-content/uploads/Math_Standards1.pdf
Chi, M. T. H. (2005). Common sense conceptions of emergent processes: Why some misconceptions are robust. Journal of the Learning Sciences, 14, 161–199.
Chiu, J., McElhaney, K. W., Zhang, N., Biswas, G., Fried, R., Basu, S., & Alozie, N. (2019). A principled approach to NGSS-aligned curriculum development integrating science, engineering, and computation: A pilot study. In Paper presented at the 2019 NARST annual international conference.
Clark, D., Nelson, B., Sengupta, P., & D’Angelo, C. (2009). Rethinking science learning through digital games and simulations: Genres, examples, and evidence. In Learning science: Computer games, simulations, and education workshop sponsored by the National Academy of Sciences. Washington DC.
Dede, C. (2010). Technological supports for acquiring 21st century skills. In P. Peterson, E. Baker, & B. McGaw (Eds.), International encyclopedia of education (pp. 158–166). Oxford, England: Elsevier.
van Deursen, A. (1997). Domain-specific languages versus object-oriented frameworks: A financial engineering case study. In Smalltalk and Java in industry and academia, STJA’97 (pp. 35–39). Ilmenau Technical University.
van Deursen, A., Klint, P., & Visser, J. (2000). Domain-specific languages: An annotated bibliography. SIGPLAN Notices, 35, 26–36.
DiSessa, A. A. (2001). Changing minds: Computers, learning, and literacy. Mit Press.
Dong, Y., Kinnebrew, J., & Biswas, G. (2016). Comparison of selection criteria for multi-feature hierarchical activity Mining in Open-Ended Learning Environments. In Proceedings of the 9th international conference on educational data mining (pp. 591–592). North Carolina: Raleigh.
Gasevic, D., Jovanovic, J., Pardo, A., & Dawson, S. (2017). Detecting learning strategies with analytics: Links with self-reported measures and academic performance. Journal of Learning Analytics, 4(2), 113–128. https://doi.org/10.18608/jla.2017.42.10.
Grover, S. (2019). An Assessment for Introductory Programming Concepts in Middle School Computer Science. Presented at the 2019. In Annual meeting of the National Council on measurement in education (NCME). Toronto: CA.
Grover, S. (2020). Designing an Assessment for Introductory Programming Concepts in Middle School Computer Science. In Proceedings of the 51st ACM Technical Symposium on Computing Science Education (SIGCSE’20), Portland, OR
Grover, S., & Basu, S. (2017). Measuring student learning in introductory block-based programming: Examining misconceptions of loops, variables, and Boolean logic. In Proceedings of the 2017 ACM SIGCSE technical symposium on computer science education (pp. 267–272). ACM.
Grover, S., & Pea, R. (2018). Computational thinking: A competency whose time has come. In S. Sentance, E. Barendsen, & S. Carsten (Eds.), Computer Science Education: Perspectives on teaching and learning. Bloomsbury.
Harvey, B., Garcia, D. D., Barnes, T., Titterton, N., Armendariz, D., Segars, L., Lemon, E., Morris, S., & Paley, J. (2013). SNAP! (build your own blocks). In Proceedings of the 44th ACM technical symposium on computer science education, SIGCSE '13 (p. 759).
Hashem, K., & Mioduser, D. (2011). The contribution of learning by modeling (LbM) to students’ understanding of complexity concepts. International Journal of e-Education, e-Business, e-Management and e-Learning, 1(2), 151–157.
Hestenes, D., Wells, M., & Swackhamer, G. (1992). Force concept inventory. The Physics Teacher, 30, 141–166.
Hilton, M. (2010). Exploring the intersection of science education and 21st century skills: A workshop summary. National Academies Press.
Hudak, P. (1996). Building domain-specific embedded languages. ACM Computing Surveys (CSUR), 28(4), 196–1es.
Hutchins, N., Biswas, G., Conlin, L., Emara, M., Grover, S., Basu, S., & McElhaney, K. (2018). Studying synergistic learning of physics and computational thinking in a learning by modeling environment. In J. C. Yang et al. (Eds.), In proceedings of the 26th international conference on computers in education (pp. 153–162). Philippines: Manila.
Hutchins, N., Biswas, G., Maróti, M., Lédeczi, A., Grover, S., Wolf, R., Blair, K. P., Chin, D. B., Conlin, L., Basu, S., & McElhaney, K. (2020). C2STEM: A system for synergistic learning of physics and computational thinking. Journal of Science Education and Technology (JOST), 29, 83–100. https://doi.org/10.1007/s10956-019-09804-9.
Järvelä, S., Gašević, D., Seppänen, T., Pechenizkiy, M., & Kirschner, P. A. (2020). Bridging learning sciences, machine learning and affective computing for understanding cognition and affect in collaborative learning. British Journal of Educational Technology. https://doi.org/10.1111/bjet.12917.
Jona, K., Wilensky, U., Trouille, L., Horn, M. S., Orton, K., Weintrop, D., & Beheshti, E. (2014). Embedding computational thinking in science, technology, engineering, and math (CT-STEM). In future directions in computer science education summit meeting. FL: Orlando.
Jonassen, D., Strobel, J., & Gottdenker, J. (2005). Model building for conceptual change. Interactive Learning Environments, 13(1–2), 15–37.
van Joolingen, W. R., De Jong, T., Lazonder, A., Savelsbergh, E. R., & Manlove, S. (2005). Co-lab: Research and development of an online learning environment for collaborative scientific discovery learning. Computers in Human Behavior, 21, 671–688.
Karsai, G., Krahn, H., Pinkernell, C., Rumpe, B., Schindler, M., & Völkel, S. (2014). Design guidelines for domain specific languages. ArXiv, abs/1409.2378.
Keating, T., Barnett, M., Barab, S. A., & Hay, K. E. (2002). The virtual solar system project: Developing conceptual understanding of astronomical concepts through building three-dimensional computational models. Journal of Science Education and Technology, 11(3), 261–275.
Kelly, S. & Tolvanen, J. (2008). Domain-specific modeling : Enabling full code generation. Retrieved from https://ebookcentral.proquest.com
Kinnebrew, J. S., Loretz, K. M., & Biswas, G. (2013). A contextualized, differential sequence mining method to derive students' learning behavior patterns. Journal of Educational Data Mining, 5(1), 190–219.
Koh, K. H., Basawapatna, A., Bennett, V., & Repenning, A. (2010). Towards the automatic recognition of computational thinking for adaptive visual language learning. In Proceedings of the 2010 IEEE symposium on visual languages and human-centric computing (pp. 59–66). Leganes.
Ledeczi, A., Bakay, A., Maroti, M., Volgyesi, P., Nordstrom, G., Sprinkle, J., & Karsai, G. (2001). Composing domain-specific design environments. Computer, 34(11), 44–51.
Leelawong, K., & Biswas, G. (2008). Designing learning by teaching agents: The Betty’s brain system. International Journal of Artificial Intelligence in Education, 18(3), 181–208.
Lehrer, R., & Schauble, L. (2015). The development of scientific thinking. In R. M. Lerner, L.S. Liben, & U. Mueller (Eds.), Handbook of child psychology and developmental science, 2(7), 671–714.
Levesque, H. J. (1986). Knowledge representation and reasoning. Annual review of computer science, 1(1), 255–287.
McElhaney, K. W., Basu, S., Wetzel, T., & Boyce, J. (2019). Three-dimensional assessment of NGSS upper elementary engineering design performance expectations. In NARST Annual International Conference.
Metcalf, S. J., Krajcik, J., & Soloway, E. (2000). Model-it: A design retrospective. In M. J. Jacobson & R. B. Kozma (Eds.), Innovations in science and mathematics education: Advanced designs for technologies of learning (pp. 77–115). Mahwah, NJ: Lawrence Erlbaum Associates.
Mislevy, R. J., & Haertel, G. D. (2006). Implications of evidence-centered design for educational testing. Educational Measurement: Issues and Practice, 25(4), 6–20.
Mislevy, R. J., & Riconscente, M. (2005). Evidence-centered assessment design: Layers, structures, and terminology (PADI technical report 9). Menlo Park, CA: SRI International.
N. G. S. S. Lead States (2013). Next generation science standards: For States, by States. Washington, DC: The National Academies Press.
Nikolai, C., & Madey, G. (2009). Tools of the trade: A survey of various agent based modeling platforms. Journal of Artificial Societies and Social Simulation, 12(2), 2.
Niwa, K., Sasaki, K., & Ihara, H. (1984). An experimental comparison of knowledge representation schemes. AI Magazine, 5(2), 29–29.
Olson, I. C., Horn, M., & Wilensky, U. (2011). Modeling on the table: Agent-based modeling in elementary school with NetTango. In Proceedings of 10th international conference on interaction design and children. Ann Arbor: MI.
Paige, R. F., Ostroff, J. S., & Brooke, P. J. (2000). Principles for modeling language design. Information and Software Technology, 42, 665–675.
Pausch, R., Burnette, T., Capeheart, A. C., Conway, M., Cosgrove, D., DeLine, R., Durbin, J., Gossweiler, R., Koga, S., & White, J. (1995). Alice: Rapid prototyping system for virtual reality. IEEE Computer Graphics and Applications, 15(3), 8–11.
Piech, C., Huang, J., Nguyen, A., Phulsuksombati, M., Sahami, M., & Guibas, L. (2015). Learning program embeddings to propagate feedback on student code. In Proceedings of the 32nd international conference on machine learning (pp. 1093–1102). France: Lille.
Redish, E. F., & Wilson, J. M. (1993). Student programming in the introductory physics course: M.U.P.P.E.T. American Journal of Physics, 61, 222–232.
Repenning, A., Webb, D., & Ioannidou, A. (2010). Scalable game design and the development of a checklist for getting computational thinking into public schools. In Proceedings of the 41st ACM technical symposium on computer science education (SIGCSE). Milwaukee: ACM Press.
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., & Kafai, Y. (2009). Scratch: Programming for all. Communications of the ACM, 52(11), 60–67.
Schwartz, D. L., Bransford, J. D., & Sears, D. (2005). Efficiency and innovation in transfer. In J. Mestre (Ed.), Transfer of learning: Research and perspectives (pp. 1–52). Greenwich, CT: Information Age Publishing.
Schwarz, C. V., & White, B. Y. (2005). Metamodelling knowledge: Developing students’ understanding of scientific modelling. Cognition and Instruction, 23(2), 165–205.
Segedy, J. R., Kinnebrew, J. S., & Biswas, G. (2015). Using coherence analysis to characterize self-regulated learning Behaviours in open-ended learning environments. Journal of Learning Analytics, 2(1), 13–48.
Selic, B. (2007). A systematic approach to domain-specific language design using UML. In Proceedings of the 10th IEEE international symposium on object and component-oriented real-time distributed computing (pp. 2–9). Santorini Island.
Sengupta, P., Dickes, A., & Farris, A. (2018). Toward a phenomenology of computational thinking in STEM education. In M. Khine (Ed.), Computational thinking in the STEM disciplines. Cham: Springer.
Sengupta, P., Dickes, A., Farris, A. V., Karan, A., Martin, D., & Wright, M. (2015). Programming in K-12 science classrooms. Communications of the ACM, 58(11), 33–35.
Sengupta, P., & Farris, A. V. (2012). Learning kinematics in elementary grades using agent-based computational modeling: A visual programming based approach. In Proceedings of the 11th international conference on Interaction Design & Children (pp. 78–87).
Sengupta, P., Farris, A. V., & Wright, M. (2012). From agents to continuous change via aesthetics: Learning mechanics with visual agent-based computational modeling. Technology, Knowledge and Learning, 17(1–2), 23–42.
Sengupta, P., Kinnebrew, J. S., Basu, S., Biswas, G., & Clark, D. (2013). Integrating computational thinking with k-12 science education using agent-based computation: A theoretical framework. Education and Information Technologies, 18(2), 351–380.
Shen, J., Lei, J., Chang, H. Y., & Namdar, B. (2014). Technology-enhanced, modeling-based instruction (TMBI) in science education. In In Handbook of Research on Educational Communications and Technology (Fourth ed., pp. 529–540). New York: Springer. https://doi.org/10.1007/978-1-4614-3185-5_41.
Sherin, B. L. (2001a). A comparison of programming languages and algebraic notation as expressive languages for physics. International Journal of Computers for Mathematical Learning, 6(1), 1–61.
Sherin, B. L. (2001b). How students understand physics equations. Cognition and Instruction, 19(4), 479–541.
Sherin, B., diSessa, A. A., & Hammer, D. M. (1993). Dynaturtle revisited: Learning physics through collaborative design of a computer model. Interactive Learning Environments, 3(2), 91–118.
Snyder, C., Hutchins, N., Biswas, G., Emara, M., Grover, S., & Conlin, L. (2019). Analyzing students’ synergistic learning processes in physics and CT by collaborative discourse analysis. In Proceedings of the international conference on computer supported collaborative learning (pp. 360–367). Lyon, France.
Sun, D., & Looi, C.K (2013). Designing a web-based science learning environment for model-based collaborative inquiry. Journal of Science Education and Technology, 22(1), 73–89.
Tissenbaum, M., Sheldon, J., & Abelson, H. (2019). From computational thinking to computational action. Communications of the ACM, 62(3), 34–36.
Tisue, S., & Wilensky, U. (2004). NetLogo: Design and Implementation of a Multi-Agent Modeling Environment. Paper presented at the Agent2004 Conference. Chicago, IL.
Trowbridge, D. E., & McDermott, L. C. (1981). Investigation of student understanding of the concept of acceleration in one dimension. American Journal of Physics, 49(3), 242–253.
VanLehn, K. (2013). Model construction as a learning activity: A design space and review. Interactive Learning Environments, 21(4), 371–413. https://doi.org/10.1080/10494820.2013.803125.
VanLehn, K., Chung, G., Grover, S., Madni, A., & Wetzel, J. (2016). Learning science by constructing models: Can dragoon increase learning without increasing the time required? International Journal of Artificial Intelligence in Education, 26(4), 1033–1068. https://doi.org/10.1007/s40593-015-0093-5.
VanLehn, K., Wetzel, J., Grover, S., & van de Sande, B. (2015). Learning how to construct models of dynamic systems: An initial evaluation of the dragoon intelligent tutoring system. IEEE Transactions on Educational Technology, 10(2), 154–167. https://doi.org/10.1109/TLT.2016.2514422.
Weintrop, D., Beheshti, E., Horn, M., Orton, K., Jona, K., Trouille, L., & Wilensky, U. (2016). Defining computational thinking for mathematics and science classrooms. Journal of Science Education and Technology, 25(1), 127–147.
Werner, L., McDowell, C., & Denner, J. (2013). A first step in learning analytics: Pre-processing low-level Alice logging data of middle school students. Journal of Educational Data Mining, 5(2), 11–37.
Wetzel, J., VanLehn, K., Chaudhari, P., Desai, A., Feng, J., Grover, S., Joiner, R., Kong-Silvert, M., Patade, V., Samala, R., Tiwari, M., & van de Sande, B. (2017). The design and development of the dragoon intelligent tutoring system for model construction: Lessons learned. Interactive Learning Environments, 25(3), 361–381. https://doi.org/10.1080/10494820.2015.1131167.
Wieman, C. E., Adams, W. K., & Perkins, K. K. (2008). PhET research: Simulations that enhance learning. Science, 322, 682–683.
Wilensky, U., Brady, C. E., & Horn, M. S. (2014). Fostering computational literacy in science classrooms. Communications of the ACM, 57(8), 24–28.
Wilensky, U., & Reisman, K. (2006). Thinking like a wolf, a sheep, or a firefly: Learning biology through constructing and testing computational theories—An embodied modeling approach. Cognition and Instruction, 24(2), 171–209.
Wilensky, U., & Resnick, M. (1999). Thinking in levels: A dynamic systems perspective to making sense of the world. Journal of Science Education and Technology, 8(1), 3–19.
Wing, J. (2011). Research notebook: Computational thinking—What and why. The Link Magazine, 20–23.
Zhang, N., Biswas, G., Chiu, J. L., & McElhaney, K. W. (2019). Analyzing students’ design solutions in an NGSS-aligned earth sciences curriculum. In Proceedings of the 20th international conference on artificial intelligence in education (pp. 532–543). Chicago.
Zhang, N., Biswas, G., & Dong, Y. (2017). Characterizing students’ learning behaviors using unsupervised learning methods. In E. André, R. Baker, X. Hu, M. Rodrigo, & B. du Boulay (Eds.), Artificial intelligence in education (pp. 430–441). Wuhan, China: Lecture notes in computer science (Vol. 10331). Cham: Springer.
Zhang, N., Biswas, G., McElhaney, K. W., Basu, S., McBride, E., & Chiu, J. L. (2020). Studying the Interactions Between Science, Engineering, and Computational Thinking in a Learning-by-Modeling Environment. In I. Bittencourt, M. Cukurova, K. Muldner, R. Luckin, & E. Millán (Eds.), Artificial Intelligence in Education. AIED 2020. Lecture notes in computer science (Vol. 12163). Cham: Springer.
Acknowledgements
We thank Shuchi Grover, Brian Broll, Satabdi Basu, Kevin McElhaney, Justin Montenegro, Beth Sanzenbacher, Naveed Mohammed, Kristen Pilner Blair, Doris Chin, Rachel Wolf and all of our C2STEM and SPICE project contributors for their assistance on this project.
Availability of Data and Material
Data available on request from the authors.
Code Availability
Available at https://github.com/c2stem
Funding
This project was supported under National Science Foundation Award DRL-1640199 and National Science Foundation Award DRL-1742195.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of Interest/Competing Interests
No conflicts of interest to declare.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
ESM 1
(DOCX 182 kb)
Rights and permissions
About this article
Cite this article
Hutchins, N.M., Biswas, G., Zhang, N. et al. Domain-Specific Modeling Languages in Computer-Based Learning Environments: a Systematic Approach to Support Science Learning through Computational Modeling. Int J Artif Intell Educ 30, 537–580 (2020). https://doi.org/10.1007/s40593-020-00209-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40593-020-00209-z