Abstract
A combined body of reviews, meta-research and other analyses demonstrates the evolution of computing education research (CER) through the decades with experience reports evolving to empirical research, increased attention paid to educational research, methods and reporting rigor. Previous analyses of CER publications show the sustained focus of CER on programming education, which has, by far, been the all-time most popular topic in CER. In the recent decade, other top researched areas include K-12 computing education and computational thinking. In this chapter, we add new insights to the top research areas of CER. We followed the PRISMA-S (Preferred Reporting Items for Systematic reviews and Meta-Analyses) literature search extension to capture the relevant literature on CER. The process of data retrieval, screening, and pre-processing resulted in a total of 16,863 articles included in the dataset. We use a combination of keyword analysis and structural topic modeling, and introduce a model of 29 topics. We also introduce emerging topics in recent years through an analysis of emerging common words in abstracts and titles during recent years. The results paint a unique picture about the dominating and trending research areas of CER, and of how common research topics are connected with each other. The analysis also reveals under-researched areas of CER.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Apiola, M., Lipponen, S., Seitamaa, A., Korhonen, T., Hakkarainen, K.: Learning Analytics for Knowledge Creation and Inventing in K-12: A Systematic Review. In: Lecture Notes in Networks and Systems (Proceedings of 2022 Computing Conference). Springer (2022)
Apiola, M., López-Pernas, S., Saqr, M.: The Venues that Shaped Computing Education Research: The Gatekeepers Under the Lens. In: M. Apiola, S. López-Pernas, M. Saqr (eds.) Past, Present and Future of Computing Education Research, Springer (2023)
Apiola, M., Saqr, M., López-Pernas, S., Tedre, M.: Computing education research compiled: Keyword trends, building blocks, creators, and dissemination. IEEE Access 10, 27041–27068 (2022). https://doi.org/10.1109/ACCESS.2022.3157609
Apiola, M., Sutinen, E.: Design science research for learning software engineering and computational thinking: Four cases. Computer Applications in Engineering Education, pp. 1–19 (2020). https://doi.org/10.1002/cae.22291
Apiola, M., Tedre, M., López-Pernas, S., Saqr, M., Daniels, M., Pears, A.: A Scientometric Journey Through the FIE Bookshelf: 1982–2020. In: 2021 IEEE Frontiers in Education Conference (FIE), pp. 1–9 (2021). https://doi.org/10.1109/FIE49875.2021.9637209
Austing, R.H., Barnes, B.H., Bonnette, D.T., Engel, G.L., Stokes, G.: Curriculum ’78: Recommendations for the undergraduate program in computer science– a report of the ACM curriculum committee on computer science. Communications of the ACM 22(3), 147–166 (1979). DOI http://doi.acm.org/10.1145/359080.359083
Butcher, D.F., Muth, W.A.: Predicting performance in an introductory computer science course. Commun. ACM 28(3), 263–268 (1985). URL https://doi.org/10.1145/3166.3167
Chen, X., Zou, D., Cheng, G., Xie, H.: Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: A retrospective of all volumes of computers & education. Computers & Education 151, 103855 (2020). URL https://doi.org/10.1016/j.compedu.2020.103855
Cooper, S., Dann, W., Pausch, R.: Teaching objects-first in introductory computer science. In: Proceedings of the 34th SIGCSE Technical Symposium on Computer Science Education, SIGCSE ’03, pp. 191–195. Association for Computing Machinery, New York, NY, USA (2003). URL https://doi.org/10.1145/611892.611966
Dagienė, V., Gulbahar, Y., Grugurina, N., López-Pernas, S., Saqr, M., Apiola, M., Stupurienė, G.: CER in Schools. In: M. Apiola, S. López-Pernas, M. Saqr (eds.) Past, Present and Future of Computing Education Research, Springer (2023)
Denning, P.J., Tedre, M.: Computational Thinking. Essential Knowledge Series. The MIT Press (2019)
Fagerlund, J., Häkkinen, P., Vesisenaho, M., Viiri, J.: Computational thinking in programming with scratch in primary schools: A systematic review. Computer Applications in Engineering Education 29(1), 12–28 (2021). DOI https://doi.org/10.1002/cae.22255
Fiesler, C., Garrett, N., Beard, N.: What do we teach when we teach tech ethics? a syllabi analysis. In: Proceedings of the 51st ACM Technical Symposium on Computer Science Education, SIGCSE ’20, pp. 289–295. Association for Computing Machinery, New York, NY, USA (2020). URL https://doi.org/10.1145/3328778.3366825
Fincher, S., Petre, M.: Computer Science Education Research. Taylor & Francis (2004)
Fincher, S.A., Robins, A.V. (eds.): The Cambridge Handbook of Computing Education Research. Cambridge University Press (2019). https://doi.org/10.1017/9781108654555.001
Franceschini, F., Maisano, D., Mastrogiacomo, L.: Empirical analysis and classification of database errors in scopus and web of science. Journal of Informetrics 10(4), 933–953 (2016). DOI https://doi.org/10.1016/j.joi.2016.07.003
Ihantola, P., Vihavainen, A., Ahadi, A., Butler, M., Börstler, J., Edwards, S.H., Isohanni, E., Korhonen, A., Petersen, A., Rivers, K., Rubio, M.A., Sheard, J., Skupas, B., Spacco, J., Szabo, C., Toll, D.: Educational Data Mining and Learning Analytics in Programming: Literature Review and Case Studies. In: Proceedings of the 2015 ITiCSE on Working Group Reports, ITICSE-WGR ’15, pp. 41–63. ACM, New York, NY, USA (2015). URL http://doi.acm.org/10.1145/2858796.2858798
Kaila, E.: Utilizing Educational Technology in Computer Science and Programming Courses. Ph.D. thesis, Turku Centre for Computer Science (University of Turku, Department of Future Technologies) (2018)
Kelly, K.: The Inevitable: Understanding the 12 Technological Forces That Will Shape Our Future. Penguin Books (2017)
López-Pernas, S., Saqr, M., Apiola, M.: Scientometrics: A Concise Introduction and a Detailed Methodology for the Mapping of the Scientific Field of Computing Education Research. In: M. Apiola, S. López-Pernas, M. Saqr (eds.) Past, Present and Future of Computing Education Research, Springer (2023)
Loui, M.C., Borrego, M.: Engineering Education Research. In: S.A. Fincher, A.V. Robins (eds.) The Cambridge Handbook of Computing Education Research. Cambridge University Press, pp. 292–321 (2019)
Luxton-Reilly, A., Simon, Albluwi, I., Becker, B.A., Giannakos, M., Kumar, A.N., Ott, L., Paterson, J., Scott, M.J., Sheard, J., Szabo, C.: Introductory programming: A systematic literature review. In: Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education, ITiCSE 2018 Companion, pp. 55–106. Association for Computing Machinery, New York, NY, USA (2018). URL https://doi.org/10.1145/3293881.3295779
Malmi, L., Hellas, A., Ihantola, P., Isomöttönen, V., Jormanainen, I., Kilamo, T., Knutas, A., Korhonen, A., Laakso, M.J., Poranen, T., Salakoski, T., Suhonen, J., and, S.L.P.: Computing Education Research in Finland. In: M. Apiola, S. López-Pernas, M. Saqr (eds.) Past, Present and Future of Computing Education Research, Springer (2023)
Malmi, L., Sheard, J., Simon, Bednarik, R., Helminen, J., Kinnunen, P., Korhonen, A., Myller, N., Sorva, J., Taherkhani, A.: Theoretical underpinnings of computing education research: What is the evidence? In: Proceedings of the Tenth Annual Conference on International Computing Education Research, ICER ’14, pp. 27–34. Association for Computing Machinery, New York, NY, USA (2014). URL https://doi.org/10.1145/2632320.2632358
Malmi, L., Simon, Sheard, J., Kinnunen, P., Sinclair, J.: The Evolution of Computing Education Research: A Meta-Analytic Perspective. In: M. Apiola, S. López-Pernas, M. Saqr (eds.) Past, Present and Future of Computing Education Research, Springer (2023)
Malmi, L., Utting, I., Ko, A.J.: Tools and Environments, pp. 639–662. The Cambridge Handbook of Computing Education Research. Cambridge University Press (2019). https://doi.org/10.1017/9781108654555.022
Margulieux, L.E., Dorn, B., Searle, K.A.: Learning Sciences for Computing Education. In: S.A. Fincher, A.V. Robins (eds.) The Cambridge Handbook of Computing Education Research, chap. 8, pp. 208–230. Cambridge University Press, Cambridge (2019)
McCracken, M., Almstrum, V., Diaz, D., Guzdial, M., Hagan, D., Kolikant, Y.B.D., Laxer, C., Thomas, L., Utting, I., Wilusz, T.: A Multi-national, Multi-institutional Study of Assessment of Programming Skills of First-year CS Students. In: Working group reports from ITiCSE on Innovation and technology in computer science education, ITiCSE-WGR ’01, pp. 125–180. ACM, New York, NY, USA (2001). URL http://doi.acm.org/10.1145/572133.572137
Papamitsiou, Z., Giannakos, M., Simon, Luxton-Reilly, A.: Computing education research landscape through an analysis of keywords. In: Proceedings of the 2020 ACM Conference on International Computing Education Research, ICER ’20, pp. 102–112. Association for Computing Machinery, New York, NY, USA (2020). URL https://doi.org/10.1145/3372782.3406276
Papert, S.: MINDSTORMS: Children, Computers, and Powerful Ideas. Basic Books (1980)
Pears, A., Seidman, S., Malmi, L., Mannila, L., Adams, E., Bennedsen, J., Devlin, M., Paterson, J.: A Survey of Literature on the Teaching of Introductory Programming. SIGCSE Bulletin 39, 204–223 (2007). URL http://doi.acm.org/10.1145/1345375.1345441
Pears, A., Tedre, M., Valtonen, T., Vartiainen, H.: What makes computational thinking so troublesome? In: To Appear in FIE’21 Frontiers in Education Conference (2021)
Raji, I.D., Scheuerman, M.K., Amironesei, R.: You Can’t Sit With Us: Exclusionary Pedagogy in AI Ethics Education. In: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, FAccT ’21, pp. 515–525. Association for Computing Machinery, New York, NY, USA (2021). URL https://doi.org/10.1145/3442188.3445914
Roberts, M.E., Stewart, B.M., Airoldi, E.M.: A model of text for experimentation in the social sciences. Journal of the American Statistical Association 111(515), 988–1003 (2016). URL https://doi.org/10.1080/01621459.2016.1141684
Roberts, M.E., Stewart, B.M., Tingley, D.: Stm: An r package for structural topic models. Journal of Statistical Software 91(2) (2019). URL https://doi.org/10.18637/jss.v091.i02
Roberts, M.E., Stewart, B.M., Tingley, D., Lucas, C., Leder-Luis, J., Gadarian, S.K., Albertson, B., Rand, D.G.: Structural topic models for open-ended survey responses. American Journal of Political Science 58(4), 1064–1082 (2014). URL https://doi.org/10.1111/ajps.12103
Robins, A., Rountree, J., Rountree, N.: Learning and Teaching Programming: A Review and Discussion. Computer Science Education 13(2), 137–172 (2003)
Robins, A.V.: Novice programmers and introductory programming. In: S.A. Fincher, A.V. Robins (eds.) The Cambridge Handbook of Computing Education Research, pp. 327–376. Cambridge University Press (2019). https://doi.org/10.1017/9781108654555.001
Salton, G.: Information science in a ph.d. computer science program. Commun. ACM 12(2), 111–117 (1969). URL https://doi.org/10.1145/362848.362871
Saqr, M., Ng, K., Oyelere, S.S., Tedre, M.: People, ideas, milestones: A scientometric study of computational thinking. ACM Trans. Comput. Educ. 21(3) (2021). URL https://doi.org/10.1145/3445984
Shapiro, B., Fiebrink, R., Norvig, P.: How machine learning impacts the undergraduate computing curriculum. Communications of the ACM 61(11), 27–29 (2018)
Simon: Emergence of computing education as a research discipline. Ph.D. thesis, Aalto University School of Science (2015)
Simon: Twenty-two years of ace. In: Proceedings of the Twenty-Second Australasian Computing Education Conference, ACE’20, pp. 203–210. Association for Computing Machinery, New York, NY, USA (2020). URL https://doi.org/10.1145/3373165.3373188
Simon, Sheard, J.: Twenty-Four Years of ITiCSE Papers. In: Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education, ITiCSE ’20, pp. 5–11. Association for Computing Machinery, New York, NY, USA (2020). URL https://doi.org/10.1145/3341525.3387407
Soloway, E.: Learning to Program = Learning to Construct Mechanisms and Explanations. Communications of the ACM 29(9), 850–858 (1986). URL http://doi.acm.org/10.1145/6592.6594
Tedre, M., Denning, P., Toivonen, T.: Ct 2.0. In: 21st Koli Calling International Conference on Computing Education Research, Koli Calling ’21. Association for Computing Machinery, New York, NY, USA (2021). URL https://doi.org/10.1145/3488042.3488053
Tedre, M., Denning, P., Toivonen, T.: Ct 2.0. In: 21st Koli Calling International Conference on Computing Education Research, Koli Calling ’21. Association for Computing Machinery, New York, NY, USA (2021). URL https://doi.org/10.1145/3488042.3488053
Tedre, M., Simon, Malmi, L.: Changing aims of computing education: a historical survey. Computer Science Education 28(2), 158–186 (2018). URL https://doi.org/10.1080/08993408.2018.1486624
Valentine, D.W.: Cs educational research: A meta-analysis of SIGCSE technical symposium proceedings. SIGCSE Bull. 36(1), 255–259 (2004). URL https://doi.org/10.1145/1028174.971391
Valtonen, T., López-Pernas, S., Saqr, M., Vartiainen, H., Sointu, E.T., Tedre, M.: The nature and building blocks of educational technology research. Computers in Human Behavior 128, 107123 (2022). URL https://doi.org/10.1016/j.chb.2021.107123
Vartiainen, H., Toivonen, T., Jormanainen, I., Kahila, J., Tedre, M., Valtonen, T.: Machine learning for middle schoolers: Learning through data-driven design. International Journal of Child-Computer Interaction 29, 100281 (2021). DOI https://doi.org/10.1016/j.ijcci.2021.100281.
Vayansky, I., Kumar, S.A.: A review of topic modeling methods. Information Systems 94, 101582 (2020). URL https://doi.org/10.1016/j.is.2020.101582
Vihavainen, A., Paksula, M., Luukkainen, M.: Extreme Apprenticeship Method in Teaching Programming for Beginners. In: Proceedings of the 42Nd ACM Technical Symposium on Computer Science Education, SIGCSE ’11, pp. 93–98. ACM, New York, NY, USA (2011). URL http://doi.acm.org/10.1145/1953163.1953196
Wing, J.M.: Computational thinking. Communications of the ACM 49(3), 33–35 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Apiola, M., Saqr, M., López-Pernas, S. (2023). The Evolving Themes of Computing Education Research: Trends, Topic Models, and Emerging Research. In: Apiola, M., López-Pernas, S., Saqr, M. (eds) Past, Present and Future of Computing Education Research . Springer, Cham. https://doi.org/10.1007/978-3-031-25336-2_8
Download citation
DOI: https://doi.org/10.1007/978-3-031-25336-2_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-25335-5
Online ISBN: 978-3-031-25336-2
eBook Packages: Computer ScienceComputer Science (R0)