Skip to main content

The Evolving Themes of Computing Education Research: Trends, Topic Models, and Emerging Research

  • Chapter
  • First Online:
Past, Present and Future of Computing Education Research

Abstract

A combined body of reviews, meta-research and other analyses demonstrates the evolution of computing education research (CER) through the decades with experience reports evolving to empirical research, increased attention paid to educational research, methods and reporting rigor. Previous analyses of CER publications show the sustained focus of CER on programming education, which has, by far, been the all-time most popular topic in CER. In the recent decade, other top researched areas include K-12 computing education and computational thinking. In this chapter, we add new insights to the top research areas of CER. We followed the PRISMA-S (Preferred Reporting Items for Systematic reviews and Meta-Analyses) literature search extension to capture the relevant literature on CER. The process of data retrieval, screening, and pre-processing resulted in a total of 16,863 articles included in the dataset. We use a combination of keyword analysis and structural topic modeling, and introduce a model of 29 topics. We also introduce emerging topics in recent years through an analysis of emerging common words in abstracts and titles during recent years. The results paint a unique picture about the dominating and trending research areas of CER, and of how common research topics are connected with each other. The analysis also reveals under-researched areas of CER.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Apiola, M., Lipponen, S., Seitamaa, A., Korhonen, T., Hakkarainen, K.: Learning Analytics for Knowledge Creation and Inventing in K-12: A Systematic Review. In: Lecture Notes in Networks and Systems (Proceedings of 2022 Computing Conference). Springer (2022)

    Google Scholar 

  2. Apiola, M., López-Pernas, S., Saqr, M.: The Venues that Shaped Computing Education Research: The Gatekeepers Under the Lens. In: M. Apiola, S. López-Pernas, M. Saqr (eds.) Past, Present and Future of Computing Education Research, Springer (2023)

    Google Scholar 

  3. Apiola, M., Saqr, M., López-Pernas, S., Tedre, M.: Computing education research compiled: Keyword trends, building blocks, creators, and dissemination. IEEE Access 10, 27041–27068 (2022). https://doi.org/10.1109/ACCESS.2022.3157609

    Article  Google Scholar 

  4. Apiola, M., Sutinen, E.: Design science research for learning software engineering and computational thinking: Four cases. Computer Applications in Engineering Education, pp. 1–19 (2020). https://doi.org/10.1002/cae.22291

  5. Apiola, M., Tedre, M., López-Pernas, S., Saqr, M., Daniels, M., Pears, A.: A Scientometric Journey Through the FIE Bookshelf: 1982–2020. In: 2021 IEEE Frontiers in Education Conference (FIE), pp. 1–9 (2021). https://doi.org/10.1109/FIE49875.2021.9637209

  6. Austing, R.H., Barnes, B.H., Bonnette, D.T., Engel, G.L., Stokes, G.: Curriculum ’78: Recommendations for the undergraduate program in computer science– a report of the ACM curriculum committee on computer science. Communications of the ACM 22(3), 147–166 (1979). DOI http://doi.acm.org/10.1145/359080.359083

  7. Butcher, D.F., Muth, W.A.: Predicting performance in an introductory computer science course. Commun. ACM 28(3), 263–268 (1985). URL https://doi.org/10.1145/3166.3167

  8. Chen, X., Zou, D., Cheng, G., Xie, H.: Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: A retrospective of all volumes of computers & education. Computers & Education 151, 103855 (2020). URL https://doi.org/10.1016/j.compedu.2020.103855

  9. Cooper, S., Dann, W., Pausch, R.: Teaching objects-first in introductory computer science. In: Proceedings of the 34th SIGCSE Technical Symposium on Computer Science Education, SIGCSE ’03, pp. 191–195. Association for Computing Machinery, New York, NY, USA (2003). URL https://doi.org/10.1145/611892.611966

  10. Dagienė, V., Gulbahar, Y., Grugurina, N., López-Pernas, S., Saqr, M., Apiola, M., Stupurienė, G.: CER in Schools. In: M. Apiola, S. López-Pernas, M. Saqr (eds.) Past, Present and Future of Computing Education Research, Springer (2023)

    Google Scholar 

  11. Denning, P.J., Tedre, M.: Computational Thinking. Essential Knowledge Series. The MIT Press (2019)

    Book  Google Scholar 

  12. Fagerlund, J., Häkkinen, P., Vesisenaho, M., Viiri, J.: Computational thinking in programming with scratch in primary schools: A systematic review. Computer Applications in Engineering Education 29(1), 12–28 (2021). DOI https://doi.org/10.1002/cae.22255

  13. Fiesler, C., Garrett, N., Beard, N.: What do we teach when we teach tech ethics? a syllabi analysis. In: Proceedings of the 51st ACM Technical Symposium on Computer Science Education, SIGCSE ’20, pp. 289–295. Association for Computing Machinery, New York, NY, USA (2020). URL https://doi.org/10.1145/3328778.3366825

  14. Fincher, S., Petre, M.: Computer Science Education Research. Taylor & Francis (2004)

    Google Scholar 

  15. Fincher, S.A., Robins, A.V. (eds.): The Cambridge Handbook of Computing Education Research. Cambridge University Press (2019). https://doi.org/10.1017/9781108654555.001

  16. Franceschini, F., Maisano, D., Mastrogiacomo, L.: Empirical analysis and classification of database errors in scopus and web of science. Journal of Informetrics 10(4), 933–953 (2016). DOI https://doi.org/10.1016/j.joi.2016.07.003

  17. Ihantola, P., Vihavainen, A., Ahadi, A., Butler, M., Börstler, J., Edwards, S.H., Isohanni, E., Korhonen, A., Petersen, A., Rivers, K., Rubio, M.A., Sheard, J., Skupas, B., Spacco, J., Szabo, C., Toll, D.: Educational Data Mining and Learning Analytics in Programming: Literature Review and Case Studies. In: Proceedings of the 2015 ITiCSE on Working Group Reports, ITICSE-WGR ’15, pp. 41–63. ACM, New York, NY, USA (2015). URL http://doi.acm.org/10.1145/2858796.2858798

  18. Kaila, E.: Utilizing Educational Technology in Computer Science and Programming Courses. Ph.D. thesis, Turku Centre for Computer Science (University of Turku, Department of Future Technologies) (2018)

    Google Scholar 

  19. Kelly, K.: The Inevitable: Understanding the 12 Technological Forces That Will Shape Our Future. Penguin Books (2017)

    Google Scholar 

  20. López-Pernas, S., Saqr, M., Apiola, M.: Scientometrics: A Concise Introduction and a Detailed Methodology for the Mapping of the Scientific Field of Computing Education Research. In: M. Apiola, S. López-Pernas, M. Saqr (eds.) Past, Present and Future of Computing Education Research, Springer (2023)

    Google Scholar 

  21. Loui, M.C., Borrego, M.: Engineering Education Research. In: S.A. Fincher, A.V. Robins (eds.) The Cambridge Handbook of Computing Education Research. Cambridge University Press, pp. 292–321 (2019)

    Google Scholar 

  22. Luxton-Reilly, A., Simon, Albluwi, I., Becker, B.A., Giannakos, M., Kumar, A.N., Ott, L., Paterson, J., Scott, M.J., Sheard, J., Szabo, C.: Introductory programming: A systematic literature review. In: Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education, ITiCSE 2018 Companion, pp. 55–106. Association for Computing Machinery, New York, NY, USA (2018). URL https://doi.org/10.1145/3293881.3295779

  23. Malmi, L., Hellas, A., Ihantola, P., Isomöttönen, V., Jormanainen, I., Kilamo, T., Knutas, A., Korhonen, A., Laakso, M.J., Poranen, T., Salakoski, T., Suhonen, J., and, S.L.P.: Computing Education Research in Finland. In: M. Apiola, S. López-Pernas, M. Saqr (eds.) Past, Present and Future of Computing Education Research, Springer (2023)

    Google Scholar 

  24. Malmi, L., Sheard, J., Simon, Bednarik, R., Helminen, J., Kinnunen, P., Korhonen, A., Myller, N., Sorva, J., Taherkhani, A.: Theoretical underpinnings of computing education research: What is the evidence? In: Proceedings of the Tenth Annual Conference on International Computing Education Research, ICER ’14, pp. 27–34. Association for Computing Machinery, New York, NY, USA (2014). URL https://doi.org/10.1145/2632320.2632358

  25. Malmi, L., Simon, Sheard, J., Kinnunen, P., Sinclair, J.: The Evolution of Computing Education Research: A Meta-Analytic Perspective. In: M. Apiola, S. López-Pernas, M. Saqr (eds.) Past, Present and Future of Computing Education Research, Springer (2023)

    Google Scholar 

  26. Malmi, L., Utting, I., Ko, A.J.: Tools and Environments, pp. 639–662. The Cambridge Handbook of Computing Education Research. Cambridge University Press (2019). https://doi.org/10.1017/9781108654555.022

  27. Margulieux, L.E., Dorn, B., Searle, K.A.: Learning Sciences for Computing Education. In: S.A. Fincher, A.V. Robins (eds.) The Cambridge Handbook of Computing Education Research, chap. 8, pp. 208–230. Cambridge University Press, Cambridge (2019)

    Chapter  Google Scholar 

  28. McCracken, M., Almstrum, V., Diaz, D., Guzdial, M., Hagan, D., Kolikant, Y.B.D., Laxer, C., Thomas, L., Utting, I., Wilusz, T.: A Multi-national, Multi-institutional Study of Assessment of Programming Skills of First-year CS Students. In: Working group reports from ITiCSE on Innovation and technology in computer science education, ITiCSE-WGR ’01, pp. 125–180. ACM, New York, NY, USA (2001). URL http://doi.acm.org/10.1145/572133.572137

  29. Papamitsiou, Z., Giannakos, M., Simon, Luxton-Reilly, A.: Computing education research landscape through an analysis of keywords. In: Proceedings of the 2020 ACM Conference on International Computing Education Research, ICER ’20, pp. 102–112. Association for Computing Machinery, New York, NY, USA (2020). URL https://doi.org/10.1145/3372782.3406276

  30. Papert, S.: MINDSTORMS: Children, Computers, and Powerful Ideas. Basic Books (1980)

    Google Scholar 

  31. Pears, A., Seidman, S., Malmi, L., Mannila, L., Adams, E., Bennedsen, J., Devlin, M., Paterson, J.: A Survey of Literature on the Teaching of Introductory Programming. SIGCSE Bulletin 39, 204–223 (2007). URL http://doi.acm.org/10.1145/1345375.1345441

  32. Pears, A., Tedre, M., Valtonen, T., Vartiainen, H.: What makes computational thinking so troublesome? In: To Appear in FIE’21 Frontiers in Education Conference (2021)

    Google Scholar 

  33. Raji, I.D., Scheuerman, M.K., Amironesei, R.: You Can’t Sit With Us: Exclusionary Pedagogy in AI Ethics Education. In: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, FAccT ’21, pp. 515–525. Association for Computing Machinery, New York, NY, USA (2021). URL https://doi.org/10.1145/3442188.3445914

  34. Roberts, M.E., Stewart, B.M., Airoldi, E.M.: A model of text for experimentation in the social sciences. Journal of the American Statistical Association 111(515), 988–1003 (2016). URL https://doi.org/10.1080/01621459.2016.1141684

  35. Roberts, M.E., Stewart, B.M., Tingley, D.: Stm: An r package for structural topic models. Journal of Statistical Software 91(2) (2019). URL https://doi.org/10.18637/jss.v091.i02

  36. Roberts, M.E., Stewart, B.M., Tingley, D., Lucas, C., Leder-Luis, J., Gadarian, S.K., Albertson, B., Rand, D.G.: Structural topic models for open-ended survey responses. American Journal of Political Science 58(4), 1064–1082 (2014). URL https://doi.org/10.1111/ajps.12103

  37. Robins, A., Rountree, J., Rountree, N.: Learning and Teaching Programming: A Review and Discussion. Computer Science Education 13(2), 137–172 (2003)

    Article  Google Scholar 

  38. Robins, A.V.: Novice programmers and introductory programming. In: S.A. Fincher, A.V. Robins (eds.) The Cambridge Handbook of Computing Education Research, pp. 327–376. Cambridge University Press (2019). https://doi.org/10.1017/9781108654555.001

  39. Salton, G.: Information science in a ph.d. computer science program. Commun. ACM 12(2), 111–117 (1969). URL https://doi.org/10.1145/362848.362871

  40. Saqr, M., Ng, K., Oyelere, S.S., Tedre, M.: People, ideas, milestones: A scientometric study of computational thinking. ACM Trans. Comput. Educ. 21(3) (2021). URL https://doi.org/10.1145/3445984

  41. Shapiro, B., Fiebrink, R., Norvig, P.: How machine learning impacts the undergraduate computing curriculum. Communications of the ACM 61(11), 27–29 (2018)

    Article  Google Scholar 

  42. Simon: Emergence of computing education as a research discipline. Ph.D. thesis, Aalto University School of Science (2015)

    Google Scholar 

  43. Simon: Twenty-two years of ace. In: Proceedings of the Twenty-Second Australasian Computing Education Conference, ACE’20, pp. 203–210. Association for Computing Machinery, New York, NY, USA (2020). URL https://doi.org/10.1145/3373165.3373188

  44. Simon, Sheard, J.: Twenty-Four Years of ITiCSE Papers. In: Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education, ITiCSE ’20, pp. 5–11. Association for Computing Machinery, New York, NY, USA (2020). URL https://doi.org/10.1145/3341525.3387407

  45. Soloway, E.: Learning to Program = Learning to Construct Mechanisms and Explanations. Communications of the ACM 29(9), 850–858 (1986). URL http://doi.acm.org/10.1145/6592.6594

  46. Tedre, M., Denning, P., Toivonen, T.: Ct 2.0. In: 21st Koli Calling International Conference on Computing Education Research, Koli Calling ’21. Association for Computing Machinery, New York, NY, USA (2021). URL https://doi.org/10.1145/3488042.3488053

  47. Tedre, M., Denning, P., Toivonen, T.: Ct 2.0. In: 21st Koli Calling International Conference on Computing Education Research, Koli Calling ’21. Association for Computing Machinery, New York, NY, USA (2021). URL https://doi.org/10.1145/3488042.3488053

  48. Tedre, M., Simon, Malmi, L.: Changing aims of computing education: a historical survey. Computer Science Education 28(2), 158–186 (2018). URL https://doi.org/10.1080/08993408.2018.1486624

  49. Valentine, D.W.: Cs educational research: A meta-analysis of SIGCSE technical symposium proceedings. SIGCSE Bull. 36(1), 255–259 (2004). URL https://doi.org/10.1145/1028174.971391

  50. Valtonen, T., López-Pernas, S., Saqr, M., Vartiainen, H., Sointu, E.T., Tedre, M.: The nature and building blocks of educational technology research. Computers in Human Behavior 128, 107123 (2022). URL https://doi.org/10.1016/j.chb.2021.107123

  51. Vartiainen, H., Toivonen, T., Jormanainen, I., Kahila, J., Tedre, M., Valtonen, T.: Machine learning for middle schoolers: Learning through data-driven design. International Journal of Child-Computer Interaction 29, 100281 (2021). DOI https://doi.org/10.1016/j.ijcci.2021.100281.

  52. Vayansky, I., Kumar, S.A.: A review of topic modeling methods. Information Systems 94, 101582 (2020). URL https://doi.org/10.1016/j.is.2020.101582

  53. Vihavainen, A., Paksula, M., Luukkainen, M.: Extreme Apprenticeship Method in Teaching Programming for Beginners. In: Proceedings of the 42Nd ACM Technical Symposium on Computer Science Education, SIGCSE ’11, pp. 93–98. ACM, New York, NY, USA (2011). URL http://doi.acm.org/10.1145/1953163.1953196

  54. Wing, J.M.: Computational thinking. Communications of the ACM 49(3), 33–35 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mikko Apiola .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Apiola, M., Saqr, M., López-Pernas, S. (2023). The Evolving Themes of Computing Education Research: Trends, Topic Models, and Emerging Research. In: Apiola, M., López-Pernas, S., Saqr, M. (eds) Past, Present and Future of Computing Education Research . Springer, Cham. https://doi.org/10.1007/978-3-031-25336-2_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-25336-2_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-25335-5

  • Online ISBN: 978-3-031-25336-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics