Skip to main content
SpringerLink
Log in

Scientometrics: A Concise Introduction and a Detailed Methodology for Mapping the Scientific Field of Computing Education Research

  • Chapter
  • First Online:
Past, Present and Future of Computing Education Research

Abstract

Scientometrics has emerged as a research field for the evaluation and mapping of scientific fields, exploring research themes, collaboration clusters and identifying gaps and future trends. While early implementations have focused on quantitative metrics, recent directions emphasize a more nuanced approach that combines qualitative methods with quantitative analysis that triangulates several aspects, e.g., temporal trends, network, and semantic analysis. This chapter reviews scientometrics as a research methodology and discusses the strengths and weaknesses and how such weaknesses can be amended. The chapter also discusses the main methodological approach, and its theoretical underpinnings, used in some of the book chapters that make use of scientometrics as a means to map the field of CER.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Valtonen T, López-Pernas S, Saqr M, et al (2022) The nature and building blocks of educational technology research. Comput Human Behav 128:107123

    Article  Google Scholar 

  2. Priem J, Hemminger BH (2010) Scientometrics 2.0: New metrics of scholarly impact on the social Web. FMRI Tech Rep. https://doi.org/10.5210/fm.v15i7.2874

  3. Thijs B (2019) Science Mapping and the Identification of Topics: Theoretical and Methodological Considerations. In: Glänzel W, Moed HF, Schmoch U, Thelwall M (eds) Springer Handbook of Science and Technology Indicators. Springer International Publishing, Cham, pp 213–233

    Chapter  Google Scholar 

  4. van Raan A (2019) Measuring Science: Basic Principles and Application of Advanced Bibliometrics. In: Glänzel W, Moed HF, Schmoch U, Thelwall M (eds) Springer Handbook of Science and Technology Indicators. Springer International Publishing, Cham, pp 237–280

    Chapter  Google Scholar 

  5. Mingers J, Leydesdorff L (2015) A review of theory and practice in scientometrics. Eur J Oper Res 246:1–19

    Article  MATH  Google Scholar 

  6. Ivancheva L (2008) Scientometrics today: A methodological overview. Collnet j scientometr inf manag 2:47–56

    Google Scholar 

  7. Alan P (1969) Statistical Bibliography or Bibliometrics. Journal of Documentation 25:348–349

    Google Scholar 

  8. Broadus RN (1987) Toward a definition of “bibliometrics”. Scientometrics 12:373–379

    Article  Google Scholar 

  9. Hood WW, Wilson CS (2001). The literature of bibliometrics, scientometrics, and informetrics. Scientometrics 52:291–314

    Google Scholar 

  10. Abramo G, D’Angelo CA (2011) Evaluating research: from informed peer review to bibliometrics. Scientometrics 87:499–514

    Article  Google Scholar 

  11. Diekmann A, Näf M, Schubiger M (2012) The impact of (Thyssen)-awarded articles in the scientific community. Kolner Z Soz Sozpsychol 64:563–581

    Article  Google Scholar 

  12. Aksnes DW, Taxt RE (2004) Peer reviews and bibliometric indicators: a comparative study at a Norwegian university. Res Eval 13:33–41

    Article  Google Scholar 

  13. Garfield E (1955) Citation Indexes for Science: A New Dimension in Documentation Through Association of Ideas. American Association for the Advancement of Science

    Google Scholar 

  14. Hirsch JE (2005) An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences of the United States of America, 102(46):16569–16572. https://doi.org/10.1073/pnas.0507655102

  15. van Eck NJ, Waltman L (2014) Visualizing Bibliometric Networks. In: Ding Y, Rousseau R, Wolfram D (eds) Measuring Scholarly Impact: Methods and Practice. Springer International Publishing, Cham, pp 285–320

    Google Scholar 

  16. Saqr M, Poquet O, Lopez-Pernas S (2022) Networks in education: A travelogue through five decades. IEEE Access 10:32361–32380

    Article  Google Scholar 

  17. Perianes-Rodriguez A, Waltman L, van Eck NJ (2016) Constructing bibliometric networks: A comparison between full and fractional counting. J Informetr 10:1178–1195

    Article  Google Scholar 

  18. Apiola M, Tedre M, López-Pernas S, et al (2021) A Scientometric Journey Through the FIE Bookshelf: 1982-2020. In: Proceedings of the 2021 IEEE Frontiers in Education Conference (FIE). pp 1–9

    Google Scholar 

  19. Waltman L (2016) A review of the literature on citation impact indicators. J Informetr 10:365–391

    Article  Google Scholar 

  20. Ismail II, Saqr M (2022) A Quantitative Synthesis of Eight Decades of Global Multiple Sclerosis Research Using Bibliometrics. Front Neurol 13:845539

    Article  Google Scholar 

  21. Tyni J, Tarkiainen A, López-Pernas S, et al (2022) Games and Rewards: A Scientometric Study of Rewards in Educational and Serious Games. IEEE Access 10:31578–31585

    Article  Google Scholar 

  22. Hicks D, Wouters P, Waltman L, et al (2015) Bibliometrics: The Leiden Manifesto for research metrics. Nature 520:429–431

    Article  Google Scholar 

  23. Apiola M, Saqr M, López-Pernas S, Tedre M (2022) Computing Education Research Compiled: Keyword Trends, Building Blocks, Creators, and Dissemination. IEEE Access 10:27041–27068

    Article  Google Scholar 

  24. Apiola M, López-Pernas S, Saqr M, et al (2022) From a National Meeting to an International Conference: A Scientometric Case Study of a Finnish Computing Education Conference. IEEE Access 10:66576–66588

    Article  Google Scholar 

  25. Rethlefsen ML, Kirtley S, Waffenschmidt S, et al (2021) PRISMA-S: an extension to the PRISMA statement for reporting literature searches in systematic reviews. J Med Libr Assoc 109:174–200

    Article  Google Scholar 

  26. Norris M, Oppenheim C (2007) Comparing alternatives to the Web of Science for coverage of the social sciences’ literature. J Informetr 1:161–169

    Article  Google Scholar 

  27. Singh VK, Singh P, Karmakar M, et al (2021) The journal coverage of Web of Science, Scopus and Dimensions: A comparative analysis. Scientometrics 126:5113–5142

    Article  Google Scholar 

  28. Baas J, Schotten M, Plume A, et al (2020) Scopus as a curated, high-quality bibliometric data source for academic research in quantitative science studies. Quantitative Science Studies 1:377–386

    Article  Google Scholar 

  29. Aria M, Cuccurullo C (2017) bibliometrix: An R-tool for comprehensive science mapping analysis. J Informetr 11:959–975

    Article  Google Scholar 

  30. OpenRefine. https://openrefine.org/. Accessed 2 May 2022

  31. Clustering methods in-depth. https://docs.openrefine.org/next/technical-reference/clustering-in-depth. Accessed 2 May 2022

  32. Patil I (2021) Visualizations with statistical details: The ‘ggstatsplot’ approach. Journal of Open Source Software 6(61):3167. https://doi.org/10.21105/joss.03167

  33. Apiola M, López-Pernas S, Saqr M (2023) The Venues that Shaped Computing Education Research: The Gatekeepers Under the Lens. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer

    Google Scholar 

  34. Apiola M, López-Pernas S, Saqr M (2023) The Evolving Themes of Computing Education Research: Trends, Topic Models, and Emerging Research. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer

    Google Scholar 

  35. Wickham H, Wickham MH (2007) The ggplot package. URL: https://cran r-project org/web/packages/ggplot2/index html

    Google Scholar 

  36. Bastian M, Heymann S, Jacomy M (2009) Gephi: an open source software for exploring and manipulating networks. In: Proceedings of the third international AAAI conference on weblogs and social media. AAAI Press, Menlo Park, CA, pp 361–362

    Google Scholar 

  37. Fruchterman TMJ, Reingold EM (1991) Graph drawing by force-directed placement. Softw Pract Exp 21:1129–1164

    Article  Google Scholar 

  38. De Meo P, Ferrara E, Fiumara G, Provetti A (2011) Generalized Louvain method for community detection in large networks. In: 2011 11th International Conference on Intelligent Systems Design and Applications. IEEE

    Google Scholar 

  39. Apiola M, López-Pernas S, Saqr M (2023) The Hands that Made Computing Education Research: Top Authors, Networks, Collaboration and Newcomers. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer

    Google Scholar 

  40. Malmi L, Hellas A, Ihantola P, et al (2023) Computing Education Research in Finland. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer

    Google Scholar 

  41. Becker B, Bradley S, Sentance S, et al (2023) CER in the UK and Ireland. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer

    Google Scholar 

  42. Malmi L, Simon, Sheard J, et al (2023) The Evolution of CER: A Meta-Analytic Perspective. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer

    Google Scholar 

  43. Daniels M, Berglund A, Pears A (2023) A Case Study: The Uppsala Computing Education Research Group (UpCERG). In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer

    Google Scholar 

  44. Saqr M, López-Pernas S, Apiola M (2023) The Impact and Chatter About Computing Education Research across the Social Media, News, Patents and Blogs: The Case of Altmetrics. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer

    Google Scholar 

  45. Association for Computing Machinery ACM Curricula recommendations. https://www.acm.org/education/curricula-recommendations. Accessed 14 Aug 2022

Download references

Author information

Authors and Affiliations

  1. University of Eastern Finland, Joensuu, Finland

    Sonsoles López-Pernas, Mohammed Saqr & Mikko Apiola

Authors
  1. Sonsoles López-Pernas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammed Saqr
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mikko Apiola
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sonsoles López-Pernas .

Editor information

Editors and Affiliations

  1. University of Eastern Finland, Joensuu, Finland

    Mikko Apiola

  2. University of Eastern Finland, Joensuu, Finland

    Sonsoles López-Pernas

  3. University of Eastern Finland, Joensuu, Finland

    Mohammed Saqr

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

López-Pernas, S., Saqr, M., Apiola, M. (2023). Scientometrics: A Concise Introduction and a Detailed Methodology for Mapping the Scientific Field of Computing Education Research. In: Apiola, M., López-Pernas, S., Saqr, M. (eds) Past, Present and Future of Computing Education Research . Springer, Cham. https://doi.org/10.1007/978-3-031-25336-2_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-25336-2_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-25335-5

  • Online ISBN: 978-3-031-25336-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation