Skip to main content

Advertisement

SpringerLink
Log in

Meta-analysis of the impact of geospatial technologies on learning outcomes

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

Many scholars have been using geospatial technologies (GST) to improve students’ learning outcomes in the Web 2.0 age. However, many studies focus on the effectiveness of GST on cognitive domain of learning outcomes, which poses challenges to GST efficacy evaluation. This study aims to examine the effectiveness of GST on students’ learning outcomes and identify potential moderators through meta-analysis. The results indicate that GST has a positive effect on students’ learning outcomes on a medium scale, while its effects on the cognitive domain were more significant than the non-cognitive domain. Moreover, we identified variable factors such as participant’s country/region, education level, intervention duration, and type of geospatial technology to analyze whether the four moderator variables had an impact on the effectiveness of GST. The moderator analysis results show that GST’s effectiveness on students’ learning outcomes depended on participants’ country/region, intervention duration and type of geospatial technology. This means that participants’ country/region, intervention duration and type of geospatial technology had a significant effect on GST’s effectiveness, while students’ education level did not have a major impact. Thus, geography educators should promote a pedagogical model with GST, and take into account the individuals’ country/region, while setting a reasonable intervention time of using GST in teaching. Teachers should also be flexible in using different types of geospatial technologies to achieve positive students’ learning outcomes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Availability of data and materials

All data generated or analysed during this study are included in this published article.

References

  • Aladağ, E. (2010). ‘The effects of GIS on students’ academic achievement and motivation in seventh-grade social studies lessons in Turkey’, International Research in Geographical and Environmental Education, 19(1), pp. 11–23. Available at: https://doi.org/10.1080/10382040903545476.

  • American Association for the Advancement of Science (2018). What are geospatial technologies? | American Association for the Advancement of Science. Available at: https://www.aaas.org/programs/scientific-responsibility-human-rights-law/overview-geospatial-project (Accessed: 14 October 2022).

  • Baker, T. R., & White, S. H. (2003). ‘The Effects of G.I.S. on Students’ Attitudes, Self-efficacy, and Achievement in Middle School Science Classrooms’, Journal of Geography, 102(6), pp. 243–254. Available at: https://doi.org/10.1080/00221340308978556.

  • Bednarz, S. W., & van der Schee, J. (2006). ‘Europe and the United States: the implementation of geographic information systems in secondary education in two contexts’, Technology, Pedagogy and Education, 15(2), pp. 191–205. Available at: https://doi.org/10.1080/14759390600769573.

  • Benimmas, A., Kerski, J., & Solís, P. (2011). ‘The impact of a geographic technologies professional development institute on Middle Eastern and North African teachers’, International Research in Geographical and Environmental Education, 20(1), pp. 21–45. Available at: https://doi.org/10.1080/10382046.2011.540101.

  • Borenstein, M. (2021). Introduction to meta-analysis. Second edition. Hoboken: Wiley.

  • Carbonell Carrera, C., & Asensio, B. (2017). Luis Alberto ‘Augmented reality as a digital teaching environment to develop spatial thinking’, Cartography and Geographic Information Science, 44(3), pp. 259–270. Available at: https://doi.org/10.1080/15230406.2016.1145556.

  • Carbonell Carrera, C., & Bermejo Asensio, Luis, A. (2017). ‘Landscape interpretation with augmented reality and maps to improve spatial orientation skill’, Journal of Geography in Higher Education, 41(1), pp. 119–133. Available at: https://doi.org/10.1080/03098265.2016.1260530.

  • Carbonell-Carrera, C., & Hess-Medler, S. (2019). ‘Interactive Visualization Software to Improve Relief Interpretation Skills: Spatial Data Infrastructure Geoportal versus Augmented Reality’, The Professional Geographer, 71(4), pp. 725–737. Available at: https://doi.org/10.1080/00330124.2019.1595064.

  • Castro, M. (2015). ‘Parental involvement on student academic achievement: A meta-analysis’, Educational Research Review, 14, pp. 33–46. Available at: https://doi.org/10.1016/j.edurev.2015.01.002.

  • Clark, A. M., Monk, J., & Yool, S. R. (2007). ‘GIS Pedagogy, Web-based Learning and Student Achievement’, Journal of Geography in Higher Education, 31(2), pp. 225–239. Available at: https://doi.org/10.1080/03098260601063677.

  • Cleophas, T. J., & Zwinderman, A. H. (2017). Modern Meta-Analysis: Review and Update of Methodologies. Cham: Springer International Publishing. Available at: https://doi.org/10.1007/978-3-319-55895-0.

  • Collins, L. (2018). ‘The Impact of Paper Versus Digital Map Technology on Students’ Spatial Thinking Skill Acquisition’, Journal of Geography, 117(4), pp. 137–152. Available at: https://doi.org/10.1080/00221341.2017.1374990.

  • Cook, D. A., Reed, D. A., & Quality of Medical Education Research Methods. (2015). ‘Appraising the : The Medical Education Research Study Quality Instrument and the Newcastle–Ottawa Scale-Education’, Academic Medicine, 90(8), p. 1067. Available at: https://doi.org/10.1097/ACM.0000000000000786.

  • De Miguel González, R., & De Lázaro Torres, M. L. (2020). ‘WebGIS Implementation and Effectiveness in Secondary Education Using the Digital Atlas for Schools’, Journal of Geography, 119(2), pp. 74–85. Available at: https://doi.org/10.1080/00221341.2020.1726991.

  • Deeks, J. J., Higgins, J. P., & Altman, D. G. (2008). ‘Analysing Data and Undertaking Meta-Analyses’, in J.P. Higgins and S. Green (eds) Cochrane Handbook for Systematic Reviews of Interventions. Chichester, UK: John Wiley & Sons, Ltd, pp. 243–296. Available at: https://doi.org/10.1002/9780470712184.ch9.

  • Edsall, R., & Wentz, E. (2007). ‘Comparing Strategies for Presenting Concepts in Introductory Undergraduate Geography: Physical Models vs. Computer Visualization’, Journal of Geography in Higher Education, 31(3), pp. 427–444. Available at: https://doi.org/10.1080/03098260701513993.

  • Favier, T. T. (2011). Geographic information systems in inquiry-based secondary geography education: Theory & practice. Amsterdam: VU University Amsterdam.

    Google Scholar 

  • Favier, T. T., & van der Schee, J. A. (2014). ‘The effects of geography lessons with geospatial technologies on the development of high school students’ relational thinking’, Computers & Education, 76, pp. 225–236. Available at: https://doi.org/10.1016/j.compedu.2014.04.004.

  • Feeley, T. H. (2020). ‘Assessing Study Quality in Meta-Analysis’, Human Communication Research, 46(2–3), pp. 334–342. Available at: https://doi.org/10.1093/hcr/hqaa001.

  • Goldstein, D., & Alibrandi, M. (2013). ‘Integrating GIS in the Middle School Curriculum: Impacts on Diverse Students’ Standardized Test Scores’, Journal of Geography, 112(2), pp. 68–74. Available at: https://doi.org/10.1080/00221341.2012.692703.

  • S. Goldstein, & J. A. Naglieri (Eds.) (2011), ‘Meta-Analysis’, in Encyclopedia of Child Behavior and Development. Boston, MA: Springer, US pp. 945–946. Available at: https://doi.org/10.1007/978-0-387-79061-9_1771.

  • Hedges, L. V. (1981). ‘Distribution Theory for Glass’s Estimator of Effect size and Related Estimators’, Journal of Educational Statistics, 6(2), pp. 107–128. Available at: https://doi.org/10.3102/10769986006002107.

  • Higgins, J. P. T. (2003). ‘Measuring inconsistency in meta-analyses’, BMJ, 327(7414), pp. 557–560. Available at: https://doi.org/10.1136/bmj.327.7414.557.

  • Hofierka, J. (2022). ‘A tangible landscape modeling system for geography education’, Education and Information Technologies, 27(4), pp. 5417–5435. Available at: https://doi.org/10.1007/s10639-021-10847-y.

  • Hong, J. E., & Melville, A. (2018). ‘Training Social Studies Teachers to Develop Inquiry-Based GIS Lessons’, Journal of Geography, 117(6), pp. 229–244. Available at: https://doi.org/10.1080/00221341.2017.1371205.

  • Huang, K. H. (2011). ‘A GIS-Interface Web Site: Exploratory Learning for Geography Curriculum’, Journal of Geography, 110(4), pp. 158–165. Available at: https://doi.org/10.1080/00221341.2011.542474.

  • Jang, D. H., Yi, P., & Shin, I. S. (2016). ‘Examining the Effectiveness of Digital Textbook use on Students’ Learning Outcomes in South Korea: A Meta-analysis’, The Asia-Pacific Education Researcher, 25(1), pp. 57–68. Available at: https://doi.org/10.1007/s40299-015-0232-7.

  • Jeno, L. M. (2019). ‘Testing the novelty effect of an m-learning tool on internalization and achievement: A Self-Determination Theory approach’, Computers & Education, 128, pp. 398–413. Available at: https://doi.org/10.1016/j.compedu.2018.10.008.

  • Jo, I., Hong, J. E., & Verma, K. (2016a). ‘Facilitating spatial thinking in world geography using Web-based GIS’, Journal of Geography in Higher Education, 40, pp. 1–18. Available at: https://doi.org/10.1080/03098265.2016.1150439.

  • Jo, I., Hong, J. E., & Verma, K. (2016b). ‘Facilitating spatial thinking in world geography using Web-based GIS’, Journal of Geography in Higher Education, 40(3), pp. 442–459. Available at: https://doi.org/10.1080/03098265.2016.1150439.

  • Kerski, J. J., Demirci, A., & Milson, A. J. (2013). ‘The Global Landscape of GIS in Secondary Education’, Journal of Geography, 112(6), pp. 232–247. Available at: https://doi.org/10.1080/00221341.2013.801506.

  • Kim, M. (2011). EFFECTS OF A GIS COURSE ON THREE COMPONENTS OF SPATIAL LITERACY. Texas A&M University.

  • Kim, M., & Bednarz, R. (2013). ‘Development of critical spatial thinking through GIS learning’, Journal of Geography in Higher Education, 37(3), pp. 350–366. Available at: https://doi.org/10.1080/03098265.2013.769091.

  • Kulo, V. A., & Bodzin, A. M. (2011). ‘Integrating Geospatial Technologies in an Energy Unit’, Journal of Geography, 110(6), pp. 239–251. Available at: https://doi.org/10.1080/00221341.2011.566344.

  • Lee, J., & Bednarz, R. (2009). ‘Effect of GIS Learning on Spatial Thinking’, Journal of Geography in Higher Education, 33(2), pp. 183–198. Available at: https://doi.org/10.1080/03098260802276714.

  • Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis (49v. vol.). Thousand Oaks, Calif: Sage Publications. (Applied social research methods series.

    Google Scholar 

  • Littell, J. H., Corcoran, J., & Pillai, V. K. (2008). Systematic reviews and meta-analysis. Oxford; New York: Oxford University Press. (Pocket guides to social work research methods).

    Book  Google Scholar 

  • Liu, Y. (2010). ‘PBL-GIS in Secondary Geography Education: Does It Result in Higher-Order Learning Outcomes?’, Journal of Geography, 109(4), pp. 150–158. Available at: https://doi.org/10.1080/00221341.2010.497541.

  • Madsen, L. M., Christiansen, F., & Rump, C. (2014). ‘Students individual engagement in GIS’, Journal of Geography in Higher Education, 38(2), pp. 251–265. Available at: https://doi.org/10.1080/03098265.2014.910758.

  • Madsen, L. M., & Rump, C. (2012). ‘Considerations of How to Study Learning Processes when Students use GIS as an Instrument for Developing Spatial Thinking Skills’, Journal of Geography in Higher Education, 36(1), pp. 97–116. Available at: https://doi.org/10.1080/03098265.2011.576336.

  • Manson, S. (2014). ‘Resource Needs and Pedagogical Value of Web Mapping for Spatial Thinking’, Journal of Geography, 113(3), pp. 107–117. Available at: https://doi.org/10.1080/00221341.2013.790915.

  • Mayer, R. (2020). Multimedia Learning. 3rd edn. Cambridge University Press. Available at: https://doi.org/10.1017/9781316941355.

  • Metoyer, S., & Bednarz, R. (2017). ‘Spatial Thinking Assists Geographic Thinking: Evidence from a Study Exploring the Effects of Geospatial Technology’, Journal of Geography, 116(1), pp. 20–33. Available at: https://doi.org/10.1080/00221341.2016.1175495.

  • Millar, G. C. (2018). ‘Tangible Landscape: A Hands-on Method for Teaching Terrain Analysis’, in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. CHI ’18: CHI Conference on Human Factors in Computing Systems, Montreal QC Canada: ACM, pp. 1–12. Available at: https://doi.org/10.1145/3173574.3173954.

  • Milson, A. J., Demirci, A., & Kerski, J. J. (Eds.). (2012). International perspectives on teaching and learning with GIS in secondary schools. Dordrecht; New York: Springer.

    Google Scholar 

  • Milson, A. J., & Earle, B. D. (2008). ‘Internet-Based GIS in an Inductive Learning Environment: A Case Study of Ninth-Grade Geography Students’, Journal of Geography, 106(6), pp. 227–237. Available at: https://doi.org/10.1080/00221340701851274.

  • Muka, T. (2020). ‘A 24-step guide on how to design, conduct, and successfully publish a systematic review and meta-analysis in medical research’, European Journal of Epidemiology, 35(1), pp. 49–60. Available at: https://doi.org/10.1007/s10654-019-00576-5.

  • National Research Council (2006). Learning to Think Spatially: GIS as a Support System in the K-12 Curriculum. Washington, D.C.: National Academies Press, p. 11019. Available at: https://doi.org/10.17226/11019.

  • Pedersen, P., Farrell, P., & McPhee, E. (2005). ‘Paper versus Pixel: Effectiveness of Paper versus Electronic Maps To Teach Map Reading Skills in an Introductory Physical Geography Course’, Journal of Geography, 104(5), pp. 195–202. Available at: https://doi.org/10.1080/00221340508978984.

  • Perugini, S., & Bodzin, A. M. (2020). ‘Using Web-Based GIS to Assess Students’ Geospatial Knowledge of Hurricanes and Spatial Habits of Mind’, Journal of Geography, 119(2), pp. 63–73. Available at: https://doi.org/10.1080/00221341.2019.1710764.

  • Reed, D. A. (2007). ‘Association between funding and quality of published medical education research’, Jama-Journal of the American Medical Association, 298(9), pp. 1002–1009. Available at: https://doi.org/10.1001/jama.298.9.1002.

  • Ridha, S., & Kamil, P. A. (2021). ‘The Problems of Teaching Geospatial Technology in Developing Countries: Concepts, Curriculum, and Implementation in Indonesia’, Journal of Geography, 120(2), pp. 72–82. Available at: https://doi.org/10.1080/00221341.2021.1872681.

  • van der Schee, J. (2015). ‘Digital Geography Education in the Twenty-First Century: Needs and Opportunities’, in O. Muñiz Solari, A. Demirci, and J. Schee (eds) Geospatial Technologies and Geography Education in a Changing World: Geospatial Practices and Lessons Learned. Tokyo: Springer Japan (Advances in Geographical and Environmental Sciences), pp. 11–20. Available at: https://doi.org/10.1007/978-4-431-55519-3_2.

  • Schneps, M. H. (2014). ‘Conceptualizing astronomical scale: Virtual simulations on handheld tablet computers reverse misconceptions’, Computers & Education, 70, pp. 269–280. Available at: https://doi.org/10.1016/j.compedu.2013.09.001.

  • Schulze, U. (2021). ‘“GIS works!”—But why, how, and for whom? Findings from a systematic review’, Transactions in GIS, 25(2), pp. 768–804. Available at: https://doi.org/10.1111/tgis.12704.

  • Shellito, B. A. (2018). Introduction to geospatial technologies. Fourth edition. New York: W. H. Freeman.

  • Songer, L. C. (2010). ‘Using Web-Based GIS in Introductory Human Geography’, Journal of Geography in Higher Education, 34(3), pp. 401–417. Available at: https://doi.org/10.1080/03098265.2010.487202.

  • Stoddard, R. H. (1973). Planning College Geography Facilities: Guidelines for space and equipment. Washington, D.C: Association of American Geographers.

    Google Scholar 

  • Sweller, J. (2020). ‘Cognitive load theory and educational technology’, Educational Technology Research and Development, 68(1), pp. 1–16. Available at: https://doi.org/10.1007/s11423-019-09701-3.

  • Tate, N. J., & Jarvis, C. H. (2017). ‘Changing the face of GIS education with communities of practice’, Journal of Geography in Higher Education, 41(3), pp. 327–340. Available at: https://doi.org/10.1080/03098265.2017.1315534.

  • Thalheimer, W., & Cook, S. (2002). ‘How to calculate effect sizes from published research: A simplified methodology’, Work-Learning Research, p. 109.

  • Tobin, K. G. (Ed.). (2012). ‘Constructivism as a Referent for Teaching and Learning’, in The Practice of Constructivism in Science Education. Routledge, pp. 19–38. Available at: https://doi.org/10.4324/9780203053409-6.

  • Watson, P. (2002). ‘The Role and Integration of Learning Outcomes into the Educational Process’, Active Learning in Higher Education, 3(3), pp. 205–219. Available at: https://doi.org/10.1177/1469787402003003002.

  • Woods, T. L. (2016). ‘Pilot Study Using the Augmented Reality Sandbox to Teach Topographic Maps and Surficial Processes in Introductory Geology Labs’, Journal of Geoscience Education, 64(3), pp. 199–214. Available at: https://doi.org/10.5408/15-135.1.

  • Wu, B., Yu, X., & Gu, X. (2020). ‘Effectiveness of immersive virtual reality using head-mounted displays on learning performance: A meta-analysis’, British Journal of Educational Technology, 51(6), pp. 1991–2005. Available at: https://doi.org/10.1111/bjet.13023.

  • Xefteris, S., Palaigeorgiou, G., & Tsorbari, A. (2019). ‘A Learning Environment for Geography and History Using Mixed Reality, Tangible Interfaces and Educational Robotics’, in M.E. Auer and T. Tsiatsos (eds) The Challenges of the Digital Transformation in Education. Cham: Springer International Publishing (Advances in Intelligent Systems and Computing), pp. 106–117. Available at: https://doi.org/10.1007/978-3-030-11935-5_11.

  • Xiang, X., & Liu, Y. (2019). ‘Exploring and enhancing spatial thinking skills: Learning differences of university students within a web-based GIS mapping environment’, British Journal of Educational Technology, 50(4), pp. 1865–1881. Available at: https://doi.org/10.1111/bjet.12677.

Download references

Acknowledgements

All author approved the manuscript.

Author information

Author notes

  1. Qianyi Ma

    Present address: School of Geographic Sciences, Faculty of Earth Sciences, East China Normal University, 500 Dongchuan Road, Minhang District, Shanghai, 200241, China

  2. Zeyang Yao

    Present address: School of Geographical Sciences, Hunan Normal University, 36 Lushan Road, Changsha, 410081, China

Authors and Affiliations

  1. School of Geographic Sciences, Faculty of Earth Sciences, East China Normal University, 500 Dongchuan Road, Minhang District, Shanghai, 200241, China

    Yushan Duan

Authors
  1. Qianyi Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yushan Duan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zeyang Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yushan Duan.

Ethics declarations

Conflict of interest

We have no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ma, Q., Duan, Y. & Yao, Z. Meta-analysis of the impact of geospatial technologies on learning outcomes. Educ Inf Technol 28, 15739–15764 (2023). https://doi.org/10.1007/s10639-023-11712-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-023-11712-w

Keywords

Search

Navigation