Skip to main content

Advertisement

Log in

ICT use in mathematics lessons and the mathematics achievement of secondary school students by international comparison: Which role do school level factors play?

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

By means of an international comparison, the research presented in the article aims to identify supporting and hindering school level factors for the use of ICT in secondary school mathematics lessons. The relationship between ICT use and the performance of Grade 9 students in mathematics is examined and further integrated into a multi-level model including school level factors. Against the background of a theoretical allocation (1) the IT equipment of schools, (2) school leadership, (3) aspects of school goals and educational strategies as well as (4) teachers’ attitudes will be analyzed by means of a multi-level regression model as well as a multi-level path model including the mathematics achievement of students as measured in the context of PISA 2012. Representative school and student data from five countries, namely Australia, Germany, the Netherlands, Norway and Singapore are taken into consideration, as the integration of ICT in teaching and learning is firmly emphasized in these countries (overall 24,579 students in 1263 schools). By modeling the complex structure, school characteristics are examined with respect to their effect on the use of ICT for mathematics teaching. Moreover, the relation between different factors and students’ mathematics achievement will be synchronously assessed in the different educational systems. The results show that characteristics at school level do play a major role in the integration of ICT into teaching and learning and turn out to be relevant across the educational systems. In addition to further in-depth country-specific findings, the results point to cross-national future challenges in the field of using technologies to enhance teaching and learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. Due to insufficient response rates, the results for Germany were not taken into consideration.

  2. A systematization of studies on the effect of technologies on learning, with a focus on the comparison of computer-based and traditional teaching, is presented by Tamim, Bernard, Borokhovski, Abrami and Schmid (2011).

References

  • Abuhmaid, A. (2011). ICT training courses for teacher professional development in Jordan. The Turkish Online Journal of Educational Technology., 10(4), 195–210.

    Google Scholar 

  • Albion, P. R., Tondeur, J., Forkosh-Baruch, A., & Peeraer, J. (2015). Teachers‘ professional development for ICT integration: towards a reciprocal relationship between research and practice. Education and Information Technologies, 20(4), 655–673.

    Article  Google Scholar 

  • Anderson, R., & Ainley, J. (2010). Technology and learning: access in schools around the world. In B. McGaw, E. Baker, & P. Peterson (Eds.), International encyclopaedia of education (3rd ed., pp. 21–33). Amsterdam: Elsevier.

    Chapter  Google Scholar 

  • Anderson, R. E., & Dexter, S. L. (2000). School technology leadership: Incidence and impact on: Teaching, learning, and computing 1998 survey, report no. 6. Irvine, CA: Center for Research on Information, Technology, and Organizations at University of California.

    Google Scholar 

  • Aydin, E. (2005). The use of computers in mathematics education: a paradigm shift from “computer assisted instruction” towards “student programming”. The Turkish Online Journal of Educational Technology, 4(2), 27–34.

    MathSciNet  Google Scholar 

  • Barzel, B. (2011). New technology? New ways of teaching – no time left for that! International Journal for Technology in Mathematics Education, 14(2), 77–86.

    Google Scholar 

  • Barzel, B., Hußmann, S. & Leuders, T. (Hrsg.) (2005). Computer, Internet & Co. im Mathematikunterricht [computers, internet & Co. in mathematics lessons]. Berlin: Cornelsen Scriptor.

  • Baumert, J., Blum, W., & Neubrand, M. (2004). Drawing lessons from PISA 2000. Zeitschrift für Erziehungswissenschaft, 7(3rd Supplement), 143–157.

    Google Scholar 

  • Bayturan, S., & Kesan, C. (2012). The effect of computer-assisted instruction on the achievement and attitudes towards mathematics of students in mathematics education. International Journal of Global Education, 1(2), 50–57.

    Google Scholar 

  • Blamire, R. (2009). ICT impact data at primary school level: the STEPS approach. In F. Scheuermann & F. Pedró (Eds.), Assessing the effects of ICT in education (pp. 199–211). Luxemburg: European Commission / OECD.

    Google Scholar 

  • Celik, V., & Yesilyurt, E. (2013). Attitudes to technology, perceived computer self-efficacy and computer anxiety as predictors of computer supported education. Computers & Education, 60(1), 148–158.

    Article  Google Scholar 

  • Cheung, A. C. K., & Slavin, R. E. (2013). The effectiveness of educational technology applications for enhancing mathematics achievement in K-12 classrooms: a meta-analysis. Educational Research Review, 9, 88–113.

    Article  Google Scholar 

  • Creemers, B. P. M., & Kyriakides, L. (2008). The dynamics of educational effectiveness. In A contribution to policy, practice and theory in contemporary schools. Abingdon: Routledge.

    Google Scholar 

  • Davis, N., Eickelmann, B., & Zaka, P. (2013). Restructuring of educational systems in the digital age from a co-evolutionary perspective. Journal of Computer Assisted Learning, 29(5), 438–450.

    Article  Google Scholar 

  • Dawson, C., & Rakes, G. C. (2003). The influence of principals’ technology training on the integration of technology into schools. Journal of Research on Technology in Education, 36(1), 29–49.

    Article  Google Scholar 

  • Dexter, S. (2008). Leadership for IT in schools. In J. Voogt & G. Knezek (Eds.), International handbook of information technology in primary and secondary education (pp. 543–554). New York: Springer.

    Chapter  Google Scholar 

  • Dexter, S. L., Anderson, R. E., & Becker, H. J. (1999). Teachers’ views of computers as catalysts for changes in their teaching practice. Journal of Research on Computing in Education, 31(3), 221–239.

    Article  Google Scholar 

  • Drossel, K., Eickelmann, B. & Gerick, J. (2016). Predictors of teachers‘ use of ICT in school – the relevance of school characteristics, teachers‘ attitudes and teacher collaboration. Education and Information Technologies, 1–23. doi:10.1007/s10639-016-9476-y

  • Dynarski, M., Agodini, R., Heaviside, S., Novak, T., Carey, N., Campuzano, L., Means, B., Murphy, R., Penuel, W., Javitz, H., Emery, D., & Sussex, W. (2007). Effectiveness of Reading and Mathematics Software Products: Findings from the First Student Cohort. [Online] Washington, D.C.: U.S. Department of Education. http://ies.ed.gov/ncee/pdf/20074005.pdf [Accessed 11th November 2015].

  • Eickelmann, B. (2011). Supportive and hindering factors to a sustainable implementation of ICT in schools. Journal for Educational Research Online, 3(1), 75–103.

    Google Scholar 

  • Eickelmann, B., & Schulz-Zander, R. (2008). Schuleffektivität, Schulentwicklung und digitale Medien [school effectiveness, school development and digital media]. In W. Bos, H. G. Holtappels, H. Pfeiffer, H.-G. Rolff, & R. Schulz-Zander (Eds.), Jahrbuch der Schulentwicklung, Bd. 15. Daten – Beispiele – Perspektiven [yearbook of school development, vol. 15. Data – examples – perspectives] (pp. 157–194). Juventa: Weinheim.

    Google Scholar 

  • Enders, C. K. (2010). Applied missing data analyses. New York: Guilford.

    Google Scholar 

  • Ertmer, P. A. (2005). Teacher pedagogical beliefs: the final frontier in our quest for technology integration? Educational Technology Research and Development, 53(4), 25–39.

    Article  Google Scholar 

  • European Commission (2013). Survey of schools: ICT in Education. Benchmarking access, use and attitudes to technology in Europe’s schools. Final report. [Online]. http://ec.europa.eu/digital-agenda/en/news/survey-schools-ict-education [Accessed 09th September 2014].

  • European Commission (2014). The International Computer and Information Literacy Study (ICILS). Main findings and implications for the education policies in Europe. [Online] Brussels. http://ec.europa.eu/education/library/study/2014/ec-icils_en.pdf [Accessed 10th November 2015].

  • Fraillon, J., Schulz, W. & Ainley, J. (2013). International Computer and Information Literacy Study: Assessment framework. Amsterdam: International Association for the Evaluation of Educational Achievement (IEA). [Online] https://www.acer.edu.au/files/ICILS_2013_Framework.pdf [Accessed 11th November 2015].

  • Fraillon, J., Ainley, J., Schulz, W., Friedman, T. & Gebhardt, E. (2014). Preparing for life in a digital age. The IEA International Computer and Information Literacy Study international report. [Online] Springer. http://www.iea.nl/fileadmin/user_upload/Publications/ Electronic_versions/ICILS_2013_International_Report.pdf [Accessed 10th November 2015].

  • Fuchs, T., & Woessmann, L. (2005). Computers and student learning: Bivariate and multivariate evidence on the availability and use of computers at home and at school. ifo Working Papers, 8. [Online] https://www.cesifo-group.de/DocDL/IfoWorkingPaper-8.pdf [Accessed 10th November 2015].

  • Galanouli, D., Murphy, C., & Gardner, J. (2004). Teachers’ perceptions of the effectiveness of ICT-competence training. Computers & Education, 43(1), 63–79.

    Article  Google Scholar 

  • Harrison, C., Lunzer, E., Tymms, P., Fitz-Gibbon, C., & Restorick, J. (2004). Use of ICT and its relationship with performance in examinations: a comparison of the ImpaCT2 project’s research findings using pupil-level, school-level and multilevel modelling data. Journal of Computer Assisted Learning, 20, 319–337.

    Article  Google Scholar 

  • Hatlevik, O. E., & Arnseth, H. C. (2012). ICT, teaching and leadership: how do teachers experience the importance of ICT-supportive school leaders? Nordic Journal of Digital Literacy, 7(1), 55–69.

    Google Scholar 

  • Hattie, J. (2009). Visible learning. A synthesis of over 800 meta-analyses relating to achievement. New York: Routledge.

    Google Scholar 

  • Heo, H., & Kang, M. (2009). Impacts of ICT use on school learning outcome. In F. Scheuermann & F. Pedró (Eds.), Assessing the effects of ICT in education (pp. 189–198). Luxemburg: European Commission / OECD.

    Google Scholar 

  • Hox, J. J., & Roberts, J. K. (2011). Handbook of advanced multilevel analysis. New York: Routledge.

    Google Scholar 

  • Hsu, S., & Kuan, P.-Y. (2013). The impact of multilevel factors on technology integration: the case of Taiwanese grade 1-9 teachers and schools. Educational Technology Research and Development, 61, 25–50.

    Article  Google Scholar 

  • Hughes, M., & Zachariah, S. (2001). An investigation into the relationship between effective administrative leadership styles and the use of technology. International Electronic Journal for Leadership in Learning, 5(5), 1–11.

    Google Scholar 

  • Kadijevich, D. M. (2015). A dataset from TIMSS to examine the relationship between computer use and mathematics achievement. British Journal of Educational Technology, 46(5), 984–987.

    Article  Google Scholar 

  • Kafyulilo, A., Fisser, P., & Voogt, J. (2015). Factors affecting teachers‘continuation of technology use in teaching. Education and Information Technologies. doi:10.1007/s10639-015-9398-0.

    Google Scholar 

  • Kang, M., Heo, H., & Kim, M. (2011). The impact of ICT use on new millennium learners’ educational performance. Interactive Technology and Smart Education, 8(1), 18–27.

    Article  Google Scholar 

  • Koehler, M. J., & Mishra, P. (2008). Introducing TPCK. In AACTE Committee on Innovation and Technology. In Handbook of technological pedagogical content knowledge (TPCK) for educators (pp. 3–29). New York: Routledge.

    Google Scholar 

  • Lal, C. (2014). Attitudinal study of user and non-user teachers’ towards ICT in relation to their school teaching subjects. Universal Journal of Educational Research, 2(3), 213–218.

    Google Scholar 

  • Law, N., & Chow, A. (2008). Teacher characteristics, contextual factors, and how these affect the pedagogical use of ICT. In N. Law, W. J. Pelgrum, & T. Plomp (Eds.), Pedagogy and ICT use in schools around the world. Findings from the IEA-SITES 2006 (pp. 182–221). CERC-Springer: Hong Kong.

    Google Scholar 

  • Law, N., Pelgrum, W. J., & Plomp, T. (2008). Pedagogy and ICT use in schools araound the world. In Findings from the IEA SITES 2006 study. Hong Kong: CERC-Springer.

    Google Scholar 

  • Lawson, T., & Comber, C. (1999). Superhighways technology: personnel factors leading to successful integration of information and communications technology in schools and colleges. Journal of Information Technology for Teacher Education, 8(1), 41–53.

    Article  Google Scholar 

  • Martin, M. O., Mullis, I. V. S., Gonzalez, E. J., & Chrostowski, S. J. (2004). TIMSS 2003 International Science Report Findings From IEA’s Trends in International Mathematics and Science Study at the Fourth and Eighth Grades. Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.

    Google Scholar 

  • Martin, M. O., Mullis, I. V. S., & Foy, P. (2008). TIMSS 2007 international science report: Findings from IEA’s Trends in International Mathematics and Science Study at the fourth and eighth grades. Chestnut Hill, MA: Boston College.

    Google Scholar 

  • Mullis, I. V. S., Martin, M. O., Gonzalez, E. J., & Chrostowski, S. J. (2004). TIMSS 2003 International Mathematics Report Findings From IEA’s Trends in International Mathematics and Science Study at the Fourth and Eighth Grades. Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.

    Google Scholar 

  • Mullis, I. V. S., Martin, M. O., & Foy, P. (2008). TIMSS 2007 international mathematics report: Findings from IEA’s Trends in International Mathematics and Science Study at the fourth and eighth grades. Chestnut Hill, MA: Boston College.

    Google Scholar 

  • Muthén, B.O. & Muthén, L.K. (2012) Software Mplus Version 7.

  • NCTM [National Council of Teachers of Mathematics] (2011). Technology in Teaching and Learning Mathematics. A Position of the National Council of Teachers of Mathematics. [Online] http://www.nctm.org/about/content.aspx?id=31734 [Accessed: 10th November 2015].

  • Nordic, E.-L. (2006). Impact of ICT in education. Copenhagen: Ramboll Management.

    Google Scholar 

  • OECD (2005). Are students ready for a technology-rich world? What PISA studies tell us. Paris: OECD Publishing.

    Google Scholar 

  • OECD (2013a). PISA 2012 results: What students know and can do. In Student performance in mathematics, reading and science (Volume I). Paris: OECD Publishing.

    Google Scholar 

  • OECD (2013b). PISA 2012. In What makes schools successful? Resources, policies and practices (Volume IV). Paris: OECD Publishing.

    Google Scholar 

  • OECD (2015). Students, Computers and Learning. Making the Connection. Paris: OECD Publishing.

    Book  Google Scholar 

  • OECD (2016). Trends shaping education 2016. Paris: OECD Publishing.

    Book  Google Scholar 

  • Ottestad, G. (2013). School leadership for ICT and teachers’ use of digital tools. Nordic Journal of Digital Literacy, 8, 107–125.

    Google Scholar 

  • Owston, R. D. (2003). School context, sustainability, and transferability. In R.B. Kozma (ed.), Technology, innovation, and educational change. In A global perspective (pp. 125–162). Washington D.C.:: ISTE.

    Google Scholar 

  • Özgen, K., & Bindak, R. (2012). Examining student opinions on computer use based on the learning styles in mathematics education. The Turkish Online Journal of Educational Technology, 11(1), 79–93.

    Google Scholar 

  • Pelgrum, W. J. (2008). School practices and conditions for pedagogy and ICT. In N. Law, W. J. Pelgrum, & T. Plomp (Eds.), Pedagogy and ICT use in schools around the world. Findings from the IEA-SITES 2006 (pp. 67–121). CERC-Springer: Hong Kong.

    Google Scholar 

  • Petko, D. (2012). Teachers’ pedagogical beliefs and their use of digital media in classrooms: sharpening the focus of the ‘will, skill, tool’ model and integrating teachers’ constructivist orientations. Computers & Education, 58, 1351–1359.

    Article  Google Scholar 

  • Petko, D., Egger, N., & Wespi, B. (2015). Digital media adoption in schools: bottom-up, top-down, complementary or optional? Computers & Education, 84, 49–61.

    Article  Google Scholar 

  • Prestridge, S. (2012). The beliefs behind the teacher that influences their ICT practices. Computers & Education, 58, 449–458.

    Article  Google Scholar 

  • Rackov, G. (2011). Application of computers in initial teaching of mathematics. Metodički obzori, 11(6), 105–117.

    Google Scholar 

  • Razzak, N. A. (2015). Challenges facing school leadership in promoting ICT integration in instruction in the public schools of Bahrain. Education and Information Technologies, 20(2), 303–318.

    Article  Google Scholar 

  • Rutkowski, L., Gonzalez, E., Joncas, M. & Davier, M. von (2010). International large-scale assessment data: issues in secondary analysis and reporting. Educational Researcher, 39(2), 142–151.

  • Scheerens, J. (2000). Improving school effectiveness. Paris: UNESCO, International Institute for Educational Planning.

    Google Scholar 

  • Schmidt, K., & Köhler, A. (2013). Teaching mathematics in the PC lab – the students’ viewpoints. International Journal of Mathematical Education in Science and Technology, 44(3), 317–331.

    Article  Google Scholar 

  • Skryabin, M., Zhang, J., Liu, L., & Zhang, D. (2015). How the ICT development level and usage influence student achievement in reading, mathematics, and science. Computers & Education, 85, 49–58.

    Article  Google Scholar 

  • Song, H.-D., & Kang, T. (2012). Evaluating the impacts of ICT use: a multi-level analysis with hierarchical linear modeling. Turkish Journal of Educational Technology, 11(4), 132–140.

    Google Scholar 

  • Stoddard, J. (2014). The need for media education in democratic education. Democracy and Education, 22(1), 1–9.

    Google Scholar 

  • Tamim, R. M., Bernard, R. M., Borokhovski, E., Abrami, P. C. & Schmid, R. F. (2011). What forty years of research says about the impact of technology on learning: a second-order meta-analysis and validation study. Review of Educational Research, 81(1), 4–28

  • Tatto, M. T., Schwille, J., Senk, S. L., Ingvarson, L., Rowley, G., Peck, R., et al. (2012). Policy, practice, and readiness to teach primary and secondary mathematics in 17 countries: Findings from the IEA Teacher Education and Development Study in Mathematics (TEDS-M). Amsterdam: IEA.

    Google Scholar 

  • Thomas, M. O. J. (2006). Teachers using computers in mathematics: a longitudinal study. [Online] Paper presented at the 30th annual conference of the International Group for the Psychology of Mathematics Education, Prague. http://www.emis.de/proceedings/PME30/5/265.pdf [Accessed: 11th November 2015].

  • Tienken, C. H., & Maher, J. A. (2008). The influence of computer-assisted instruction on eight grade mathematics achievement. Research in Middle Level Education, 32(3), 1–13.

    Google Scholar 

  • Tomczyk, Ł., Szotkowski, R., Fabiś, A., Wąsiński, A., Chudý, Š. & Neumeister, P. (2015). Selected aspects of conditions in the use of new media as an important part of the training of teachers in the Czech Republic and Poland – differences, risks and threats. Education and Information Technologies, 1–21. doi:10.1007/s10639-015-9455-8.

  • Tondeur, J., van Keer, H., van Braak, J., & Valcke, M. (2008). ICT integration in the classroom: challenging the potential of a school policy. Computers & Education, 51(1), 212–223.

    Article  Google Scholar 

  • Uslu, O., & Bümen, N. T. (2012). Effects of the professional development program on Turkish teachers: technology Integrationg along with attitude towards ICT in education. The Turkish Online Journal of Educational Technology, 11(3), 115–127.

    Google Scholar 

  • Voogt, J., Erstad, O., Dede, C., & Mishra, P. (2013). Challenges to learning and schooling in the digital networked world of the twenty-first century. Journal of Computer Assisted Learning, 29(5), 403–413.

    Article  Google Scholar 

  • Wiest, L. R. (2001). The role of computers in mathematics teaching and learning. Computers in the Schools, 17(1–2), 41–55.

    Article  Google Scholar 

  • Williams, D., Coles, L., Richardson, A., Wilson, K., & Tuson, J. (2000). Integrating information and communications technology in professional practice: an analysis of teachers’ needs based on a survey of primary and secondary teacher in Scottish schools. Journal of Information Technology for Teacher Education, 9(2), 167–182.

    Article  Google Scholar 

  • Wittwer, J., & Senkbeil, M. (2008). Is students’ computer use at home related to their mathematical performance at school? Computers & Education, 50, 1558–1571.

    Article  Google Scholar 

  • Zuzovsky, R. (2013). What works where? The relationship between instructional variables and schools’ mean scores in mathematics and science in low-, medium-, and high-achieving countries. [Online]. Large-scale Assessments in Education, 1, 2. http://www.largescaleassessmentsineducation.com/content/1/1/2 [Accessed: 16th November 2015].

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Birgit Eickelmann.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Eickelmann, B., Gerick, J. & Koop, C. ICT use in mathematics lessons and the mathematics achievement of secondary school students by international comparison: Which role do school level factors play?. Educ Inf Technol 22, 1527–1551 (2017). https://doi.org/10.1007/s10639-016-9498-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-016-9498-5

Keywords

Navigation