Abstract
By means of an international comparison, the research presented in the article aims to identify supporting and hindering school level factors for the use of ICT in secondary school mathematics lessons. The relationship between ICT use and the performance of Grade 9 students in mathematics is examined and further integrated into a multi-level model including school level factors. Against the background of a theoretical allocation (1) the IT equipment of schools, (2) school leadership, (3) aspects of school goals and educational strategies as well as (4) teachers’ attitudes will be analyzed by means of a multi-level regression model as well as a multi-level path model including the mathematics achievement of students as measured in the context of PISA 2012. Representative school and student data from five countries, namely Australia, Germany, the Netherlands, Norway and Singapore are taken into consideration, as the integration of ICT in teaching and learning is firmly emphasized in these countries (overall 24,579 students in 1263 schools). By modeling the complex structure, school characteristics are examined with respect to their effect on the use of ICT for mathematics teaching. Moreover, the relation between different factors and students’ mathematics achievement will be synchronously assessed in the different educational systems. The results show that characteristics at school level do play a major role in the integration of ICT into teaching and learning and turn out to be relevant across the educational systems. In addition to further in-depth country-specific findings, the results point to cross-national future challenges in the field of using technologies to enhance teaching and learning.




Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
Due to insufficient response rates, the results for Germany were not taken into consideration.
A systematization of studies on the effect of technologies on learning, with a focus on the comparison of computer-based and traditional teaching, is presented by Tamim, Bernard, Borokhovski, Abrami and Schmid (2011).
References
Abuhmaid, A. (2011). ICT training courses for teacher professional development in Jordan. The Turkish Online Journal of Educational Technology., 10(4), 195–210.
Albion, P. R., Tondeur, J., Forkosh-Baruch, A., & Peeraer, J. (2015). Teachers‘ professional development for ICT integration: towards a reciprocal relationship between research and practice. Education and Information Technologies, 20(4), 655–673.
Anderson, R., & Ainley, J. (2010). Technology and learning: access in schools around the world. In B. McGaw, E. Baker, & P. Peterson (Eds.), International encyclopaedia of education (3rd ed., pp. 21–33). Amsterdam: Elsevier.
Anderson, R. E., & Dexter, S. L. (2000). School technology leadership: Incidence and impact on: Teaching, learning, and computing 1998 survey, report no. 6. Irvine, CA: Center for Research on Information, Technology, and Organizations at University of California.
Aydin, E. (2005). The use of computers in mathematics education: a paradigm shift from “computer assisted instruction” towards “student programming”. The Turkish Online Journal of Educational Technology, 4(2), 27–34.
Barzel, B. (2011). New technology? New ways of teaching – no time left for that! International Journal for Technology in Mathematics Education, 14(2), 77–86.
Barzel, B., Hußmann, S. & Leuders, T. (Hrsg.) (2005). Computer, Internet & Co. im Mathematikunterricht [computers, internet & Co. in mathematics lessons]. Berlin: Cornelsen Scriptor.
Baumert, J., Blum, W., & Neubrand, M. (2004). Drawing lessons from PISA 2000. Zeitschrift für Erziehungswissenschaft, 7(3rd Supplement), 143–157.
Bayturan, S., & Kesan, C. (2012). The effect of computer-assisted instruction on the achievement and attitudes towards mathematics of students in mathematics education. International Journal of Global Education, 1(2), 50–57.
Blamire, R. (2009). ICT impact data at primary school level: the STEPS approach. In F. Scheuermann & F. Pedró (Eds.), Assessing the effects of ICT in education (pp. 199–211). Luxemburg: European Commission / OECD.
Celik, V., & Yesilyurt, E. (2013). Attitudes to technology, perceived computer self-efficacy and computer anxiety as predictors of computer supported education. Computers & Education, 60(1), 148–158.
Cheung, A. C. K., & Slavin, R. E. (2013). The effectiveness of educational technology applications for enhancing mathematics achievement in K-12 classrooms: a meta-analysis. Educational Research Review, 9, 88–113.
Creemers, B. P. M., & Kyriakides, L. (2008). The dynamics of educational effectiveness. In A contribution to policy, practice and theory in contemporary schools. Abingdon: Routledge.
Davis, N., Eickelmann, B., & Zaka, P. (2013). Restructuring of educational systems in the digital age from a co-evolutionary perspective. Journal of Computer Assisted Learning, 29(5), 438–450.
Dawson, C., & Rakes, G. C. (2003). The influence of principals’ technology training on the integration of technology into schools. Journal of Research on Technology in Education, 36(1), 29–49.
Dexter, S. (2008). Leadership for IT in schools. In J. Voogt & G. Knezek (Eds.), International handbook of information technology in primary and secondary education (pp. 543–554). New York: Springer.
Dexter, S. L., Anderson, R. E., & Becker, H. J. (1999). Teachers’ views of computers as catalysts for changes in their teaching practice. Journal of Research on Computing in Education, 31(3), 221–239.
Drossel, K., Eickelmann, B. & Gerick, J. (2016). Predictors of teachers‘ use of ICT in school – the relevance of school characteristics, teachers‘ attitudes and teacher collaboration. Education and Information Technologies, 1–23. doi:10.1007/s10639-016-9476-y
Dynarski, M., Agodini, R., Heaviside, S., Novak, T., Carey, N., Campuzano, L., Means, B., Murphy, R., Penuel, W., Javitz, H., Emery, D., & Sussex, W. (2007). Effectiveness of Reading and Mathematics Software Products: Findings from the First Student Cohort. [Online] Washington, D.C.: U.S. Department of Education. http://ies.ed.gov/ncee/pdf/20074005.pdf [Accessed 11th November 2015].
Eickelmann, B. (2011). Supportive and hindering factors to a sustainable implementation of ICT in schools. Journal for Educational Research Online, 3(1), 75–103.
Eickelmann, B., & Schulz-Zander, R. (2008). Schuleffektivität, Schulentwicklung und digitale Medien [school effectiveness, school development and digital media]. In W. Bos, H. G. Holtappels, H. Pfeiffer, H.-G. Rolff, & R. Schulz-Zander (Eds.), Jahrbuch der Schulentwicklung, Bd. 15. Daten – Beispiele – Perspektiven [yearbook of school development, vol. 15. Data – examples – perspectives] (pp. 157–194). Juventa: Weinheim.
Enders, C. K. (2010). Applied missing data analyses. New York: Guilford.
Ertmer, P. A. (2005). Teacher pedagogical beliefs: the final frontier in our quest for technology integration? Educational Technology Research and Development, 53(4), 25–39.
European Commission (2013). Survey of schools: ICT in Education. Benchmarking access, use and attitudes to technology in Europe’s schools. Final report. [Online]. http://ec.europa.eu/digital-agenda/en/news/survey-schools-ict-education [Accessed 09th September 2014].
European Commission (2014). The International Computer and Information Literacy Study (ICILS). Main findings and implications for the education policies in Europe. [Online] Brussels. http://ec.europa.eu/education/library/study/2014/ec-icils_en.pdf [Accessed 10th November 2015].
Fraillon, J., Schulz, W. & Ainley, J. (2013). International Computer and Information Literacy Study: Assessment framework. Amsterdam: International Association for the Evaluation of Educational Achievement (IEA). [Online] https://www.acer.edu.au/files/ICILS_2013_Framework.pdf [Accessed 11th November 2015].
Fraillon, J., Ainley, J., Schulz, W., Friedman, T. & Gebhardt, E. (2014). Preparing for life in a digital age. The IEA International Computer and Information Literacy Study international report. [Online] Springer. http://www.iea.nl/fileadmin/user_upload/Publications/ Electronic_versions/ICILS_2013_International_Report.pdf [Accessed 10th November 2015].
Fuchs, T., & Woessmann, L. (2005). Computers and student learning: Bivariate and multivariate evidence on the availability and use of computers at home and at school. ifo Working Papers, 8. [Online] https://www.cesifo-group.de/DocDL/IfoWorkingPaper-8.pdf [Accessed 10th November 2015].
Galanouli, D., Murphy, C., & Gardner, J. (2004). Teachers’ perceptions of the effectiveness of ICT-competence training. Computers & Education, 43(1), 63–79.
Harrison, C., Lunzer, E., Tymms, P., Fitz-Gibbon, C., & Restorick, J. (2004). Use of ICT and its relationship with performance in examinations: a comparison of the ImpaCT2 project’s research findings using pupil-level, school-level and multilevel modelling data. Journal of Computer Assisted Learning, 20, 319–337.
Hatlevik, O. E., & Arnseth, H. C. (2012). ICT, teaching and leadership: how do teachers experience the importance of ICT-supportive school leaders? Nordic Journal of Digital Literacy, 7(1), 55–69.
Hattie, J. (2009). Visible learning. A synthesis of over 800 meta-analyses relating to achievement. New York: Routledge.
Heo, H., & Kang, M. (2009). Impacts of ICT use on school learning outcome. In F. Scheuermann & F. Pedró (Eds.), Assessing the effects of ICT in education (pp. 189–198). Luxemburg: European Commission / OECD.
Hox, J. J., & Roberts, J. K. (2011). Handbook of advanced multilevel analysis. New York: Routledge.
Hsu, S., & Kuan, P.-Y. (2013). The impact of multilevel factors on technology integration: the case of Taiwanese grade 1-9 teachers and schools. Educational Technology Research and Development, 61, 25–50.
Hughes, M., & Zachariah, S. (2001). An investigation into the relationship between effective administrative leadership styles and the use of technology. International Electronic Journal for Leadership in Learning, 5(5), 1–11.
Kadijevich, D. M. (2015). A dataset from TIMSS to examine the relationship between computer use and mathematics achievement. British Journal of Educational Technology, 46(5), 984–987.
Kafyulilo, A., Fisser, P., & Voogt, J. (2015). Factors affecting teachers‘continuation of technology use in teaching. Education and Information Technologies. doi:10.1007/s10639-015-9398-0.
Kang, M., Heo, H., & Kim, M. (2011). The impact of ICT use on new millennium learners’ educational performance. Interactive Technology and Smart Education, 8(1), 18–27.
Koehler, M. J., & Mishra, P. (2008). Introducing TPCK. In AACTE Committee on Innovation and Technology. In Handbook of technological pedagogical content knowledge (TPCK) for educators (pp. 3–29). New York: Routledge.
Lal, C. (2014). Attitudinal study of user and non-user teachers’ towards ICT in relation to their school teaching subjects. Universal Journal of Educational Research, 2(3), 213–218.
Law, N., & Chow, A. (2008). Teacher characteristics, contextual factors, and how these affect the pedagogical use of ICT. In N. Law, W. J. Pelgrum, & T. Plomp (Eds.), Pedagogy and ICT use in schools around the world. Findings from the IEA-SITES 2006 (pp. 182–221). CERC-Springer: Hong Kong.
Law, N., Pelgrum, W. J., & Plomp, T. (2008). Pedagogy and ICT use in schools araound the world. In Findings from the IEA SITES 2006 study. Hong Kong: CERC-Springer.
Lawson, T., & Comber, C. (1999). Superhighways technology: personnel factors leading to successful integration of information and communications technology in schools and colleges. Journal of Information Technology for Teacher Education, 8(1), 41–53.
Martin, M. O., Mullis, I. V. S., Gonzalez, E. J., & Chrostowski, S. J. (2004). TIMSS 2003 International Science Report Findings From IEA’s Trends in International Mathematics and Science Study at the Fourth and Eighth Grades. Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.
Martin, M. O., Mullis, I. V. S., & Foy, P. (2008). TIMSS 2007 international science report: Findings from IEA’s Trends in International Mathematics and Science Study at the fourth and eighth grades. Chestnut Hill, MA: Boston College.
Mullis, I. V. S., Martin, M. O., Gonzalez, E. J., & Chrostowski, S. J. (2004). TIMSS 2003 International Mathematics Report Findings From IEA’s Trends in International Mathematics and Science Study at the Fourth and Eighth Grades. Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.
Mullis, I. V. S., Martin, M. O., & Foy, P. (2008). TIMSS 2007 international mathematics report: Findings from IEA’s Trends in International Mathematics and Science Study at the fourth and eighth grades. Chestnut Hill, MA: Boston College.
Muthén, B.O. & Muthén, L.K. (2012) Software Mplus Version 7.
NCTM [National Council of Teachers of Mathematics] (2011). Technology in Teaching and Learning Mathematics. A Position of the National Council of Teachers of Mathematics. [Online] http://www.nctm.org/about/content.aspx?id=31734 [Accessed: 10th November 2015].
Nordic, E.-L. (2006). Impact of ICT in education. Copenhagen: Ramboll Management.
OECD (2005). Are students ready for a technology-rich world? What PISA studies tell us. Paris: OECD Publishing.
OECD (2013a). PISA 2012 results: What students know and can do. In Student performance in mathematics, reading and science (Volume I). Paris: OECD Publishing.
OECD (2013b). PISA 2012. In What makes schools successful? Resources, policies and practices (Volume IV). Paris: OECD Publishing.
OECD (2015). Students, Computers and Learning. Making the Connection. Paris: OECD Publishing.
OECD (2016). Trends shaping education 2016. Paris: OECD Publishing.
Ottestad, G. (2013). School leadership for ICT and teachers’ use of digital tools. Nordic Journal of Digital Literacy, 8, 107–125.
Owston, R. D. (2003). School context, sustainability, and transferability. In R.B. Kozma (ed.), Technology, innovation, and educational change. In A global perspective (pp. 125–162). Washington D.C.:: ISTE.
Özgen, K., & Bindak, R. (2012). Examining student opinions on computer use based on the learning styles in mathematics education. The Turkish Online Journal of Educational Technology, 11(1), 79–93.
Pelgrum, W. J. (2008). School practices and conditions for pedagogy and ICT. In N. Law, W. J. Pelgrum, & T. Plomp (Eds.), Pedagogy and ICT use in schools around the world. Findings from the IEA-SITES 2006 (pp. 67–121). CERC-Springer: Hong Kong.
Petko, D. (2012). Teachers’ pedagogical beliefs and their use of digital media in classrooms: sharpening the focus of the ‘will, skill, tool’ model and integrating teachers’ constructivist orientations. Computers & Education, 58, 1351–1359.
Petko, D., Egger, N., & Wespi, B. (2015). Digital media adoption in schools: bottom-up, top-down, complementary or optional? Computers & Education, 84, 49–61.
Prestridge, S. (2012). The beliefs behind the teacher that influences their ICT practices. Computers & Education, 58, 449–458.
Rackov, G. (2011). Application of computers in initial teaching of mathematics. Metodički obzori, 11(6), 105–117.
Razzak, N. A. (2015). Challenges facing school leadership in promoting ICT integration in instruction in the public schools of Bahrain. Education and Information Technologies, 20(2), 303–318.
Rutkowski, L., Gonzalez, E., Joncas, M. & Davier, M. von (2010). International large-scale assessment data: issues in secondary analysis and reporting. Educational Researcher, 39(2), 142–151.
Scheerens, J. (2000). Improving school effectiveness. Paris: UNESCO, International Institute for Educational Planning.
Schmidt, K., & Köhler, A. (2013). Teaching mathematics in the PC lab – the students’ viewpoints. International Journal of Mathematical Education in Science and Technology, 44(3), 317–331.
Skryabin, M., Zhang, J., Liu, L., & Zhang, D. (2015). How the ICT development level and usage influence student achievement in reading, mathematics, and science. Computers & Education, 85, 49–58.
Song, H.-D., & Kang, T. (2012). Evaluating the impacts of ICT use: a multi-level analysis with hierarchical linear modeling. Turkish Journal of Educational Technology, 11(4), 132–140.
Stoddard, J. (2014). The need for media education in democratic education. Democracy and Education, 22(1), 1–9.
Tamim, R. M., Bernard, R. M., Borokhovski, E., Abrami, P. C. & Schmid, R. F. (2011). What forty years of research says about the impact of technology on learning: a second-order meta-analysis and validation study. Review of Educational Research, 81(1), 4–28
Tatto, M. T., Schwille, J., Senk, S. L., Ingvarson, L., Rowley, G., Peck, R., et al. (2012). Policy, practice, and readiness to teach primary and secondary mathematics in 17 countries: Findings from the IEA Teacher Education and Development Study in Mathematics (TEDS-M). Amsterdam: IEA.
Thomas, M. O. J. (2006). Teachers using computers in mathematics: a longitudinal study. [Online] Paper presented at the 30th annual conference of the International Group for the Psychology of Mathematics Education, Prague. http://www.emis.de/proceedings/PME30/5/265.pdf [Accessed: 11th November 2015].
Tienken, C. H., & Maher, J. A. (2008). The influence of computer-assisted instruction on eight grade mathematics achievement. Research in Middle Level Education, 32(3), 1–13.
Tomczyk, Ł., Szotkowski, R., Fabiś, A., Wąsiński, A., Chudý, Š. & Neumeister, P. (2015). Selected aspects of conditions in the use of new media as an important part of the training of teachers in the Czech Republic and Poland – differences, risks and threats. Education and Information Technologies, 1–21. doi:10.1007/s10639-015-9455-8.
Tondeur, J., van Keer, H., van Braak, J., & Valcke, M. (2008). ICT integration in the classroom: challenging the potential of a school policy. Computers & Education, 51(1), 212–223.
Uslu, O., & Bümen, N. T. (2012). Effects of the professional development program on Turkish teachers: technology Integrationg along with attitude towards ICT in education. The Turkish Online Journal of Educational Technology, 11(3), 115–127.
Voogt, J., Erstad, O., Dede, C., & Mishra, P. (2013). Challenges to learning and schooling in the digital networked world of the twenty-first century. Journal of Computer Assisted Learning, 29(5), 403–413.
Wiest, L. R. (2001). The role of computers in mathematics teaching and learning. Computers in the Schools, 17(1–2), 41–55.
Williams, D., Coles, L., Richardson, A., Wilson, K., & Tuson, J. (2000). Integrating information and communications technology in professional practice: an analysis of teachers’ needs based on a survey of primary and secondary teacher in Scottish schools. Journal of Information Technology for Teacher Education, 9(2), 167–182.
Wittwer, J., & Senkbeil, M. (2008). Is students’ computer use at home related to their mathematical performance at school? Computers & Education, 50, 1558–1571.
Zuzovsky, R. (2013). What works where? The relationship between instructional variables and schools’ mean scores in mathematics and science in low-, medium-, and high-achieving countries. [Online]. Large-scale Assessments in Education, 1, 2. http://www.largescaleassessmentsineducation.com/content/1/1/2 [Accessed: 16th November 2015].
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Eickelmann, B., Gerick, J. & Koop, C. ICT use in mathematics lessons and the mathematics achievement of secondary school students by international comparison: Which role do school level factors play?. Educ Inf Technol 22, 1527–1551 (2017). https://doi.org/10.1007/s10639-016-9498-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-016-9498-5