skip to main content
10.1145/3377571.3379439acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesic4eConference Proceedingsconference-collections
research-article

A Meta-Analysis of Blended Learning Trends

Published:03 May 2020Publication History

ABSTRACT

With technology being at the forefront in the modern-day classrooms, blended learning is the driving force for new pedagogical approaches. For decades, studies have demonstrated the positive effects of blended learning approaches on the learning outcomes. However, the extent and breadth of blended learning's efficacy in enhancing education would always be an interesting query, given technology is rapidly evolving and diversifying in recent times. Thus, the present study carried out a quantitative meta-analysis to examine the overall effectiveness of blended learning interventions. Characterized by a set of priori emphasizing on technology usage, a systematic search identified 40 meta-analytic compliant samples published from 2015 to 2019, which were selected for analysis. Cohen's d [1][2] was employed, yielding effect sizes (ES), to determine the efficacy of the blended learning interventions on learning outcomes. The ES of each learning outcome was totaled and averaged for each intervention to gauge the overall outcome. This combined ES was then interpreted according to Cohen's [1] Benchmark. Additionally, ES of different interventions were combined into their respective cohorts; Science and Technology, Social Sciences and Language, as well as the category of technological intervention, namely either: (a) Web-Based Applications, (b) Mobile Applications, (c) Standalone Applications or (d) Devices. Results show (a) Web-Based Application were most frequently used, followed by (b) Mobile Applications, (c) Devices, and lastly (d) Standalone Applications. There was a considerable number of large, medium, small effect sizes, as well as negative effect size for these interventions deployed. Overall, these findings represent a comprehensive body of high-quality evidence that blended learning shows great promise in satisfying the learning outcomes, scaffolded by technology.

References

  1. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Laurence Erlbaum Associates. Inc CIT0006.Google ScholarGoogle Scholar
  2. Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155.Google ScholarGoogle ScholarCross RefCross Ref
  3. Graham, C. R., Woodfield, W., & Harrison, J. B. (2013). A framework for institutional adoption and implementation of blended learning in higher education. The internet and higher education, 18, 4--14.Google ScholarGoogle Scholar
  4. Wang, C., & Wu, F. (2018). An expert system approach to support blended learning in context-aware environment. In S. K. S. Cheung, L. Kwok, K. Kubota, L.-K. Lee, & J. Tokito (Eds.), Blended Learning. Enhancing Learning Success (Vol. 10949, pp. 45--56).Google ScholarGoogle ScholarCross RefCross Ref
  5. Tan, M., & Hew, K. F. (2016). Incorporating meaningful gamification in a blended learning research methods class: Examining student learning, engagement, and affective outcomes. Australasian Journal of Educational Technology 32(5), 19--34.Google ScholarGoogle Scholar
  6. Wang, Y. H. (2016). Could a mobile-assisted learning system support flipped classrooms for classical Chinese learning? Journal of Computer Assisted Learning, 32(5), 391--415.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Barhoumi, C. (2015). The effectiveness of Whatsapp mobile learning activities guided by activity theory on students' knowledge management. Contemporary Educational Technology, 6(3), 221--238.Google ScholarGoogle ScholarCross RefCross Ref
  8. Chen, C. H., & Hwang, G. J. (2017). Effects of the team competition-based ubiquitous gaming approach on students' interactive patterns, collective efficacy and awareness of collaboration and communication. Journal of Educational Technology & Society, 20(1), 87--98.Google ScholarGoogle Scholar
  9. Hung, H. T. (2015). Flipping the classroom for English language learners to foster active learning. Computer Assisted Language Learning, 28(1), 81--96.Google ScholarGoogle ScholarCross RefCross Ref
  10. Liu, T., Chen, Z., Lesgold, A. M., Feng, X., & Wang, C. (2017). Novelty blended learning pattern and its application in English language teaching. In Proceedings of the International Conference on Digital Technology in Education (pp.7--12). New York, NY: ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Suana, W., Distrik, I. W., Herlina, K., Maharta, N., & Putri, N. M. A. A. (2019). Supporting blended learning using mobile instant messaging application: Its effectiveness and limitations. International Journal of Instruction, 12(1), 1011--1024.Google ScholarGoogle ScholarCross RefCross Ref
  12. Saritepeci, M., & Çakir, H. (2015). The effect of blended learning environments on student motivation and student engagement: A study on social studies course. Education and Science, 40(177), 203--216.Google ScholarGoogle Scholar
  13. Schechter, R., Macaruso, P., Kazakoff, E. R., & Brooke, E. (2015). Exploration of a blended learning approach to reading instruction for low SES students in early elementary grades. Computers in the Schools, 32(3--4), 183--200.Google ScholarGoogle Scholar
  14. Mahmud, M. M. (2018). Technology and Language-What Works and What Does Not: A Meta-analysis of Blended Learning Research. Journal of Asia TEFL, 15(2), 365.Google ScholarGoogle Scholar
  15. Kara, S. (2018). Blended learning: A model to enhance engagement in reading class. Abant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi, 18 (2), 953--970.Google ScholarGoogle Scholar
  16. Yick, K., Yip, J., Au, S., Lai, Y., & Yu, A. (2019). Effectiveness of blended learning in the first year of fashion education. International Journal of Fashion Design, Technology and Education, 12(2), 178--188.Google ScholarGoogle ScholarCross RefCross Ref
  17. Smith, M. L., & Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies. American psychologist, 32(9), 752.Google ScholarGoogle Scholar
  18. Rosenthal, R. (1995). Writing meta-analytic reviews. Psychological bulletin, 118(2), 183.Google ScholarGoogle Scholar
  19. Higgins, S., Xiao, Z., & Katsipataki, M. (2012). The impact of digital technology on learning: A summary for the education endowment foundation. Durham, UK: Education Endowment Foundation and Durham University.Google ScholarGoogle Scholar
  20. Sitzmann, T., Kraiger, K., Stewart, D., & Wisher, R. (2006). The comparative effectiveness of web-based and classroom instruction: A meta-analysis. Personnel Psychology, 59(3), 623--664.Google ScholarGoogle ScholarCross RefCross Ref
  21. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. SAGE publications, Inc.Google ScholarGoogle Scholar
  22. Mark, W., Lipsey, & Wilson, D. B. (2001). Practical meta-analysis (Vol. 49). Thousand Oaks, CA: Sage publications.Google ScholarGoogle Scholar
  23. Rosenthal, R. (1991). Effect sizes: Pearson's correlation, its display via the BESD, and alternative indices.Google ScholarGoogle Scholar
  24. Mahmud, M. M. (2017). Transformative driven mechanism framework as key success indicators for blended learning. Unpublished doctoral dissertation. University of Technology MARA, Shah Alam, Malaysia.Google ScholarGoogle Scholar
  25. Akgunduz, D., & Akinoglu, O. (2016). The effect of blended learning and social media-supported learning on the students' attitude and self-directed learning skills in science education. The Turkish Online Journal of Educational Technology, 15(2), 106--115.Google ScholarGoogle Scholar
  26. Bazelais, P., & Doleck, T. (2018). Blended learning and traditional learning: A comparative study of college mechanics courses. Education and Information Technologies, 23(6), 2889--2900.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Cabi, E. (2018). The impact of the flipped classroom model on students' academic achievement. The International Review of Research in Open and Distributed Learning, 19(3), 202--221.Google ScholarGoogle ScholarCross RefCross Ref
  28. Chao, C. Y., Chen, Y. T., & Chuang, K. Y. (2015). Exploring students' learning attitude and achievement in flipped learning supported computer aided design curriculum: A study in high school engineering education. Computer Applications in Engineering Education, 23(4), 514--526.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Fazal, M., & Bryant, M. (2019). Blended learning in middle school math: The question of effectiveness. Journal of Online Learning Research, 5(1), 49--64.Google ScholarGoogle Scholar
  30. Hoic-Bozic, N., Holenko Dlab, M., & Mornar, V. (2016). Recommender system and web 2.0 tools to enhance a blended learning model. IEEE Transactions on Education, 59(1), 39--44.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Lin, Y. W., Tseng, C. L., & Chiang, P. J. (2016). The Application of the Moodle On-Line Teaching Platform on Mathematics Curriculum. 數位學習科技期刊, 8(4), 89--115.Google ScholarGoogle Scholar
  32. Ozonur, M., Yelken, T. Y., & Tokmak, H. S. (2018). Social presence and motivation in online environments: Second Life versus the Enocta Learning Management System/Adobe Connect. Australasian Journal of Educational Technology, 34(3), 1--14.Google ScholarGoogle ScholarCross RefCross Ref
  33. Prescott, W. A., Woodruff, A., Prescott, G. M., Albanese, N., Bernhardi, C., & Doloresco, F. (2016). Introduction and assessment of a blended-learning model to teach patient assessment in a doctor of pharmacy program. American Journal of Pharmaceutical Education, 80(10), 1--10.Google ScholarGoogle ScholarCross RefCross Ref
  34. Smith, J. G., & Suzuki, S. (2015). Embedded blended learning within an Algebra classroom: A multimedia capture experiment: Embedded blended learning. Journal of Computer Assisted Learning, 31(2), 133--147.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Sulisworo, D., Agustin, S. P., & Sudarmiyati, E. (2016). Cooperative-blended learning using Moodle as an open source learning platform. International Journal of Technology Enhanced Learning, 8(2), 187--198.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Tsai, C. W. (2015). Investigating the effects of web-mediated design thinking and co-regulated learning on developing students' computing skills in a blended course. Universal Access in the Information Society, 14(2), 295--305.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. van Niekerk, J., & Webb, P. (2016). The effectiveness of brain-compatible blended learning material in the teaching of programming logic. Computers & Education, 103, 16--27.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Alsancak Sirakaya, D., & Ozdemir, S. (2018). The effect of a flipped classroom model on academic achievement, self-directed learning readiness, motivation and retention. Malaysian Online Journal of Educational Technology, 6(1), 76--91.Google ScholarGoogle Scholar
  39. Cosgrove, S. B., & Olitsky, N. H. (2015). Knowledge retention, student learning, and blended course work: Evidence from principles of economics courses. Southern Economic Journal, 82(2), 556--579.Google ScholarGoogle ScholarCross RefCross Ref
  40. Jou, M., Lin, Y. T., & Wu, D. W. (2016). Effect of a blended learning environment on student critical thinking and knowledge transformation. Interactive Learning Environments, 24(6), 1131--1147.Google ScholarGoogle ScholarCross RefCross Ref
  41. Kurt, G. (2017). Implementing the flipped classroom in teacher education: Evidence from Turkey. Journal of Educational Technology & Society, 20(1), 211--221.Google ScholarGoogle Scholar
  42. Sriarunrasmee, J., Techataweewan, W., & Mebusaya, R. P. (2015). Blended learning supporting self-directed learning and communication skills of Srinakharinwirot university's first year students. Procedia - Social and Behavioral Sciences, 197, 1564--1569.Google ScholarGoogle ScholarCross RefCross Ref
  43. Zafonte, M., & Parks-Stamm, E. J. (2016). Effective instruction in APA style in blended and face-to-face classrooms. Scholarship of Teaching and Learning in Psychology, 2(3), 208--218.Google ScholarGoogle ScholarCross RefCross Ref
  44. Bakeer, A. M. (2018). Students' attitudes towards implementing blended learning in teaching English in higher education institutions: A case of Al-Quds Open University. International Journal of Humanities and Social Science, 8(6), 131--139.Google ScholarGoogle ScholarCross RefCross Ref
  45. Banditvilai, C. (2016). Enhancing students' language skills through blended learning. Electronic Journal of e-Learning, 14(3), 220--229.Google ScholarGoogle Scholar
  46. Bataineh, R. F., & Mayyas, M. B. (2017). The utility of blended learning in EFL reading and grammar: A case for Moodle. Teaching English with Technology, 17(3), 35--49.Google ScholarGoogle Scholar
  47. Inal, M., & Korkmaz, Ö. (2019). The effect of web based blended learning on students' academic achievement and attitudes towards English course. Education and Information Technologies 24(4), 2603--2619.Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Tosun, S. (2015). The effects of blended learning on EFL students' vocabulary enhancement. Procedia - Social and Behavioral Sciences, 199, 641--647.Google ScholarGoogle ScholarCross RefCross Ref
  49. Tsai, Y. R. (2015). Applying the Technology Acceptance Model (TAM) to explore the effects of a Course Management System (CMS)-assisted EFL writing instruction. CALICO Journal, 32(1), 153--171.Google ScholarGoogle ScholarCross RefCross Ref
  50. Hwang, G. J., & Lai, C. L. (2017). Facilitating and bridging out-of-class and in-class learning: An interactive e-book-based flipped learning approach for math courses. Journal of Educational Technology & Society, 20(1), 184--197.Google ScholarGoogle Scholar
  51. McCutcheon, K., O'Halloran, P., & Lohan, M. (2018). Online learning versus blended learning of clinical supervisee skills with pre-registration nursing students: A randomised controlled trial. International Journal of Nursing Studies, 82, 30--39.Google ScholarGoogle ScholarCross RefCross Ref
  52. Ige, O. A., & Tsotetsi, C. (2017). Effects of computer-assisted teaching strategies on students' social behaviours in rural learning ecologies: A model for South Korea's rural schools. The Anthropologist, 29(2-3), 170--177.Google ScholarGoogle ScholarCross RefCross Ref
  53. Mahmud, M. M., Ramachandiran, C. R., & Ismail, O. (2019, January). Is ratio even worth experimenting? a conceptual review in a blended ecosystem. In Proceedings of the 10th International Conference on E-Education, E-Business, E-Management and E-Learning (pp. 58--62).Google ScholarGoogle Scholar

Index Terms

  1. A Meta-Analysis of Blended Learning Trends

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      IC4E '20: Proceedings of the 2020 11th International Conference on E-Education, E-Business, E-Management, and E-Learning
      January 2020
      441 pages
      ISBN:9781450372947
      DOI:10.1145/3377571

      Copyright © 2020 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 3 May 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader