Abstract
Online learning has been widely adopted in higher education, because it can help both teachers and students to achieve educational goals through better accessibility, flexibility, and interaction. As the Internet and educational technologies have evolved, however, educators indicate that online education and the related technology is more than just a technical consideration; thus, online educators and scholars should address the pedagogical perspectives of online learning. Therefore, this study attempts to provide an effective online teaching method and to investigate the effects of online competency-based learning (CBL) and design-based learning (DBL) on enhancing students’ learning performance, self-directed learning readiness (SDLR), and experience of online learning in an online computing course. The experimental design in this study involved a 2 (CBL vs. non-CBL) × 2 (DBL vs. non-DBL) factorial pretest/posttest design. Four classes in a course titled “Applied Information Technology: Office Software” were chosen for this research. Students involved in this experiment were from non-computer field departments at a comprehensive university. Based on the analysis carried out in this research, students who received the intervention with online DBL showed significantly better skills in using PowerPoint. However, learners who received the intervention with online CBL and/or DBL did not have significantly better SDLR or experience of online learning. The potential reasons for this insignificance in students’ SDLR and experience of online learning as well as their implications are reported in this paper.
Similar content being viewed by others
References
Abdelaziz, H.A.: The effect of computer-mediated instruction and web quest on pre-service business education teachers’ self-directed learning readiness and teaching performance. Delta Pi Epsilon J. 54(1), 1–15 (2012)
Akhtar, S., Warburton, S., Xu, W.: The use of an online learning and teaching system for monitoring computer aided design student participation and predicting student success. Int. J. Technol. Des. Educ. 27(2), 251–270 (2017)
Allen, I., Seaman, J.: (2013) Changing Course: Ten Years of Tracking Online Education in the United States. Needham, MA: The Sloan Consortium, pp. 1–26. http://files.eric.ed.gov/fulltext/ED541571.pdf. Accessed 15 Dec 2015
Alotaibi, K.N.: The learning environment as a mediating variable between self-directed learning readiness and academic performance of a sample of Saudi nursing and medical emergency students. Nurse Educ. Today 36, 249–254 (2016)
Al-Zahrani, A.M.: From passive to active: the impact of the flipped classroom through social learning platforms on higher education students’ creative thinking. Br. J. Edu. Technol. 46(6), 1133–1148 (2015)
Apedoe, X.A., Reynolds, B., Ellefson, M.R., Schunn, C.D.: Bringing engineering design into high school science classrooms: The heating/cooling unit. J. Sci. Educ. Technol. 17(5), 454–465 (2008)
Applin, H., Williams, B., Day, R., Buro, K.: A comparison of competencies between problem-based learning and non-problem-based graduate nurses. Nurse Educ. Today 31(2), 129–134 (2011)
Baughman, J.A., Brumm, T.J., Mickelson, S.K.: Student professional development: competency-based learning and assessment. J. Technol. Stud. 38(2), 115–127 (2012)
Banerjee, A.V., Cole, S., Dufflo, E., Linden, L.: Remedying education: evidence from two randomized experiments in India. Quart. J. Econ. 122(3), 1235–1264 (2007)
Bishop, J.L., Verleger, M.A.: The flipped classroom: a survey of the research. In: Atlanta, G.A. (Ed.) ASEE National Conference Proceedings (2013). http://www.studiesuccesho.nl/wp-content/uploads/2014/04/flipped-classroom-artikel.pdf. Accessed 10 Dec 2015
Boyle, T., Bradley, C., Chalk, P., Jones, R., Pickard, P.: Using blended learning to improve student success rates in learning to program. J. Educ. Media 28(2–3), 165–178 (2003)
Braha, D., Maimon, O.: The design process: properties, paradigms, and structure. IEEE Trans. Syst. Man Cybern. Part A Syst. Humans 27(2), 146–166 (1997)
Broadbent, J.: Comparing online and blended learner’s self-regulated learning strategies and academic performance. Internet Higher Educ. 33, 24–32 (2017)
Brumm, T., Mickelson, S., Steward, B., Kaleita, A.: Competency-based outcomes assessment for agricultural engineering programs. Int. J. Eng. Educ. 22(6), 1163–1172 (2006)
Burns, M.K., Kanive, R., DeGrande, M.: Effect of a computer-delivered math fact intervention as a supplemental intervention for math in third and fourth grades. Remedial Spec. Educ. 33(3), 184–191 (2012)
Butt, A.: Student views on the use of a flipped classroom approach: evidence from Australia. Bus. Educ. Accredit. 6(1), 33–43 (2014)
Caspersen, M.E., Nowack, P.: (2013). Computational thinking and practice—a generic approach to computing in Danish high schools. In: Proceedings of the 15th Australasian Computing Education Conference (ACE 2013), Adelaide, Australia. CRPIT, 136. Angela Carbone and Jacqueline Whalley Eds., ACS. pp. 137–143
Chang, H.Y., Wang, C.Y., Lee, M.H., Wu, H.K., Liang, J.C., Lee, S.W.Y., Chiou, G.L., Lo, H.C., Lin, J.W., Hsu, C.Y., Wu, Y.T., Chen, S., Hwang, F.K., Tsai, C.C.: A review of features of technology-supported learning environments based on participants’ perceptions. Comput. Hum. Behav. 53, 223–237 (2015)
Chen, C.H., Chiu, C.H.: Employing intergroup competition in multitouch design-based learning to foster student engagement, learning achievement, and creativity. Comput. Educ. 103, 99–113 (2016)
Cheng, B., Yang, W.M., Kinshuk, S.J.H., Peng, J.: Acceptance of competency-based workplace e-Learning systems: effects of individual and peer learning support. Comput. Educ. 57(1), 1317–1333 (2011)
Cheville, R.A., McGovern, A., Bull, K.S.: The light applications in science and engineering research collaborative undergraduate laboratory for teaching (LASECULT)-relevant experiential learning in photonics. IEEE Trans. Educ. 48(2), 254–263 (2005)
Choi, J., An, S., Lee, Y.: Computing education in Korea—Current issues and endeavors. ACM Trans. Comput. Educ. 15(2), 8 (2015)
Computing Curricula: The overview report. IEEE CS, ACM Joint Task Force on Computing Curricula. IEEE Computer Society Press and ACM Press. (2005) http://www.acm.org/education/curric_vols/CC2005-March06Final.pdf. Accessed 12 Dec 2015
Cydis, S., Galantino, M.L., Hood, C., Padden, M., Richard, M.: Integrating and assessing essential learning outcomes: fostering faculty development and student engagement. J. Scholarsh. Teach. Learn. 15(3), 33–52 (2015)
Dharshini, A.P., Chandrakumarmangalam, S., Arthi, G.: Ant colony optimization for competency based learning objects sequencing in e-learning. Appl. Math. Comput. 263, 332–341 (2015)
Ding, J., Xiong, C., Liu, H.: Construction of a digital learning environment based on cloud computing. Br. J. Edu. Technol. 46(6), 1367–1377 (2015)
Doppelt, Y.: Assessing creative thinking in design-based learning. Int. J. Technol. Des. Educ. 19(1), 55–65 (2009)
Doppelt, Y., Mehalik, M.M., Schunn, C.D., Silk, E., Krysinski, D.: Engagement and achievements: a case study of design-based learning in a science context. J. Technol. Educ. 19(2), 22–39 (2008)
Duran, M., Hoft, M., Lawson, D.B., Medjahed, B., Orady, E.A.: Urban high school students’ IT/STEM learning: findings from a collaborative inquiry-and design-based afterschool program. J. Sci. Educ. Technol. 23(1), 116–137 (2014)
Dym, C.L., Agogino, A.M., Eris, O., Frey, D.D., Leifer, L.J.: Engineering design thinking, teaching, and learning. J. Eng. Educ. 94(1), 103–120 (2005)
Ellefson, M.R., Brinker, R.A., Vernacchio, V.J., Schunn, C.D.: Design-based learning for biology: genetic engineering experience improves understanding of gene expression. Biochem. Mol. Biol. Educ. 36(4), 292–298 (2008)
Fan, J.Y., Wang, Y.H., Chao, L.F., Jane, S.W., Hsu, L.L.: Performance evaluation of nursing students following competency-based education. Nurse Educ. Today 35(1), 97–103 (2015)
Fisher, M., King, J.: The self-directed learning readiness scale for nursing education revisited: a confirmatory factor analysis. Nurse Educ. Today 30(1), 44–48 (2010)
Fisher, M., King, J., Tague, G.: Development of a self-directed learning readiness scale for nursing education. Nurse Educ. Today 21(7), 516–525 (2001)
Gal-Ezer, J., Stephenson, C.: A tale of two countries: successes and challenges in k-12 computer science education in Israel and the United States. ACM Trans. Comput. Educ. 14(2), 8 (2014)
Gómez Puente, S.M., van Eijck, M., Jochems, W.: A sampled literature review of design-based learning approaches: a search for key characteristics. Int. J. Technol. Des. Educ. 23(3), 717–732 (2013)
Gómez Puente, S.M., van Eijck, M., Jochems, W.: Professional development for design-based learning in engineering education: a case study. Eur. J. Eng. Educ. 40(1), 14–31 (2015)
Greenhill, M., Metz, C., Stander, P.: Performance-based public administration: a viable approach to adult learning. Teach. Polit. Sci. 9(4), 197–204 (1982)
Guzdial, M.: Paving the way for computational thinking. Commun. ACM 51(8), 25–27 (2008)
Haelermans, C., Ghysels, J., Prince, F.: Increasing performance by differentiated teaching? Experimental evidence of the student benefits of digital differentiation. Br. J. Edu. Technol. 46(6), 1161–1174 (2014)
Haelermans, C., Ghysels, J., Prince, F.: A dataset of three educational technology experiments on differentiation, formative testing and feedback. Br. J. Edu. Technol. 46(5), 1102–1108 (2015)
Horzum, M.B., Kaymak, Z.D., Gungoren, O.C.: Structural equation modeling towards online learning readiness. Acad. Motiv. Perceived Learn. 15(3), 759–770 (2015)
Junus, I.S., Santoso, H.B., Isal, R.Y.K., Utomo, A.Y.: Usability evaluation of the student centered e-learning environment. Int. Rev. Res. Open Distrib. Learn. 16(4), 62–82 (2015)
Ke, F.: An implementation of design-based learning through creating educational computer games: A case study on mathematics learning during design and computing. Comput. Educ. 73, 26–39 (2014)
Kim, P., Suh, S., Song, S.: Development of a design-based learning curriculum through design-based research for a technology-enabled science classroom. Educ. Technol. Res. Dev. 63(4), 575–602 (2015)
King, E., Boyatt, R.: Exploring factors that influence adoption of e-learning within higher education. Br. J. Edu. Technol. 46(6), 1272–1280 (2015)
Knowles, M.S.: Self-directed Learning. Association Press, New York (1975)
Koulouri, T., Lauria, S., Macredie, R.D.: Teaching introductory programming: A quantitative evaluation of different approaches. ACM Trans. Comput. Educ. 14(4), 26 (2014)
Kovacs, P.J., Hutchison, E.D., Collins, K.S., Linde, L.B.: Norming or transforming: Feminist pedagogy and social work competencies. Affilia 28(3), 229–239 (2013)
Lacey, A., Murray, C.: Rethinking the regulatory environment of competency-based education. American Enterprise Institute, Washington, DC (2015). https://www.luminafoundation.org/files/resources/rethinking-the-cbe-regulatory-environment.pdf. Accessed 09 Dec 2015
Lai, H.J.: The influence of adult learners’ self-directed learning readiness and network literacy on online learning effectiveness: a study of civil servants in Taiwan. Educ. Technol. Soc. 14(2), 98–106 (2011)
Lai, C.L., Hwang, G.J.: A self-regulated flipped classroom approach to improving students’ learning performance in a mathematics course. Comput. Educ. 100, 126–140 (2016)
Laurillard, D.: Technology enhanced learning as a tool for pedagogical innovation. J. Philos. Educ. 42(3–4), 521–533 (2008)
Lee, T.S., Shen, P.D., Tsai, C.W.: Enhancing computing skills of low-achieving students via e-learning: a design experiment of web-based, problem-based learning and self-regulated learning. CyberPsychol. Behav. 11(4), 431–436 (2008)
Levy, Y., Ramim, M.M.: An assessment of competency-based simulations on e-learners’ manage-ment skills enhancements. Interdiscipl. J. e-Skills Life Long Learn. 11, 179–190 (2015)
Linge, N., Parsons, D.: Problem-based learning as an effective tool for teaching computer network design. IEEE Trans. Educ. 49(1), 5–10 (2006)
Loh, B., Reiser, B.J., Radinsky, J., Edelson, D.C., Gomez, L.M., Marshall, S.: Developing reflective inquiry practices: a case study of software, the teacher, and students. In: Crowley, K., Schunn, C., Okada, T. (eds.) Designing for Science: Implications from Everyday, Classroom, and Professional Settings, pp. 279–324. Erlbaum, Mahwah (2001)
Lyons, J.S., Brader, J.S.: Using the learning cycle to develop freshmen’s abilities to design and conduct experiments. Int. J. Mech. Eng. Educ. 32(2), 126–134 (2004)
Massey, A.P., Ramesh, V., Khatri, V.: Design, development and assessment of mobile applications: the case for problem-based learning. IEEE Trans. Educ. 49(2), 183–192 (2006)
McCarthy, J.: Enhancing feedback in higher education: Students’ attitudes towards online and in-class formative assessment feedback models. Act. Learn. High Educ. 18(2), 127–141 (2017)
McLaughlin, J.E., Griffin, L.M., Esserman, D.A., Davidson, C.A., Glatt, D.M., Roth, M.T., Gharkholonarehe, N., Mumper, R.J.: Pharmacy student engagement, performance, and perception in a flipped satellite classroom. Am. J. Pharmaceut. Educ. 77(9), 1–8 (2013)
Mehalik, M.M., Schunn, C.: What constitutes good design? A review of empirical studies of design processes. Int. J. Eng. Educ. 22(3), 519–532 (2006)
Northey, G., Govind, R., Bucic, T., Chylinski, M., Dolan, R., van Esch, P.: The effect of “here and now” learning on student engagement and academic achievement. Br. J. Edu. Technol. 49(2), 321–333 (2018)
Oh, E.G., Reeves, T.C.: Collaborating online: A logic model of online collaborative group work for adult learners. Int. J. Online Pedagogy Course Des. 5(3), 47–61 (2015). https://doi.org/10.4018/ijopcd.2015070104
Ouyang, F., Scharber, C.: Adapting the TPACK framework for online teaching within higher education. Int. J. Online Pedagogy Course Des. 8(1), 42–59 (2018)
Pijl-Zieber, E.M., Barton, S., Konkin, J., Awosoga, O., Caineet, V.: Competence and competency-based nursing education: finding our way through the issues. Nurse Educ. Today 34(5), 676–678 (2013)
Popova, V., Clougherty, R.J. Jr.: PLA binaries in the context of competency-based assessment. J. Contin. Higher Educ. 62, 56–58 (2014)
Raman, R., Venkatasubramanian, S., Achuthan, K., Nedungadi, P.: Computer science (CS) education in Indian schools: Situation analysis using Darmstadt model. ACM Trans. Comput. Educ. 15(2), 7 (2015)
Razzouk, R., Shute, V.: What is design thinking and why is it important? Rev. Educ. Res. 82(3), 330–348 (2012)
Rivenbark, W.C., Jacobson, W.: Three principles of competency-based learning: mission, mission, mission. J. Public Affairs Educ. 20(2), 181–192 (2014)
Semet, Y., Lutton, E., Collet, P.: Ant colony optimization for E-learning: observing the emergence of pedagogic suggestions. In IEEE SIS’03: IEEE Swarm Intelligence Symposium, pp. 46–52 (2003)
Shelley, M., Yildirim, A.: Transfer of learning in mathematics, science, and reading among students in Turkey: a study using 2009 PISA data. Int. J. Educ. Math. Sci. Technol. 1(2), 83–95 (2013)
Shen, P.D., Lee, T.H., Tsai, C.W.: Applying blended learning with web-mediated self-regulated learning to enhance vocational students’ computing skills and attention to learn. Interact. Learn. Environ. 19(2), 193–209 (2011)
Shin, M., Lee, Y.: Changing the landscape of teacher education via online teaching and learning. Techniques. Connect. Educ. Careers 83(9), 32–33 (2009)
Sicilia, M.A., Naeve, A.: Competencies and organizational learning: A conceptual framework. In: Sicilia, M.A. (ed.) Competencies in Organizational e-Learning: Concepts and Tools, pp. 1–9. Information Science Publishing, Hershey (2007)
Spady, W.G.: Competency-based education: A bandwagon in search of a definition. Educ. Res. 6(1), 9–14 (1977)
Stevens, B., Hyde, J., Knight, R., Shires, A., Alexander, R.: (2015), Competency-based training and assessment in Australian postgraduate clinical psychology education. Clinical psychologist. https://doi.org/10.1111/cp.12061/full. Accessed 09 Dec 2015
Swan, K., Day, S.L., Bogle, L.R., Matthews, D.B.: A collaborative, design-based approach to improving an online program. Internet Higher Educ. 21, 74–81 (2014)
The Design-Based Research Collective: Design-based research: an emerging paradigm for educational inquiry. Educ. Res. 32(1), 5–8 (2003)
Tilley, D.S.: Competency in nursing: a concept analysis. J. Contin. Educ. Nurs. 39(2), 58–64 (2008)
Tsai, C.W.: Facilitating students to earn computing certificates via blended learning in online problem-solving environment: A cross-course-orientation comparison. Int. J. Inf. Commun. Technol. Educ. 6(2), 11–23 (2010)
Tsai, C.W.: The role of teacher’s initiation in online pedagogy. Educ. Train. 54(6), 456–471 (2012)
Tsai, C.W.: A quasi-experimental study of a blended course integrated with refined web-mediated pedagogy of collaborative learning and self-regulated learning. Interact. Learn. Environ. 22(6), 737–751 (2014)
Tsai, C.W.: Investigating the effects of web-mediated design thinking and co-regulated learning on developing students’ computing skills in a blended course. Univ. Access Inf. Soc. 14(2), 295–305 (2015)
Tsai, C.W.: Exploring the effects of online team-based learning and co-regulated learning on students’ development of computing skills. Interact. Learn. Environ. 24(4), 665–680 (2016)
Tsai, C.W., Lee, T.H.: Developing an appropriate design for e-learning with web-mediated teaching methods to enhance low-achieving students’ computing skills: Five studies in e-learning implementation. Int. J. Dist. Educ. Technol. 10(1), 1–30 (2012)
Tsai, C.W., Shen, P.D.: The application of web and educational technologies in supporting web-enabled self-regulated learning in different computing course orientations. Int. J. Inf. Commun. Technol. Educ. 7(1), 70–79 (2011)
Tsai, C.W., Shen, P.D.: Improving undergraduates’ experience of online learning and involvement: An innovative online pedagogy. Int. J. Enterp. Inf. Syst. 9(3), 100–112 (2013)
Tsai, C.W., Shen, P.D., Huang, H.J.: Applying Open Course Ware to improve non-information majors’ computer skills and self-directed learning. Int. J. Open Source Softw. Process. 4(2), 1–15 (2012)
Van Doorn, J.R., Van Doorn, J.D.: (2014). The quest for knowledge transfer efficacy: blended teaching, online and in-class, with consideration of learning typologies for non-traditional and traditional students. Front. Psychol. 5
Vartiainen, H., Liljestrom, A., Enkenberg, J.: Design-oriented pedagogy for technology-enhanced learning to cross over the borders between formal and informal environments. J. Univ. Comput. Sci. 18(15), 2097–2119 (2012)
Voorhees, A.: Creating and implementing competency learning models. New Direct. Inst. Res. 2001(110), 83–95 (2001)
Whitworth, D.E., Wright, K.: Online assessment of learning and engagement in university laboratory practicals. Br. J. Edu. Technol. 46(6), 1201–1213 (2015)
Wiley, K.: Effects of a self-directed learning project and preference for structure on self-directed learning readiness. Nurs. Res. 32(3), 181–185 (1983)
Williams, B., Boyle, M., Winship, C., Brightwell, R., Devenish, S., Munro, G.: Examination of self-directed learning readiness of paramedic undergraduates: a multi-institutional study. J. Nurs. Educ. Pract. 3(2), 102–111 (2012)
Williams, B., Brown, T.: A confirmatory factor analysis of the self-directed learning readiness scale. Nurs. Health Sci. 15(4), 430–436 (2013)
Wing, J.M.: Computational thinking. Commun. ACM 49(3), 33–35 (2006)
Won, S.G.L., Evans, M.A., Carey, C., Schnittka, C.G.: Youth appropriation of social media for collaborative and facilitated design-based learning. Comput. Hum. Behav. 50, 385–391 (2015)
Yuan, H.B., Williams, B.A., Fang, J.B., Pang, D.: Chinese baccalaureate nursing students’ readiness for self-directed learning. Nurse Educ. Today 32, 427–431 (2012)
Yueh, H.P., Chen, T.L., Lin, W., Sheen, H.J.: Developing digital courseware for a virtual nano-biotechnology laboratory: a design-based research approach. Educ. Technol. Soc. 17(2), 158–168 (2014)
Yuen, T.T., Robbins, K.A.: A qualitative study of students’ computational thinking skills in a data-driven computing class. ACM Trans. Comput. Educ. 14(4), 27 (2014)
Acknowledgements
The author would like to express appreciation for the financial support of MOST research Grant 105-2511-S-130-001 from the Ministry of Science and Technology, Taiwan, ROC.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tsai, CW. Applying online competency-based learning and design-based learning to enhance the development of students’ skills in using PowerPoint and Word, self-directed learning readiness, and experience of online learning. Univ Access Inf Soc 19, 283–294 (2020). https://doi.org/10.1007/s10209-018-0640-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10209-018-0640-6