Abstract
Evaluating the effectiveness of online courses and what makes or breaks e-learning pose several challenges. Assessing educational data is generally a multivariate problem of high dimensionality. The implementation is often costly, the experimentation setup is complex, and supervision needs technical expertise. This research proposes an ex-ante and ex-post comparison of online course features using the Kano method from customer satisfaction analysis. Undergraduate students were asked to fill out questionnaires before and after taking a fully functional online course to compare their perceived importance of e-learning features. Attitudes towards 12 features, including ease of use, multimedia inclusion, account settings, and other specific features were gathered. The questionnaire also included feedback on overall experience, general positive and negative elements, and a free-form field for comments and suggestions regarding online courses. The results of this experiment suggest a shift in how students perceive the importance of features associated with online courses after successful completion.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
From several questions asked by this student in the open-ended question section, the authors could infer an English comprehension of basic rather than none.
References
Becher, T.: The significance of disciplinary differences. Stud. High. Educ. 19(2), 151–161 (1994). https://doi.org/10.1080/03075079412331382007
Berger, C., Blauth, R.E., Boger, D.: Kano’s methods for understanding customer-defined quality. Center Qual. Manage. J. 2, 3–36 (1993)
Chen, C., Sonnert, G., Sadler, P.M., Sasselov, D.D., Fredericks, C., Malan, D.J.: Going over the cliff: MOOC dropout behavior at chapter transition. Distance Educ. 41(1), 6–25 (2020). https://doi.org/10.1080/01587919.2020.1724772
Chen, L.H., Kuo, Y.F.: Understanding e-learning service quality of a commercial bank by using kano’s model. Total Qual. Manage. Bus. Excellence 22(1), 99–116 (2011). https://doi.org/10.1080/14783363.2010.532345
Chen, Y., Zhang, M.: MOOC student dropout: pattern and prevention. In: Proceedings of the ACM Turing 50th Celebration Conference - China. ACM TUR-C 2017, Association for Computing Machinery, New York, NY, USA (2017). https://doi.org/10.1145/3063955.3063959
Dominici, G., Palumbo, F.: How to build an e-learning product: factors for student/customer satisfaction. Bus. Horiz. 56(1), 87–96 (2013)
Goopio, J., Cheung, C.: The MOOC dropout phenomenon and retention strategies. J. Teach. Travel Tourism 1–21 (2020). https://doi.org/10.1080/15313220.2020.1809050
Kano, N., Seraku, N., Takahashi, F., Tsuji, S.I.: Attractive quality and must-be quality. J. Japan. Soc. Qual. Control 14(2), 147–156 (1984). https://doi.org/10.20684/quality.14.2_147
Katai, Z.: Promoting computational thinking of both sciences- and humanities-oriented students: an instructional and motivational design perspective. Educ. Tech. Res. Dev. 68(5), 2239–2261 (2020). https://doi.org/10.1007/s11423-020-09766-5
Chen, L.H., Lin, H.C.: Integrating Kano’s model into e-learning satisfaction. In: 2007 IEEE International Conference on Industrial Engineering and Engineering Management, pp. 297–301 (2007). https://doi.org/10.1109/IEEM.2007.4419199
Liyanagunawardena, T.R., Parslow, P., Williams, S.: Dropout: MOOC participants’ perspective. In: EMOOCs 2014, the Second MOOC European Stakeholders Summit, pp. 95–100, February 2014. http://centaur.reading.ac.uk/36002/
Parasuraman, A., Zeithaml, V.A., Berry, L.: SERVQUAL: a multiple-item scale for measuring consumer perceptions of service quality. J. Retail. 64, 12–40 (1988)
Parasuraman, A., Zeithaml, V.A., Malhotra, A.: E-S-Qual: a multiple-item scale for assessing electronic service quality. J. Serv. Res. 7(3), 213–233 (2005). https://doi.org/10.1177/1094670504271156
Selim, H.M.: Critical success factors for e-learning acceptance: confirmatory factor models. Comput. Educ. 49(2), 396–413 (2007)
Sun, P.C., Tsai, R.J., Finger, G., Chen, Y.Y., Yeh, D.: What drives a successful e-learning? An empirical investigation of the critical factors influencing learner satisfaction. Comput. Educ. 50(4), 1183–1202 (2008)
Violante, M.G., Vezzetti, E.: Virtual interactive e-learning application: an evaluation of the student satisfaction. Comput. Appl. Eng. Educ. 23(1), 72–91 (2015). https://doi.org/10.1002/cae.21580
Wang, Y.S., Bauk, S., Šćepanović, S., Kopp, M.: Estimating students’ satisfaction with web based learning system in blended learning environment. Educ. Res. Int. 2014 (2014). https://doi.org/10.1155/2014/731720
Wang, Y.S., Wang, H.Y., Shee, D.Y.: Measuring e-learning systems success in an organizational context: scale development and validation. Comput. Hum. Behav. 23(4), 1792–1808 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Marutschke, D.M., Hayashi, Y. (2021). Ex-Ante and Ex-Post Feature Evaluation of Online Courses Using the Kano Model. In: Cristea, A.I., Troussas, C. (eds) Intelligent Tutoring Systems. ITS 2021. Lecture Notes in Computer Science(), vol 12677. Springer, Cham. https://doi.org/10.1007/978-3-030-80421-3_34
Download citation
DOI: https://doi.org/10.1007/978-3-030-80421-3_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-80420-6
Online ISBN: 978-3-030-80421-3
eBook Packages: Computer ScienceComputer Science (R0)