Skip to main content

Ex-Ante and Ex-Post Feature Evaluation of Online Courses Using the Kano Model

  • Conference paper
  • First Online:
Intelligent Tutoring Systems (ITS 2021)

Abstract

Evaluating the effectiveness of online courses and what makes or breaks e-learning pose several challenges. Assessing educational data is generally a multivariate problem of high dimensionality. The implementation is often costly, the experimentation setup is complex, and supervision needs technical expertise. This research proposes an ex-ante and ex-post comparison of online course features using the Kano method from customer satisfaction analysis. Undergraduate students were asked to fill out questionnaires before and after taking a fully functional online course to compare their perceived importance of e-learning features. Attitudes towards 12 features, including ease of use, multimedia inclusion, account settings, and other specific features were gathered. The questionnaire also included feedback on overall experience, general positive and negative elements, and a free-form field for comments and suggestions regarding online courses. The results of this experiment suggest a shift in how students perceive the importance of features associated with online courses after successful completion.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    From several questions asked by this student in the open-ended question section, the authors could infer an English comprehension of basic rather than none.

References

  1. Becher, T.: The significance of disciplinary differences. Stud. High. Educ. 19(2), 151–161 (1994). https://doi.org/10.1080/03075079412331382007

    Article  MathSciNet  Google Scholar 

  2. Berger, C., Blauth, R.E., Boger, D.: Kano’s methods for understanding customer-defined quality. Center Qual. Manage. J. 2, 3–36 (1993)

    Google Scholar 

  3. Chen, C., Sonnert, G., Sadler, P.M., Sasselov, D.D., Fredericks, C., Malan, D.J.: Going over the cliff: MOOC dropout behavior at chapter transition. Distance Educ. 41(1), 6–25 (2020). https://doi.org/10.1080/01587919.2020.1724772

    Article  Google Scholar 

  4. Chen, L.H., Kuo, Y.F.: Understanding e-learning service quality of a commercial bank by using kano’s model. Total Qual. Manage. Bus. Excellence 22(1), 99–116 (2011). https://doi.org/10.1080/14783363.2010.532345

    Article  Google Scholar 

  5. Chen, Y., Zhang, M.: MOOC student dropout: pattern and prevention. In: Proceedings of the ACM Turing 50th Celebration Conference - China. ACM TUR-C 2017, Association for Computing Machinery, New York, NY, USA (2017). https://doi.org/10.1145/3063955.3063959

  6. Dominici, G., Palumbo, F.: How to build an e-learning product: factors for student/customer satisfaction. Bus. Horiz. 56(1), 87–96 (2013)

    Article  Google Scholar 

  7. Goopio, J., Cheung, C.: The MOOC dropout phenomenon and retention strategies. J. Teach. Travel Tourism 1–21 (2020). https://doi.org/10.1080/15313220.2020.1809050

  8. Kano, N., Seraku, N., Takahashi, F., Tsuji, S.I.: Attractive quality and must-be quality. J. Japan. Soc. Qual. Control 14(2), 147–156 (1984). https://doi.org/10.20684/quality.14.2_147

  9. Katai, Z.: Promoting computational thinking of both sciences- and humanities-oriented students: an instructional and motivational design perspective. Educ. Tech. Res. Dev. 68(5), 2239–2261 (2020). https://doi.org/10.1007/s11423-020-09766-5

    Article  Google Scholar 

  10. Chen, L.H., Lin, H.C.: Integrating Kano’s model into e-learning satisfaction. In: 2007 IEEE International Conference on Industrial Engineering and Engineering Management, pp. 297–301 (2007). https://doi.org/10.1109/IEEM.2007.4419199

  11. Liyanagunawardena, T.R., Parslow, P., Williams, S.: Dropout: MOOC participants’ perspective. In: EMOOCs 2014, the Second MOOC European Stakeholders Summit, pp. 95–100, February 2014. http://centaur.reading.ac.uk/36002/

  12. Parasuraman, A., Zeithaml, V.A., Berry, L.: SERVQUAL: a multiple-item scale for measuring consumer perceptions of service quality. J. Retail. 64, 12–40 (1988)

    Google Scholar 

  13. Parasuraman, A., Zeithaml, V.A., Malhotra, A.: E-S-Qual: a multiple-item scale for assessing electronic service quality. J. Serv. Res. 7(3), 213–233 (2005). https://doi.org/10.1177/1094670504271156

    Article  Google Scholar 

  14. Selim, H.M.: Critical success factors for e-learning acceptance: confirmatory factor models. Comput. Educ. 49(2), 396–413 (2007)

    Article  MathSciNet  Google Scholar 

  15. Sun, P.C., Tsai, R.J., Finger, G., Chen, Y.Y., Yeh, D.: What drives a successful e-learning? An empirical investigation of the critical factors influencing learner satisfaction. Comput. Educ. 50(4), 1183–1202 (2008)

    Article  Google Scholar 

  16. Violante, M.G., Vezzetti, E.: Virtual interactive e-learning application: an evaluation of the student satisfaction. Comput. Appl. Eng. Educ. 23(1), 72–91 (2015). https://doi.org/10.1002/cae.21580

    Article  Google Scholar 

  17. Wang, Y.S., Bauk, S., Šćepanović, S., Kopp, M.: Estimating students’ satisfaction with web based learning system in blended learning environment. Educ. Res. Int. 2014 (2014). https://doi.org/10.1155/2014/731720

  18. Wang, Y.S., Wang, H.Y., Shee, D.Y.: Measuring e-learning systems success in an organizational context: scale development and validation. Comput. Hum. Behav. 23(4), 1792–1808 (2007)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daniel Moritz Marutschke .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Marutschke, D.M., Hayashi, Y. (2021). Ex-Ante and Ex-Post Feature Evaluation of Online Courses Using the Kano Model. In: Cristea, A.I., Troussas, C. (eds) Intelligent Tutoring Systems. ITS 2021. Lecture Notes in Computer Science(), vol 12677. Springer, Cham. https://doi.org/10.1007/978-3-030-80421-3_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-80421-3_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-80420-6

  • Online ISBN: 978-3-030-80421-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics