Skip to main content

Examining an e-learning system through the lens of the information systems success model: Empirical evidence from Italy

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

This study aims to examine an e-learning system based on student perceptions through employing the Information Systems Success Model (IS Success Model). The study is built on the assumption that system quality and information quality affect the system use and user satisfaction and in turn system success. The survey data was collected from 144 students who use an e-learning system at a public university in Rome, Italy. The data was subject to PLS path-modeling analysis via Smart PLS 3.0. The empirical results, which are drawn from the students’ self-reported perceptional evaluations about the e-learning system confirm that whereas system quality has significant impact on both system usage and user satisfaction, information quality has significant impact only on user satisfaction. Moreover, the author also found that both user satisfaction and system usage have positive and significant impacts on system success.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Abbreviations

IS Success Model:

information systems success model

PLS:

partial least squares

SEM:

structural equation modeling

References

  • Allen, I. E., & Seaman, J. (2016). Online report card: Tracking online education in the United States. Babson survey research group.

  • Aparicio, M., Bacao, F., & Oliveira, T. (2017). Grit in the path to e-learning success. Computers in Human Behavior, 66, 388–399.

    Google Scholar 

  • Auld, D. P., Blumberg, F. C., & Clayton, K. (2010). Linkages between motivation, self-efficacy, self-regulated learning and preferences for traditional learning environments or those with an online component. Digital Culture & Education, 2(2), 128–143.

    Google Scholar 

  • Bharati, P. (2003). People and information matter: Task support satisfaction from the other side. The Journal of Computer Information Systems, 43(2), 93–102.

    MathSciNet  Google Scholar 

  • Bhuasiri, W., Xaymoungkhoun, O., Zo, H., Rho, J. J., & Ciganek, A. P. (2012). Critical success factors for e-learning in developing countries: A comparative analysis between ICT experts and faculty. Computers & Education, 58(2), 843–855.

    Google Scholar 

  • Chin, W. W. (1998). The partial least squares approach to structural equation modeling. In G. A. Marcoulides (Ed.), Modern methods for business research (pp. 295–336). New York: Taylor & Francis Group.

    Google Scholar 

  • Chin, W. W. (2010). How to write up and report PLS analyses. In V. Esposito Vinzi, W. W. Chin, J. Henseler, & H. Wang (Eds.), Handbook of partial least squares: Concepts, methods and applications (pp. 655–690). Berlin, Heidelberg: Springer.

    Google Scholar 

  • Chiu, C. M., & Wang, E. T. (2008). Understanding web-based learning continuance intention: The role of subjective task value. Information & Management, 45(3), 194–201.

    MathSciNet  Google Scholar 

  • Cidral, W. A., Oliveira, T., Di Felice, M., & Aparicio, M. (2018). E-learning success determinants: Brazilian empirical study. Computers & Education, 122, 273–290.

    Google Scholar 

  • Clayton, K., Blumberg, F., & Auld, D. P. (2010). The relationship between motivation, learning strategies and choice of environment whether traditional or including an online component. British Journal of Educational Technology, 41(3), 349–364.

    Google Scholar 

  • Clayton, K. E., Blumberg, F. C., & Anthony, J. A. (2018). Linkages between course status, perceived course value, and students’ preference for traditional versus non-traditional learning environments. Computers & Education, 125, 175–181.

    Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale: Lawrence Erlbaum.

    MATH  Google Scholar 

  • Czerniewicz, L., & Brown, C. (2009). A study of the relationship between institutional policy, organisational culture and e-learning use in four south African universities. Computers & Education, 53(1), 121–131.

    Google Scholar 

  • Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340.

    Google Scholar 

  • DeLone, W. H., & McLean, E. R. (1992). Information systems success: The quest for the dependent variable. Information systems research, 3(1), 60–95.

  • Delone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: A ten-year update. Journal of management information systems, 19(4), 9–30.

  • DeLone, W. H., & Mclean, E. R. (2004). Measuring e-commerce success: Applying the DeLone & McLean information systems success model. International Journal of Electronic Commerce, 9(1), 31–47.

    Google Scholar 

  • Fallon, C., & ve Brown, S. (2003). E-learning standards: A guide to purchasing, Developing and deploying Standarts-conformant E-learning. Florida: CRC Press.

    Google Scholar 

  • Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention and behavior: An introduction to theory and research. Boston: Reading, MA: Addison-Wesley.

  • Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.2307/3151312.

    Article  Google Scholar 

  • Freeze, R. D., Alshare, K. A., Lane, P. L., & Wen, H. J. (2010). IS success model in e-learning context based on students' perceptions. Journal of Information Systems Education, 21(2), 173.

    Google Scholar 

  • Gill, G. (2006). Asynchronous discussion groups: A use-based taxonomy with examples. Journal of Information Systems Education, 17(4), 373.

    Google Scholar 

  • Guimaraes, T., Armstrong, C. P., & Jones, B. M. (2009). A new approach to measuring information systems quality. The Quality Management Journal, 16(1), 42–51.

    Google Scholar 

  • Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis - a global perspective (7th ed.). Upper Saddle River: Pearson.

    Google Scholar 

  • Hair, J. F., Sarstedt, M., Pieper, T. M., & Ringle, C. M. (2012). The use of partial least squares structural equation modeling in strategic management research: A review of past practices and recommendations for future applications. Long Range Planning, 45(5), 320–340. https://doi.org/10.1016/j.lrp.2012.09.008.

    Article  Google Scholar 

  • Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling (PLS-SEM) (2nd ed.). Thousands Oak: Sage Publications.

    MATH  Google Scholar 

  • Halawi, L. A., McCarthy, R. V., & Aronson, J. E. (2008). An empirical investigation of knowledge management systems' success. The Journal of Computer Information Systems, 48(2), 121–135.

    Google Scholar 

  • Hassanzadeh, A., Kanaani, F., & Elahi, S. (2012). A model for measuring e-learning systems success in universities. Expert Systems with Applications, 39(12), 10959–10966.

    Google Scholar 

  • Henseler, J., Ringle, C. M., & Sinkovics, R. R. (2009). The use of partial least squares path modeling in international marketing. In R. R. Sinkovics & P. N. Ghauri (Eds.), Advances in international marketing (Vol. 20, pp. 277–320). Bingley: Emerald.

    Google Scholar 

  • Liaw, S. S., Huang, H. M., & Chen, G. D. (2007). Surveying instructor and learner attitudes toward e-learning. Computers & Education, 49(4), 1066–1080.

    Google Scholar 

  • Lin, H.-Y., Hsu, P.-Y., & Ting, P.-H. (2006). ERP systems success: An integration of IS success model and balanced scorecard. Journal of Research and Practice in Information Technology, 38(3), 215–228.

    Google Scholar 

  • Loewenthal, K. M. (2001). An introduction to psychological tests and scales: Psychology Press.

  • Marshall, J., Greenberg, H., & Machun, P. A. (2012). How would they choose? Online student preferences for advance course information. Open Learning: The Journal of Open, Distance and e-Learning, 27(3), 249–263.

    Google Scholar 

  • McGill, T. J., & Klobas, J. E. (2009). A task–technology fit view of learning management system impact. Computers & Education, 52(2), 496–508.

    Google Scholar 

  • McGill, T. J., Klobas, J. E., & Renzi, S. (2014). Critical success factors for the continuation of e-learning initiatives. The Internet and Higher Education, 22, 24–36.

    Google Scholar 

  • Mohammadi, H. (2015). Investigating users’ perspectives on e-learning: An integration of TAM and IS success model. Computers in Human Behavior, 45, 359–374.

    Google Scholar 

  • Nunnally, J. (1978). Psychometric methods. New York: McGraw-Hill.

    Google Scholar 

  • Nunnally, J. C., & Bernstein, I. (1994). The assessment of reliability. Psychometric Theory, 3(1), 248–292.

    Google Scholar 

  • Peña-Ayala, A., Sossa, H., & Méndez, I. (2014). Activity theory as a framework for building adaptive e-learning systems: A case to provide empirical evidence. Computers in Human Behavior, 30, 131–145.

    Google Scholar 

  • Petter, S., DeLone, W., & McLean, E. (2008). Measuring information systems success: Models, dimensions, measures, and interrelationships. European Journal of Information Systems, 17(3), 236–263.

    Google Scholar 

  • Petter, S., DeLone, W., & McLean, E. R. (2012). The past, present, and future of" IS Success". Journal of the Association for Information Systems, 13(5), 341–362.

    Google Scholar 

  • Ringle, C. M., Sarstedt, M., & Straub, D. (2012). Editor's comments: A critical look at the use of PLS-SEM in MIS quarterly. MIS Quarterly (MISQ), 36(1), iii–xiv.

    Google Scholar 

  • Ringle, C. M., Wende, S., & Becker, J.-M. (2014). SmartPLS 3. Hamburg: SmartPLS.

    Google Scholar 

  • Rossin, D., Ro, Y. K., Klein, B. D., & Guo, Y. M. (2009). The effects of flow on learning outcomes in an online information management course. Journal of Information Systems Education, 20(1), 87.

    Google Scholar 

  • Seddon, P. B. (1997). A respecification and extension of the DeLone and McLean model of IS success. Information Systems Research, 8(3), 240–253.

    Google Scholar 

  • Seddon, P., & Kiew, M. Y. (1996). A partial test and development of DeLone and McLean’s model of IS success. Australasian Journal of Information Systems, 4(1). https://doi.org/10.3127/ajis.v4i1.379.

  • Sun, P. C., Tsai, R. J., Finger, G., Chen, Y. Y., & Yeh, D. (2008). What drives a successful e-learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers & Education, 50(4), 1183–1202.

    Google Scholar 

  • Swaid, S. I., & Wigand, R. T. (2009). Measuring the quality of e-service: Scale development and initial validation. Journal of Electronic Commerce Research, 10(1), 13.

    Google Scholar 

  • Van der Heijden, H. (2004). User acceptance of hedonic information systems. MIS Quarterly, 28, 695–704.

    Google Scholar 

  • Viberg, O., & Grönlund, Å. (2013). Cross-cultural analysis of users' attitudes toward the use of mobile devices in second and foreign language learning in higher education: A case from Sweden and China. Computers & Education, 69, 169–180.

    Google Scholar 

  • Wang, W.-T., & Wang, C.-C. (2009). An empirical study of instructor adoption of web-based learning systems. Computers & Education, 53(3), 761–774.

    Google Scholar 

  • Zhang, D., & Nunamaker, J. F. (2003). Powering e-learning in the new millennium: An overview of e-learning and enabling technology. Information Systems Frontiers, 5(2), 207–218.

    Google Scholar 

Download references

Acknowledgements

The author would like express her gratitude to the students who devoted their times for participating in the survey at the University of Rome Tor Vergata.

Author information

Authors and Affiliations

Authors

Contributions

The author read and approved the final manuscript.

Corresponding author

Correspondence to Özlem Efiloğlu Kurt.

Ethics declarations

Competing interests

The author declares that she has no competing interests.

The author also confirms that the content of the manuscript has not been published or submitted for publication to any other outlets.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Based on e-learning systems, the paper applies the Information System Success Model, which has been a widely recognised theoretical model in the relevant literature. It aims at investigating the IS Success model through the lens of students’ perspectives on e-learning systems by collecting survey data from students who are registered for an e-learning system in a state university in Italy. This enables testing the model in a different country and a new learning system in which students are taught only through online modules. This study offers fresh insights about online learning systems which are being widely applied in today’s higher education environment. Hence, this study fits well into the aims and scope of Education and Information Technologies Journal.

Appendix

Appendix

Table 4 The survey items in english

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Efiloğlu Kurt, Ö. Examining an e-learning system through the lens of the information systems success model: Empirical evidence from Italy. Educ Inf Technol 24, 1173–1184 (2019). https://doi.org/10.1007/s10639-018-9821-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-018-9821-4

Keywords