Skip to main content

Advertisement

Log in

The effect of usability on the intention to use the e-learning system in a sustainable way: A case study at Universitas Indonesia

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

E-Learning has been massively used in higher education, one of which is in Universitas Indonesia. The e-learning system in Universitas Indonesia is called Student Centered E-Learning Environment Universitas Indonesia (SCELE UI). This research determines the effect of usability on the intention to use SCELE UI in a sustainable way. The Expectation Confirmation Model (ECM) is used as a basis of the research model. Perceived Usability, Learnability, Presentation, Navigation and Error variables are added to the model. The Partial Least Square is used to analyze and test the model. Of the 12 proposed hypotheses, 10 hypotheses were accepted and 2 hypotheses were rejected. This research gives theoretical and practical contributions. On the theoretical side, this research successfully proposes and examines the integration of usability and ECM in the context of sustain e-learning usage intention. This research reveals the indirect effect of Perceived Usability on continued usage intention of the e-learning system. On the practical side, this research also provides insights for developers and universities that can help them to effectively foster the improvement of their system that can ensure sustained usage by their students.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Availability of data and materials

The authors can not share the data as this may breach participant confidentiality.

References

  • Abran, A., Khelifi, A., Suryn, W., & Seffah, A. (2003). Usability meanings and interpretations in ISO standards. Software Quality Journal, 11, 325–338.

    Article  Google Scholar 

  • Ahmadi, N., Romoser, M. R., Guarnieri, L. M., Kry, T. G., & Porter-Fyke, E. I. (2019). Application of eye tracking technology in naturalistic usability assessment of an academic library website. In T. Z. Ahram and C. Falcão (Eds.): AHFE 2018, AISC 794 (pp. 729–740). Switzerland: Springer Nature.

  • Akrimi, Y., & Khemakhem, P. R. (2014). An analysis of perceived usability, perceived interactivity and website personality and their effects on consumer satisfaction. International Journal of Management Excellence, 2(3), 227–236.

    Article  Google Scholar 

  • Akugizibwe, E., & Ahn, J. Y. (2020). Perspectives for effective integration of e-learning tools in university mathematics instruction for developing countries. Education and Information Technologies, 25, 889–903.

    Article  Google Scholar 

  • Al-Fraihat, D., Joy, M., Masa’deh, R., & Sinclair, J. (2020). Evaluating e-learning systems success: An empirical study. Computers in Human Behavior, 102, 67–86.

    Article  Google Scholar 

  • Alotaibi, K. J. (2017). Gathering of usability requirements by Saudi e-learning software developers. Proceedings of the 8th International Conference on Information Technology (ICIT) (pp. 255–261). https://doi.org/10.1109/ICITECH.2017.8080009

  • Alshammari, M., Anane, R., & Hendley, R. J., et al. (2015). Design and usability evaluation of adaptive e-learning systems based on learner knowledge and learning style. In J. Abascal (Ed.), INTERACT 2015, Part II, LNCS 9297 (pp. 584–591). Switzerland.

    Google Scholar 

  • Alshehri, A., Rutter, M., & Smith, S. (2019). Assessing the relative importance of an e-learning system’s usability design characteristics based on students’ preferences. European Journal of Educational Research, 8(3), 839–855. https://doi.org/10.12973/eu-jer.8.3.839

    Article  Google Scholar 

  • Alves, R., & Nunes, N. J. (2016). Ceiling and threshold of PaaS tools: The role of learnability in tool adoption. In C. Bogdan et al. (Eds.): HCSE 2016/HESSD 2016, LNCS 9856 (pp. 335–347). Switzerland: Springer.

  • Ambalov, I. A. (2018). A meta-analysis of IT continuance: An evaluation of the expectation-confirmation model. Telematics and Informatics, 35, 1561–1571.

    Article  Google Scholar 

  • Ammar, L. S., Trabelsi, A., & Mahfoudhi, A. (2016). A model-driven approach for usability engineering of interactive systems. Software Quality Journal, 24, 301–335. https://doi.org/10.1007/s11219-014-9266-y1892

    Article  Google Scholar 

  • Ardito, C., Costabile, M. F., De Marsico, M., Lanzilotti, R., Levialdi, S., Roselli, T., & Rossano, V. (2006). An approach to usability evaluation of e-learning applications. Universal Access in the Information Society, 4, 270–283.

    Article  Google Scholar 

  • Arning, K., Himmel, S., & Ziefle, M. (2016). You can(’t) teach an old dog new tricks: Analyzing the learnability of manufacturing software systems in older users. In J. Zhou and G. Salvendy (Eds.): ITAP 2016, PartII, LNCS 9755 (pp. 277–288). Switzerland: Springer.

  • Belanche, D., Casalo´, L., & Guinalı, M. (2012). Website usability, consumer satisfaction and the intention to use a website: The moderating effect of perceived risk. Journal of Retailing and Consumer Services, 19, 124–132.

    Article  Google Scholar 

  • Bhattacherjee, A. (2001). Understanding information systems continuance: An expectation-confirmation model. Management Information Systems Quarterly, 25(3), 351–370.

    Article  Google Scholar 

  • Bolen, M.C. (2020). Exploring the determinants of users’ continuance intention in smartwatches. Technology in Society, 60.https://doi.org/10.1016/j.techsoc.2019.101209

  • Bourges-Waldegg, P., & Scrivener, A. (1998). Meaning: The central issue in cross-cultural HCI design. Interacting with Computers, 9(3), 287–309.

    Article  Google Scholar 

  • Cabero-Almenara, J., Marín-Díaz, V., & Sampedro-Requena, B. E. (2016). Meta-analysis of research in e-learning published in Spanish journals. International Journal of Educational Technology in Higher Education, 13(25). https://doi.org/10.1186/s41239-016-0023-0

  • Casalo, L., Flavian, C., & Guinalíu, M. (2008). The role of perceived usability, reputation, satisfaction and consumer familiarity on the website loyalty formationprocess. Computers in Human Behavior, 24, 325–345.

    Article  Google Scholar 

  • Castañeda, L., & Selwyn, N. (2018). More than tools? Making sense of the ongoing digitizations of higher education. International Journal of Educational Technology in Higher Education, 15(22). https://doi.org/10.1186/s41239-018-0109-y

  • Chen, C. P., Lai, H. M., & Ho, C. Y. (2015). Why do teachers continue to use teaching blogs? The roles of perceived voluntariness and habit. Computers & Education, 82, 236–249. https://doi.org/10.1016/j.compedu.2014.11.017

    Article  Google Scholar 

  • Chen, S. C., Yen, D. C., & Peng, S. C. (2018a). Assessing the impact of determinants in e-magazines acceptance: An empirical study. Computer Standards & Interfaces, 57, 49–58.

    Article  Google Scholar 

  • Chen, Y., Yang, L., Zhang, M., & Yang, J. (2018b). Central or peripheral? Cognition elaboration cues’ effect on users’ continuance intention of mobile health applications in the developing markets. International Journal of Medical Informatics, 116, 33–45.

    Article  Google Scholar 

  • Cheng, M., & Yuen, A. H. K. (2019). Cultural divides in acceptance and continuance of learning management system use: A longitudinal study of teenagers. Educational Technology Research and Development, 67, 1613–1637. https://doi.org/10.1007/s11423-019-09680-5

    Article  Google Scholar 

  • Cheng, Y. M. (2021). Can tasks and learning be balanced? A dual-pathway model of cloud-based e-learning continuance intention and performance outcomes. Kybernetes. https://doi.org/10.1108/K-07-2020-0440

  • Chin, W. W. (1998). The partial least squares approach for structural equation modeling. In G. A. Macoulides (Ed.), Modern methods for business research. Mahwah (pp. 295–336). NJ: Lawrence Erlbaum Associates

  • Choi, B. C. F., & Lee, N. T. (2015). A study on mobile fitness application usage. In F. F. H. Nah & C. H. Tan (Eds.), HCIB 2015, LNCS 9191 (pp. 446–457). Switzerland.

    Google Scholar 

  • Chow, W.C., & Shi, S. (2014). Investigating students’ satisfaction and continuance intention toward e-learning: An extension of the expectation–confirmation model. In Procedia - Social and Behavioral Sciences, 141, (pp. 1145 – 1149). https://doi.org/10.1016/j.sbspro.2014.05.193

  • Daghan, G., & Akkoyunlu, B. (2016). Modeling the continuance usage intention of online learning environments. Computers in Human Behavior, 60, 198–211. https://doi.org/10.1016/j.chb.2016.02.066

    Article  Google Scholar 

  • Darmawan, A. K., Siahaan, D. O., Susanto, T. D., Hoiriyah, Umam, B. A., & Bakir, B. (2020). Understanding Indonesian citizen's continuance itention to use mobile-based smart city: A perspective of modified expectation confirmation model (M-ECM). In Proceedings of the 7th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE). https://doi.org/10.1109/ICITACEE50144.2020.9239157

  • Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319. https://doi.org/10.2307/249008

    Article  Google Scholar 

  • DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success : A ten-year update. Journal of Management Information Systems, 19(4), 9–30.

    Article  Google Scholar 

  • Demangeot, C., & Broderick, A. J. (2006). Exploring the experiential intensity of online shopping environments. Qualitative Market Research: An International Journal, 9(4), 325–351.

    Article  Google Scholar 

  • Digión, L. B., & Sosa, M., et al. (2012). Communicability and usability for the interface in e-learning. In F. V. Cipolla-Ficarra (Ed.), ADNTIIC 2011, LNCS 7547 (pp. 165–172). Berlin.

    Google Scholar 

  • Eltahir, M. E., Al-Qatawneh, S., Al-Ramahi, N., & Alsalhi, N. (2019). The perspective of students and faculty members on the efficiency and usability of e-learning courses at Ajman university: A case study. Journal of Technology and Science Education, 9(3), 388–403. https://doi.org/10.3926/jotse.590

    Article  Google Scholar 

  • Eze, S. C., Chinedu-Eze, V. C., & Bello, A. O. (2018). The utilisation of e-learning facilities in the educational delivery system of Nigeria: a study of M-University. International Journal of Educational Technology in Higher Education, 15(34). https://doi.org/10.1186/s41239-018-0116-z

  • Fang, X., & Holsapple, C. W. (2011). A model-driven approach for usability engineering of interactive systems. Information Systems Frontiers, 13, 453–469. https://doi.org/10.1007/s10796-010-9227-3

    Article  Google Scholar 

  • Fernandez, A., Abrahão, S., & Insfran, E. (2011). A web usability evaluation process for model-driven web development. In H. Mouratidis and C. Rolland (Eds.): CAiSE 2011, LNCS 6741 (pp. 108–122). Berlin: Springer-Verlag.

  • Findlater, L., & Mcgrenere, J. (2008). Impact of screen size on performance, awareness, and user satisfaction with adaptive graphical user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1247–1256). https://doi.org/10.1145/1357054.1357249

  • Findlater, L., Moffatt, K., Mcgrenere, J., & Dawson, J. (2009). Ephemeral adaptation: The use of gradual onset to improve menu selection performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1655–1664). https://doi.org/10.1145/1518701.1518956

  • Flavián, C., Longás, L., & Lozano, J. (2013). E-learning and market orientation in higher education. Education and Information Technologies, 18, 69–83.

    Article  Google Scholar 

  • Fu, X., Zhang, J., & Chan, F. T. S. (2018). Determinants of loyalty to public transit: A model integrating satisfaction-loyalty theory and expectation-confirmation theory. Transportation Research Part a: Policy and Practice, 113, 476–490.

    Google Scholar 

  • Gajos, K., Wobbrock, J., & Weld, D. (2008). Improving the performance of motor-impaired users with automatically - generated, ability-based interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1257–1266). https://doi.org/10.1145/1357054.1357250

  • Gamberini, L., & Valentini, E. (2003). Web usability today: Theories, approach and methods. In G. Riva & C. Galimberti (Eds.), Towards CyberPsychology: Mind, Cognitions and Society in the Internet Age (pp. 109–126). Amsterdam.

    Google Scholar 

  • Geng, R., & Tian, J. (2015). Improving web navigation usability by comparing actual and anticipated usage. IEEE Transactions on Human-Machine Systems, 45(1), 84–94. https://doi.org/10.1109/THMS.2014.2363125

    Article  MathSciNet  Google Scholar 

  • Ghavifekr, S., & Mahmood, H. (2017). Factors affecting use of e-learning platform (SPeCTRUM) among University students in Malaysia. Education and Information Technologies, 22, 75–100.

    Article  Google Scholar 

  • Greenberg, S., & Witten, I. (1985). Adaptive personalized interfaces - A question of viability. Behaviour and Information Technology, 4, 31–45.

    Article  Google Scholar 

  • Harefa, E. B. (2020). Usability measurement of google classroom applications as e-learning for students of department of building engineering education IKIP gunung sitoli. Indonesian Science Education Research, 2(1), 11–14.

    Google Scholar 

  • Heimgartner, R. (2005). Towards cross-cultural adaptive human-machine-interaction in automotive navigation systems. In Proceedings of the Seventh International Workshop on Internationalisation of Products and Systems (pp. 97–111).

  • Heimgartner, R., Tiede, L. W., Leimbach, J., Zehner, S., & Windl, H. (2007). Towards cultural adaptability to broaden universal access in future interfaces of driver information systems. In Stephanidis C. (Ed.), Universal Access in Human-Computer Interaction. Ambient Interaction (pp. 383–392). Springer, Berlin, Heidelberg.

  • Henseler, J., Ringle, C. M., & Sarstedt, M. (2012). Using partial least squares path modeling in advertising research: Basic concepts and recent issues. Handbook of Research on International Advertising. https://doi.org/10.4337/9781781001042.00023

    Article  Google Scholar 

  • Höck, M., & Ringle, C. M. (2006). Strategic networks in the software industry: An empirical analysis of the value continuum. In IFSAM VIIIth World Congress.

    Google Scholar 

  • Holden, H. (2009). Assessing teachers’ acceptance and usage behavior of current job-related technologies. Unpublished Dissertation, University of Maryland Baltimore, County, Baltimore, MD. UMI # 3389007

  • Holzinger, A. (2005). Usability engineering methods for software developers. Communications of the ACM, 48(1), 71–74.

    Article  Google Scholar 

  • Hook, K. (1997). Evaluating the utility and usability of an adaptive hypermedia system. In Proceedings of the 2nd international conference on Intelligent user interfaces (pp. 179–186). https://doi.org/10.1145/238218.238320

  • Hussain, W., Hussain, O. K., Hussain, F. K., & Khan, M. Q. (2017). Usability evaluation of english, local and plain languages to enhance on-screen text readability: A use case of Pakistan. Global Journal of Flexible Systems Management, 18(1), 33–49. https://doi.org/10.1007/s40171-016-0146-0

    Article  Google Scholar 

  • Ibrahim, Y., & Hidayat-ur-Rehman, I. (2021). COVID-19 crisis and the continuous use of virtual classes. International Journal of Advanced and Applied Sciences, 8(4), 117–129. https://doi.org/10.21833/ijaas.2021.04.014

    Article  Google Scholar 

  • Islam, A. K. M. N. (2011). Antecedents of post-adoption expectations. T. Skersys et al. (Eds.): I3E 2011, IFIP AICT 353 (pp. 269–281). IFIP International Federation for Information Processing.

  • ISO 9241–11. (2018). Ergonomics of human-system interaction — Part 11: usability: Definitions and concepts. https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en. Accessed 3 Mar 2021

  • Kabir, M. A., Hossin, M. A., Mahmud, S. M. H., Noori, S. R. H., & Bhuiyan, T. (2018). Usability evaluation of mobile applications: An empirical analysis of supply chain management systems. Proceedings of the 4th International Conference on Computer and Communications (pp. 2525–2531). https://doi.org/10.1109/CompComm.2018.8780831

  • Kersten, G., Kersten, M., & Rakowski, W. (2002). Software and culture: Beyond the internationalization of the interface. Journal of Global Information Management, 10(4). https://doi.org/10.4018/jgim.2002100105

  • Kiili, K. (2002). Evaluating WAP usability: “What Usability?” Proceedings of the IEEE International Workshop on Wireless and Mobile Technologies in Education. https://doi.org/10.1109/WMTE.2002.1039245

    Article  Google Scholar 

  • Kim, B. (2010). An empirical investigation of mobile data service continuance: Incorporating the theory of planned behavior into the expectation–confirmation model. Expert Systems with Applications, 37, 7033–7039.

    Article  Google Scholar 

  • Kim, M. H., Ko, S. M., Mun, J. S., Ji, Y. G., & Jung, M. R. (2007). A usability study on personalized EPG (pEPG) UI of digital TV. In J. Jacko (Ed.): Human-Computer Interaction, Part III, HCII 2007, LNCS 4552 (pp. 892–901). Berlin: Springer-Verlag.

  • Kipkurui, N. G. P., & Ikoha, A. (2014). Evaluating usability of e-learning systems in universities. International Journal of Advanced Computer Science and Applications, 5(8).https://doi.org/10.14569/ijacsa.2014.050815

  • Kumar, A., Tadayoni, R., & Sorensen, L. T. (2015). Metric based efficiency analysis of educational erp system usability-using fuzzy model. In Proceedings of the Third International Conference on Image Information Processing (pp. 382–386). https://doi.org/10.1109/ICIIP.2015.7414801

  • Kumar, J. A., & Bervell, B. (2019). Google Classroom for mobile learning in higher education: Modelling the initial perceptions of students. Education and Information Technologies, 24(1), 1793–1817.

    Article  Google Scholar 

  • Kumar, J. A., Bervell, B., & Osman, S. (2020). Google classroom: Insights from Malaysian higher education students’ and instructors’ experiences. Education and Information Technologies, 25, 4175–4195.

    Article  Google Scholar 

  • Lacka, E., & Chong, A. (2016). Usability perspective on social media sites’ adoption in the B2B context. Industrial Marketing Management, 54, 80–91.

    Article  Google Scholar 

  • Lee, M. C. (2010). Explaining and predicting users’ continuance intention toward e-learning: An extension of the expectation–confirmation model. Computers & Education, 54, 506–516. https://doi.org/10.1016/j.compedu.2009.09.002

  • Leung, L., & Chen, C. (2019). E-health/m-health adoption and lifestyle improvements: Exploring the roles of technology readiness, the expectation-confirmation model, and health-related information activities. Telecommunications Policy, 43, 563–575. https://doi.org/10.1016/j.telpol.2019.01.005

    Article  Google Scholar 

  • Lin, C. C. (2013). Exploring the relationship between technology acceptance model and usability test. Information Technology and Management, 14, 243–245. https://doi.org/10.1007/s10799-013-0162-0

    Article  Google Scholar 

  • Lin, T. C., Huang, S. L., & Hsu, C. J. (2015). A dual-factor model of loyalty to IT product – The case of smartphones. International Journal of Information Management, 35, 215–228.

    Article  Google Scholar 

  • Mabanza, N. (2018). Evaluating the usability of flat panel displays: A case study of the faculty of engineering and information technology. In Proceedings of the International Conference on Advances in Big Data, Computing and Data Communication Systems (icABCD). https://doi.org/10.1109/ICABCD.2018.8465477

  • Milicevic, V., Denic, N., Milicevic, Z., Arsic, L., Spasic-Stojkovic, M., Petkovic, D., Stojanovic, J., Krkic, M., Milovancevic, N. S., & Jovanovic, A. (2021). E-learning perspectives in higher education institutions. Technological Forecasting & Social Change. https://doi.org/10.1016/j.techfore.2021.120618

    Article  Google Scholar 

  • Moraga, M. A., Calero, C., Piattini, M., & Diaz, O. (2007). Improving a portlet usability model. Software Quality Journal, 15, 155–177. https://doi.org/10.1007/s11219-006-9008-x

    Article  Google Scholar 

  • Nascimento, B., Oliveira, T., & Tam, C. (2018). Wearable technology: What explains continuance intention in smartwatches? Journal of Retailing and Consumer Services, 43, 157–169. https://doi.org/10.1016/j.jretconser.2018.03.017

    Article  Google Scholar 

  • Ngampornchai, A., & Adams, J. (2016). Students’ acceptance and readiness for e-learning in Northeastern Thailand. International Journal of Educational Technology in Higher Education, 13(34). https://doi.org/10.1186/s41239-016-0034-x

  • Nielsen, J. (1993). Usability engineering. Boston, EEUU: AP Professional

  • Nouman, N., & Umer, A. (2019). Web navigation and usability analysis of educational websites in Pakistan. In Proceedings of the Seventh International Conference on Digital Information Processing and Communications (ICDIPC) (pp. 57–62). https://doi.org/10.1109/ICDIPC.2019.8723704

  • Obienu, A. C., & Amadin, F. I. (2020). User acceptance of learning innovation: A structural equation modelling based on the GUAM framework. Education and Information Technologies. https://doi.org/10.1007/s10639-020-10341-x

    Article  Google Scholar 

  • Oghuma, A. P., Libaque-Saenz, C. F., Wong, S. F., & Chang, Y. (2016). An expectation-confirmation model of continuance intention to use mobile instant messaging. Telematics and Informatics, 33, 34–47.

    Article  Google Scholar 

  • Oghuma, A. P., Chang, Y., Libaque-Saenz, C. F., Park, M. C., & Rho, J. J. (2015). Benefit-confirmation model for post-adoption behavior of mobile instant messaging applications: A comparative analysis of KakaoTalk and Joyn in Korea. Telecommunications Policy, 39, 658–677.

    Article  Google Scholar 

  • Olsina, L., Santos, L., & Lew, P. (2014). Evaluating mobileapp usability: A holistic quality approach. In S. Casteleyn, G. Rossi, and M. Winckler (Eds.): ICWE 2014, LNCS 8541 (pp. 111–129). Switzerland: Springer.

  • Oulasvirta, A., Engelbrecht, K., Jameson, A., & Möller, S. (2019). The usability of spoken dialogue system design. Designing Human Interface in Speech Technology. https://doi.org/10.1007/0-387-24156-6_7

    Article  Google Scholar 

  • Pangestu, H., & Karsen, M. (2016). Evaluation of usability in online learning. In International Conference on Information Management and Technology (ICIMTech) (pp. 267–271). https://doi.org/10.1109/ICIMTech.2016.7930342

  • Pirhonen, A. (2005). Supporting a user facing a novel application: Learnability in OOBE. Personal and Ubiquitous Computing, 9, 218–226. https://doi.org/10.1007/s00779-004-0323-6

    Article  Google Scholar 

  • Rafla, T., Robillard, P. N., & Desmarais, M. (2007). A method to elicit architecturally sensitive usability requirements: Its integration into a software development process. Software Quality Journal, 15, 117–133. https://doi.org/10.1007/s11219-006-9009-9

    Article  Google Scholar 

  • Raita, E., & Oulasvirta, A. (2014). Mixed feelings? The relationship between perceived usability and user experience in the wild. In The 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (pp. 26–30)

  • Ramadiani, A. R., Selamat, M. H., Abdullah, R., Pa, N. C., & Azainil. (2016). User difficulties in e-learning system. In 2nd International Conference on Science in Information Technology (ICSITech). https://doi.org/10.1109/icsitech.2016.7852626

  • Rauf, A., Batool, S., Rehman, S. U., & Shahid, A. A. (2010). Survey based usability evaluation of Ms Word. In Proceedings of the International Conference on User Science Engineering (i-USEr) (pp. 195–198). https://doi.org/10.1109/IUSER.2010.5716750

  • Reinecke, K., & Bernstein, A. (2007). Culturally adaptive software: Moving beyond internationalization. In Aykin N. (Ed.) Usability and Internationalization. Global and Local User Interfaces (pp. 201–210). Springer, Berlin, Heidelberg

  • Reinecke, K., & Bernstein, A. (2011). Improving performance, perceived usability, and aesthetics with culturally adaptive user interfaces. ACM Transactions on Computer-Human Interaction, 18(2), 1–29. https://doi.org/10.1145/1970378.1970382

    Article  Google Scholar 

  • Reinecke, K., Schenkel, S., & Bernstein, A. (2010). Modeling a user’s culture. In E. G. Blanchard & D. Allard (Eds.), Handbook of Research on Culturally - Aware Information Technology: Perspectives and Models (pp. 242–264). USA.

    Google Scholar 

  • Revythi, A., & Tselios, N. (2019). Extension of technology acceptance model by using system usability scale to assess behavioral intention to use e-learning. Education and Information Technologies, 24, 2341–2355.

    Article  Google Scholar 

  • Ringle, C. M., Wende, S., & Jan-Michael, B. (2015). SmartPLS 3. http://www.smartpls.com. Accessed 14 March 2021

  • Rosenbaum, S. (1989). Usability evaluations versus usability testing: When and why? IEEE Transactions on Professional Communication, 32(4), 210–216. https://doi.org/10.1109/47.44533

    Article  Google Scholar 

  • Safsouf, Y., Mansouri, K., & Poirier, F. (2020). Smart learning environment, measure online student satisfaction: a case study in the context of higher education in Morocco. In Proceedings of 4th International Conference on Electrical and Information Technologies. https://doi.org/10.1109/ICEIT48248.2020.9113189

  • Salloum, S. A., Al-Emran, M., Shaalan, K., & Tarhini, A. (2019). Factors affecting the E-learning acceptance: A case study from UAE. Education and Information Technologies, 24, 509–530.

    Article  Google Scholar 

  • Saputra, R., Isnaini, N., Adhy, S., Bahtiar, N., Abidin, Z., & Suharto, E. (2020). Factors influencing student’s adoption of e-learning in Indonesian secondary schools. In Proceedings of 4th International Conference on Informatics and Computational Sciences (ICICoS). https://doi.org/10.1109/ICICoS51170.2020.9299109

  • Sauro, J. (2013). How to measure learnability. MeasuringU mixed-methods research and software firm. https://measuringu.com/measure-learnability/. Accessed 12 March 2021

  • Scholtz, B. M., Mahmud, I., & Ramayah, T. (2016). Does usability matter? an analysis of the impact of usability on technology acceptance in ERP settings. Interdisciplinary Journal of Information, Knowledge, and Management, 11, 309–330. https://doi.org/10.28945/3591

    Article  Google Scholar 

  • Scholtz, B., Calitz, A., & Cilliers, C. (2013). Usability evaluation of a medium-sized ERP system in higher education. Electronic Journal of Information Systems Evaluation, 16(2), 148–161.

    Google Scholar 

  • Seaborn, K., Satoh, Y., & Fels, D. I. (2016). usability and safety of a hud during powered chair navigation: A pilot study. In M. Antona and C. Stephanidis (Eds.): UAHCI 2016, Part III, LNCS 9739 (pp. 628–638). Switzerland: Springer.

  • Sears, A., & Shneiderman, B. (1994). Split menus: Effectively using selection frequency to organize menus. ACM Transactions on Computer-Human Interaction, 1(1). https://doi.org/10.1145/174630.174632

  • Seffah, A., Donyaee, M., Kline, R. B., & Padda, H. K. (2006). Usability measurement and metrics: A consolidated model. Software Quality Journal, 14, 159–178. https://doi.org/10.1007/s11219-006-7600-8

    Article  Google Scholar 

  • Sholiq, Auda, R.A., Subriadi, A.P., Tjahyanto, A., & Wulandari, A.D. (2021). Measuring software quality with usability, efficiency, and portability characteristics. IOP Conference Series: Earth and Environmental Science, 704. https://doi.org/10.1088/1755-1315/704/1/012039

  • Singh, A., & Wesson, J. L. (2009). Evaluation criteria for assessing the usability of ERP systems. In Proceedings of the 2009 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists (pp. 87–95). New York : ACM.

  • Stone, R. W., & Baker-Eveleth, L. (2013). Students’ expectation, confirmation, and continuance intention to use electronic textbooks. Computers in Human Behavior, 29, 984–990. https://doi.org/10.1016/j.chb.2012.12.007

    Article  Google Scholar 

  • Suzianti, A., & Paramadini, S.A. (2021). Continuance intention of e-learning: The Condition and Its Connection with Open Innovation. Journal of Open Innovation: Technology, Market, and Complexity, 7 (97). https://doi.org/10.3390/joitmc7010097

  • Tam, C., Santos, D., & Oliveira, T. (2020). Exploring the influential factors of continuance intention to use mobile Apps: Extending the expectation confirmation model. Information Systems Frontiers, 22, 243–217. https://doi.org/10.1007/s10796-018-9864-5

    Article  Google Scholar 

  • Tesavrita, C., Suryadi, K., & Wiratmadja, I. I. (2016). Web Usability and Self-Efficacy in Promoting Individual Knowledge Sharing. Proceedings of the IEEE International Conference on Industrial Engineering and Engineering Management (IEEM) (pp. 16–20). https://doi.org/10.1109/IEEM.2016.7797827

  • Venkatesh, V., & Goyal, S. (2010). Expectation disconfirmation and technology adoption: Polynomial modeling and response surface analysis. MIS Quarterly, 34(2), 281–303.

    Article  Google Scholar 

  • Venkatesh, V., Thong, J. Y. L., Chan, F. K. Y., Hu, P. J. H., & Brown, S. A. (2011). Extending the twostage information systems continuance model: Incorporating UTAUT predictors and the role of context. Information Systems Journal, 21(6), 527–555. https://doi.org/10.1111/j.1365-2575.2011.00373

    Article  Google Scholar 

  • Wang, L. Y. K., Lew, S. K., Lau, S. H., & Leow, M. C. (2019). Usability factors predicting continuance of intention to use cloud e-learning application. Heliyon, 5https://doi.org/10.1016/j.heliyon.2019.e01788

  • Watanabe, W. M., de Mattos Fortes, R. P., & Pimentel, M. D. G. C. (2011). The link-offset-scale mechanism for improving the usability of touch screen displays on the web. In P. Campos et al. (Eds.): INTERACT 2011, Part III, LNCS 6948 (pp. 356–372). Berlin: Springer-Verlag.

  • Weichbroth, P. (2020). Usability of mobile applications: A systematic literature study. IEEE Access, 8, 55563–55577. https://doi.org/10.1109/ACCESS.2020.2981892

    Article  Google Scholar 

  • Xu, F., & Du, J. T. (2018). Factors influencing users’ satisfaction and loyalty to digital libraries in Chinese universities. Computers in Human Behavior, 83, 64–72.

    Article  Google Scholar 

  • Yeung, P., & Jordan, E. (2006). Understanding the continued usage of business e-learning courses in HK corporations. In D. Kumar & J. Tumer, (Eds.): Education for the 21st Century-Impact of ICT and Digital Resources (pp. 245–254). Boston: Springer.

  • Yu, Y., & Liu, Z. (2008). Research on system usability of digital libraries in China. Proceedings of the IEEE International Symposium on Electronic Design, Test & Applications. https://doi.org/10.1109/DELTA.2008.22

    Article  Google Scholar 

  • Yuan, H., Lao, C. C., Hu, S. L., Zhang, Q. L., & Liang B. K. (2019). Design and usability of the touch-based interface of CNC presses. In Proceedings of the International Conference on Information Technology and Computer Application (ITCA) (pp. 39–52). https://doi.org/10.1109/ITCA49981.2019.00016

  • Yusuf, S. U., Taslim, J., Adnan, W. A. W., & Baharudin, S. K. (2014). Usability evaluation of human resource management information system (HRMIS). In Proceedings of the 3rd International Conference on User Science and Engineering (i-USEr) (pp. 204–209). https://doi.org/10.1109/IUSER.2014.7002703

  • Zali, Z., & Fadzlah, A. F. A. (2016). An initial theoretical usability evaluation model for assessing defence mobile e-based application system. In Proceedings of the International Conference on Information and Communication Technology (ICICTM) (pp. 198–202). https://doi.org/10.1109/ICICTM.2016.7890800

  • Zardari, B. A., Hussain, Z., Arain, A. A., Rizvi, W. H., & Vighio, M. S. (2020). QUEST e-learning portal: Applying heuristic evaluation, usability testing and eye tracking. Universal Access in the Information Society. https://doi.org/10.1007/s10209-020-00774-z

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Contributions

AR made substantial contributions to the whole part of the Manuscript and the data analysis, also involved in revising the manuscript to meet the journal standard. ANH involved in the analysis of data. GAS involved in writing the whole part of the Manuscript and analysis of data. IW and NNA were involved in the acquisition of data and interpretation of data. JAJ involved in the literature study.

Corresponding author

Correspondence to Arief Ramadhan.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ramadhan, A., Hidayanto, A.N., Salsabila, G.A. et al. The effect of usability on the intention to use the e-learning system in a sustainable way: A case study at Universitas Indonesia. Educ Inf Technol 27, 1489–1522 (2022). https://doi.org/10.1007/s10639-021-10613-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-021-10613-0

Keywords

Navigation