Skip to main content
Springer Nature Link
Log in

Eye-Tracking and Usability in (Mobile) ERP Systems

  • Conference paper
  • First Online:
Enterprise Information Systems (ICEIS 2021)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 455))

Included in the following conference series:

Abstract

This article covers the development of a specific model for the end-user-based evaluation of the usability of Mobile ERP systems employing eye-tracking technology. Recent studies show that the mobile use of ERP software is significant, even though there is also room for improvement. Simultaneously, it is undisputed that ERP-specific usability models are necessary to meet the specific requirements of ERP systems. Therefore, we examine usability dimensions in the Mobile ERP context in a first, preliminary study. In addition, we investigate how eye-tracking technology can support the usability measurement for each usability dimension. Therefore, after a detailed literature analysis, a usability model for the mobile application of ERP systems (Mobile ERP) is developed. Subsequently, we summarize the results of a first explorative preliminary study with 19 test persons. The results show that the model allows the usability of mobile ERP systems to be classified and that few decisive factors contribute to the perception of good usability in ERP systems. In the third part of this paper (after literature review and usability study), we introduce an overview of eye-tracking metrics for MERP-U to examine which MERP-U dimensions eye-tracking measures.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Bahssas, D.M., Al Bar, A.M., Hoque, M.R.: Enterprise resource planning (ERP) systems: design, trends and deployment. Int. Technol. Manag. Rev. 5(2), 72–81 (2015)

    Article  Google Scholar 

  2. Omar, K., Gomez, J.M.: A selection model of ERP system in mobile ERP design science research: case study: mobile ERP usability. In: Proceedings of the 13th International Conference of Computer Systems and Applications (AICCSA), Agadir, Morocoo, pp. 1–8. IEEE (2016)

    Google Scholar 

  3. Tai, Y.T., Huang, C.H., Chuang, S.C.: The construction of a mobile business application system for ERP. Kybernetes 45(1), 141–157 (2016)

    Article  Google Scholar 

  4. Trovarit AG: ERP in der Praxis-Trovarit-the IT-Matchmaker. https://www.trovarit.com/erp-praxis/. Accessed 26 Oct 2021

  5. Omar, K.: Towards improving the usability of mobile ERP. A model for devising adaptive mobile us to improve the usability of mobile ERP. In: Cunningham, D.W., Hofstedt, P., Meer, K., Schmitt, I. (eds.) INFORMATIK 2015, pp. 1783–1794. Gesellschaft für Informatik e. V., Bonn (2015)

    Google Scholar 

  6. Omar, K., Rapp, B., Gómez, J.M.: Heuristic evaluation checklist for mobile ERP user interfaces. In: 7th International Conference on Information and Communication Systems (ICICS), Irbid, Jordan, pp. 180–185. IEEE (2016)

    Google Scholar 

  7. Omar, K., Gomez, J.M.: An adaptive system architecture for devising adaptive user interfaces for mobile ERP apps. In: Proceedings of the 2nd International Conference on the Applications of Information Technology in Developing Renewable Energy Processes and Systems (IT-DREPS 2017), Amman, Jordan, pp. 1–6. IEEE (2017)

    Google Scholar 

  8. Wüllerich, T., Dobhan, A.: The usability of mobile enterprise resource planning systems. In: Proceedings of the 23rd International Conference on Enterprise Information Systems (ICEIS 2021), vol. 2, pp. 517–524 (2021)

    Google Scholar 

  9. Meiselman, H.L.: Emotion Measurement, 2nd edn. Elsevier, Amsterdam (2021)

    Google Scholar 

  10. Singh, A., Wesson, J.: Evaluation criteria for assessing the usability of ERP systems. In: Dwolatzky, B., Cohen, J., Hazelhurst, S. (eds.) Proceedings of the 2009 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists, pp. 87–95. Association for Computing Machinery, New York (2009)

    Google Scholar 

  11. Voeller, N.T.: The digital sensorium: considering the senses in website design. Comput. Compos. 54 (2019)

    Google Scholar 

  12. Gonçales, L.J., Farias, K., da Silva, B.C.: Measuring the cognitive load of software developers: an extended systematic mapping study. Inf. Softw. Technol. 136, 106563 (2021)

    Article  Google Scholar 

  13. Zhang, D., Adipat, B.: Challenges, methodologies, and issues in the usability testing of mobile applications. Int. J. Hum.-Comput. Interact. 18(3), 293–308 (2005)

    Article  Google Scholar 

  14. Vosylius, A.E., Lapin, K.: Usability of educational websites for tablet computers. In: Sikorski, M., Dittmar, A., Marasek, K., Greef, T. de (eds.) MIDI 2015, Proceedings of the Multimedia, Interaction, Design and Innovation, pp. 1–10. Association for Computing Machinery, New York (2015)

    Google Scholar 

  15. Muccini, H., Di Francesco, A., Esposito, P.: Software testing of mobile applications: challenges and future research directions. In: Hoffman, D. (ed.) Proceedings of the 7th International Workshop on Automation of Software Test (AST), Zurich, Switzerland, pp. 29–35. IEEE (2012)

    Google Scholar 

  16. Nayebi, F., Desharnais, J.M., Abran, A.: The state of the art of mobile application usability evaluation. In: 25th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), Montreal, QC, Canada, pp. 1–4. IEEE (2012)

    Google Scholar 

  17. Shackel, B., Richardson, S.: Human Factors for Informatics Usability. Cambridge University Press, Cambridge (1991)

    MATH  Google Scholar 

  18. Rastari, S., Sangar, A.B.: Investigating and comparing the usability models in the banking applications. Eng. Res. J. 3(6), 77–85 (2015)

    Google Scholar 

  19. Nielsen, J.: Usability Engineering. Elsevier, Mountain View California (1994)

    MATH  Google Scholar 

  20. Harrison, R., Flood, D., Duce, D.: Usability of mobile applications: literature review and rationale for a new usability model. J. Interact. Sci. 1(1), 2–16 (2013)

    Article  Google Scholar 

  21. Hussain, A., Abubakar, H.I., Hashim, N.B.: Evaluating mobile banking application: usability dimensions and measurements. In: Proceedings of the 6th International Conference on Information Technology and Multimedia (ICIMU), Putrajaya, Malaysia, pp. 136–140. IEEE (2014)

    Google Scholar 

  22. Kureerung, P., Ramingwong, L.: Factors supporting user interface design of mobile government application. In: Daigaku, T. (ed.) ICISS 2019: Proceedings of the 2nd International Conference on Information Science and System, pp. 115–119. The Association for Computing Machinery, New York (2019)

    Google Scholar 

  23. Myka, J., Indyka-Piasecka, A., Telec, Z., Trawiński, B., Dac, H.C.: Comparative analysis of usability of data entry design patterns for mobile applications. In: Nguyen, N.T., Gaol, F.L., Hong, T.-P., Trawiński, B. (eds.) ACIIDS 2019. LNCS (LNAI), vol. 11431, pp. 737–750. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-14799-0_63

    Chapter  Google Scholar 

  24. Saleh, A., Isamil, R.B., Fabil, N.B.: Extension of PACMAD model for usability evaluation metrics using goal question metrics (GQM) approach. J. Theor. Appl. Inf. Technol. 79(1), 90–100 (2015)

    Google Scholar 

  25. International Standardisation Organisation, ISO 9241-11 (1998). https://www.sis.se/api/document/preview/611299/. Accessed 22 Oct 2021

  26. Frokjaer, E., Hertzum, M., Hornbæk, K.: Measuring usability: are effectiveness, efficiency and satisfaction really correlated? In: Turner, T., Pemberton, S. (eds.) CHI 2000: The future is here CHI 2000 conference proceedings conference on Human Factors in Computing Systems, pp. 345–352. The Association for Computing Machinery, New York (2000)

    Google Scholar 

  27. Raptis, D., Tselios, N., Kjeldskov, J., Skov, M.B.: Does size matter? Investigating the impact of mobile phone screen size on users’ perceived usability, effectiveness and efficiency. In: Rohs, M. (ed.) MobileHCI 2013 proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 127–136. The Association for Computing Machinery, New York (2013)

    Google Scholar 

  28. Bevan, N., Carter, J., Harker, S.: ISO 9241-11 revised: what have we learnt about usability since 1998? In: Kurosu, M. (ed.) HCI 2015. LNCS, vol. 9169, pp. 143–151. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20901-2_13

    Chapter  Google Scholar 

  29. Condos, C., James, A., Every, P., Simpson, T.: Ten usability principles for the development of effective WAP and m-commerce services. ASLIB Proc. 54(6), 345–355 (2002)

    Article  Google Scholar 

  30. Zahra, F., Hussain, A., Mohd, H.: Usability evaluation of mobile applications; where do we stand? In: AIP Conference Proceedings: 2nd International Conference on Applied Science and Technology 2017 (ICAST 2017), vol. 1891. AIP Publishing LLC (2017)

    Google Scholar 

  31. Shneiderman, B.: Designing the user interface. Strategies for effective human-computer interaction reading. Interaction 3 (1998)

    Google Scholar 

  32. Seffah, A., Donyaee, M., Kline, R.B., Padda, H.K.: Usability measurement and metrics: a consolidated model. Software Qual. J. 14(2), 159–178 (2006)

    Article  Google Scholar 

  33. Coursaris, C.K., Kim, D.J.: A meta-analytical review of empirical mobile usability studies. J. Usability Stud. 6(3), 117–171 (2011)

    Google Scholar 

  34. Hussain, A., Kutar, M.: Usability evaluation of SatNav application on mobile phone using mGQM. Int. J. Comput. Inf. Syst. Ind. Manag. Appl. 4, 92–100 (2012)

    Google Scholar 

  35. Baharuddin, R., Singh, D., Razali, R.: Usability dimensions for mobile applications-a review. J. Appl. Sci. Eng. Technol. 5(6), 2225–2231 (2013)

    Article  Google Scholar 

  36. Tan, J., Ronkko, K., Gencel, C.: A framework for software usability and user experience measurement in mobile industry. In: IWSM-MENSURA 2013: The Joint Conference of the 23rd International Workshop on Software Measurement (IWSM) and the 8th International Conference on Software Process and Product Measurement (Mensura), Conference Publishing Services, pp. 156–164. IEEE Computer Society, Los Alamitos (2013)

    Google Scholar 

  37. Goel, S., Nagpal, R., Mehrotra, D.: Mobile applications usability parameters: taking an insight view. In: Mishra, D., Nayak, M., Joshi, A. (eds.) Information and Communication Technology for Sustainable Development, pp. 35–43. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-3932-4_4

    Chapter  Google Scholar 

  38. Nielsen, J.: Usability inspection methods. In: Conference Companion on Human Factors in Computing Systems, Massachusetts, pp.413–414. ACM (1994)

    Google Scholar 

  39. Omar, K., Gomez, J.M.: A selection model of ERP system in mobile ERP design science research: case study: mobile ERP usability. In: IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA), Agadir, Morocoo, pp. 1–8. IEEE (2016)

    Google Scholar 

  40. Yen, P.Y., Bakken, S.: A comparison of usability evaluation methods: heuristic evaluation versus end-user think-aloud protocol – an example from a web-based communication tool for nurse scheduling. In: AMIA Annual Symposium proceedings, pp. 714–718. American Medical Informatics Association (2009)

    Google Scholar 

  41. Hussain, A., Mkpojiogu, E.O.C., Fadzil, N., Hassan, N., Zaaba, Z.F.: A mobile usability evaluation of a pregnancy app. J. Telecommun. Electron. Comput. Eng. (JTEC) 10(1–11), 13–18 (2018)

    Google Scholar 

  42. Lapin, K.: Deriving usability goals for mobile applications. In: Marasek, K., Sikor-ski, M. (eds.) Proceedings of MIDI 2014: International Conference on Multimedia, Interaction, Design and Innovation, Polish-Japanese Institute of Information Technology, pp. 1–6. Association for Computing Machinery, New York (2013)

    Google Scholar 

  43. Alturki, R., Gay, V.: Usability testing of fitness mobile application methodology and quantitative results. In: Computer Science & Information Technology (CS & IT): proceedings of the 7th International Conference on Computer Science, Engineering & Applications, in Copenhagen, Denmark, pp. 97–114. Academy & Industry Research Collaboration Center (AIRCC) (2017)

    Google Scholar 

  44. Yassien, E., Masa’deh, R.’a., Mufleh, M., Alrowwad, A.’a., Masa’deh, R.’e.: The impact of ERP system’s usability on enterprise resource planning project implementation success via the mediating role of user satisfaction. J. Manag. Res. 9(3), 49–71 (2017)

    Google Scholar 

  45. Cooprider, J., Topi, H., Xu, J., Dias, M., Babaian, T., Lucas, W.: A collaboration model for ERP user-system interaction. In: Sprague, R.H. (ed.) 43rd Hawaii International Conference on System Sciences (HICSS), Piscataway, New Jersey, pp. 1–9. IEEE (2010)

    Google Scholar 

  46. Zali, Z.: An initial theoretical usability evaluation model for assessing defence mobile e-based application system. In: ICICTM 2016: Proceedings of the International Conference on Information and Communication Technology, Piscataway, New Jersey, pp. 198–202. IEEE (2016)

    Google Scholar 

  47. Topi, H., Lucas, W., Babaian, T.: Identifying Usability Issues with an ERP Implementation. In: 7th International Conference on Enterprise Information Systems, Miami, pp. 128–133. ICEIS (2005)

    Google Scholar 

  48. Scholtz, B., Cilliers, C., Calitz, A.: Qualitative techniques for evaluating enterprise resource planning (ERP) user interfaces. In: Kotzé, P. (ed.) SAICSIT 2010: Fountains of computing research proceedings of SAICSIT 2010 Annual Research Conference of the South African Institute of Computer Scientist and Information Technologists, Bela Bela, South Africa, pp. 284–293. Association for Computing Machinery, New York (2010)

    Google Scholar 

  49. Parks, N.E.: Testing & quantifying ERP usability. In: Connolly, R., Brewer, J.L. (eds.) SIGITE/RIIT 2012: Proceedings of the ACM Special Interest Group for Information Technology Education Conferences, Calgary, Alberta, Canada, p. 31. Association for Computing Machinery, New York (2012)

    Google Scholar 

  50. Paa, L., Piazolo, F., Promberger, K., Keckeis, J.: Measuring ERP usability from the users’ perspective. In: Piazolo, F., Felderer, M. (eds.) Multidimensional Views on Enterprise Information Systems. LNISO, vol. 12, pp. 149–160. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-27043-2_12

    Chapter  Google Scholar 

  51. Hinterhuber, H., Promberger, K., Piazolo, F.: Usability Testing von ERP-Systemen. Leopold-Franzens-Universität Innsbruck, Innsbruck (2010)

    Google Scholar 

  52. Akiki, P.A., Bandara, A.K., Yu, Y.: Engineering adaptive model-driven user inter-faces. IEEE Trans. Software Eng. 42(12), 1118–1147 (2016)

    Article  Google Scholar 

  53. Babaian, T., Lucas, W., Chircu, A., Power, N.: Evaluating interactive visualizations for supporting navigation and exploration in enterprise systems. In: Hammoudi, S., Maciaszek, L., Missikoff, M. M., Camp, O., Cordeiro J. (eds.) ICEIS 2016: Proceedings of the 18th International Conference on Enterprise Information Systems: Rome, Italy, vol. 2, pp. 368–377. SCITEPRESS - Science and Technology Publications Lda (2016)

    Google Scholar 

  54. Schmutz, P., Heinz, S., Métrailler, Y., Opwis, K.: Cognitive load in eCommerce applications—measurement and effects on user satisfaction. Adv. Hum.-Comput. Interact. 1–9 (2009)

    Google Scholar 

  55. Boczon, P.: State of the art: eye tracking technology and applications. In: Geiselhart F., et al. (eds.) Research Trends in Media Informatics, RTMI 2014, pp. 1–8. Villa Eberhardt, Ulm (2014)

    Google Scholar 

  56. Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Weijer, J.V.D.: Eye Tracking a comprehensive guide to methods and measures. Oxford, New York (2011)

    Google Scholar 

  57. Joseph, A.W., Murugesh, R.: Potential eye tracking metrics and indicators to measure cognitive load in human-computer interaction research. J. Sci. Res. 64(1), 268–275 (2020)

    Google Scholar 

  58. Salvucci, D.D., Goldberg, J.H.: Identifying fixations and saccades in eye-tracking protocols. In: Proceedings of the Symposium on Eye Tracking Research & Applications - ETRA 2000. The Symposium, Palm Beach Gardens, Florida, United States, pp. 71–78. Association for Computing Machinery, New York (2000)

    Google Scholar 

  59. Goldberg, J.H., Kotval, X.P.: Computer interface evaluation using eye movements: methods and constructs. Int. J. Ind. Ergon. 24(6), 631–645 (1999)

    Article  Google Scholar 

  60. Holmqvist, K., Andersson, R.: Eye tracking: a comprehensive guide to methods, paradigms, and measures, 2nd edn. Lund Eye-Tracking Research Institute, Lund (2017)

    Google Scholar 

  61. Duchowski, A.T.: Eye Tracking Methodology: Theory and Practice. Springer, London (2003). https://doi.org/10.1007/978-1-4471-3750-4

    Book  MATH  Google Scholar 

  62. Rayner, K.: Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372–422 (1998)

    Article  Google Scholar 

  63. Sharafi, Z., Soh, Z., Guéhéneuc, Y.G.: A systematic literature review on the usage of eye-tracking in software engineering. Inf. Softw. Technol. 67, 79–107 (2015)

    Article  Google Scholar 

  64. Wang, J., Antonenko, P., Celepkolu, M., Jimenez, Y., Fieldman, E., Fieldman, A.: Exploring relationships between eye tracking and traditional usability testing data. Int. J. Hum.-Comput. Interact. 35(6), 483–494 (2019)

    Article  Google Scholar 

  65. Tonbuloğlu, I.: Using eye tracking method and video record in usability test of educational softwares and gender effects. Procedia Soc. Behav. Sci. 103, 1288–1294 (2013)

    Article  Google Scholar 

  66. Zardari, B.A., Hussain, Z., Arain, A.A., Rizvi, W.H., Vighio, M.S.: QUEST e-learning portal: applying heuristic evaluation, usability testing and eye tracking. Univers. Access Inf. Soc. 20, 531–543 (2020)

    Article  Google Scholar 

  67. Conley, Q., Earnshaw, Y., McWatters, G.: Examining course layouts in blackboard: using eye-tracking to evaluate usability in a learning management system. Int. J. Hum.-Comput. Interact. 36(4), 373–385 (2020)

    Article  Google Scholar 

  68. Stankov, G., Nagy, B.: Eye tracking based usability evaluation of the MaxWhere virtual space in a search task. In: 2019 10th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), Naples, Italy, pp. 469–474. IEEE (2019)

    Google Scholar 

  69. Bataineh, E., Al Mourad, B., Kammoun, F.: Usability analysis on Dubai e-government portal using eye tracking methodology. In: 2017 Computing Conference, London, UK, pp. 591–600. IEEE (2017)

    Google Scholar 

  70. Tomaschko, M., Hohenwarter, M.: Usability evaluation of a mobile graphing calculator application using eye tracking. In: Zaphiris, P., Ioannou, A. (eds.) LCT 2018. LNCS, vol. 10924, pp. 180–190. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91743-6_14

    Chapter  Google Scholar 

  71. Eloff, J.H., De Bruin, J.A., Malan, K.M.: Semi-automated usability analysis through eye tracking. S. Afr. Comput. J. 30(1), 66–84 (2018)

    Google Scholar 

  72. Diego-Mas, J.A., Garzon-Leal, D., Poveda-Bautista, R., Alcaide-Marzal, J.: User-interfaces layout optimization using eye-tracking, mouse movements and genetic algorithms. Appl. Ergon. 78, 197–209 (2019)

    Article  Google Scholar 

  73. Weichbroth, P.: Usability of mobile applications: a systematic literature study. IEEE Access 8, 55563–55577 (2020)

    Article  Google Scholar 

  74. Goldberg, J.H., Wichansky, A.M.: Eye tracking in usability evaluation: a practitioner’s guide. In: Hyönö, J., Radach, R., Deubel, H. (eds.) The Mind’s Eye Cognitive and Applied Aspects of Eye Movement Research, pp. 493–516. Elsevier B.V., North Holland (2003)

    Google Scholar 

  75. Ooms, K., Dupont, L., Lapon, L., Popelka, S.: Accuracy and precision of fixation locations recorded with the low-cost Eye Tribe tracker in different experimental set-ups. J. Eye Mov. Res. 8(1) (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Applied Sciences Würzburg-Schweinfurt, Schweinfurt, Germany

    Alexander Dobhan, Thomas Wüllerich & David Röhner

Authors
  1. Alexander Dobhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thomas Wüllerich
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. David Röhner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alexander Dobhan .

Editor information

Editors and Affiliations

  1. Polytechnic Institute of Setúbal/INSTICC, Setúbal, Portugal

    Joaquim Filipe

  2. Warsaw University of Technology, Warsaw, Poland

    Michał Śmiałek

  3. George Mason University, Fairfax, VA, USA

    Alexander Brodsky

  4. MODESTE/ESEO, Angers, France

    Slimane Hammoudi

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dobhan, A., Wüllerich, T., Röhner, D. (2022). Eye-Tracking and Usability in (Mobile) ERP Systems. In: Filipe, J., Śmiałek, M., Brodsky, A., Hammoudi, S. (eds) Enterprise Information Systems. ICEIS 2021. Lecture Notes in Business Information Processing, vol 455. Springer, Cham. https://doi.org/10.1007/978-3-031-08965-7_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-08965-7_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-08964-0

  • Online ISBN: 978-3-031-08965-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics