skip to main content
10.1145/2987491.2987527acmotherconferencesArticle/Chapter ViewAbstractPublication PageshtConference Proceedingsconference-collections
research-article

Make Your Choice: Dimensionality of an Open Integrated Conceptual Model for Evaluating E-Service Quality, Usability and User Experience (e-SQUUX) of Web-Based Applications

Authors Info & Claims
Published:26 September 2016Publication History

ABSTRACT

Developments in internet technology and pervasive computing have resulted in a variety of web-based applications (WBAs), including business transactions, information-delivery and social networking, as well as e-government, e-health and e-learning. Different websites have varying requirements and users have differing backgrounds, experiences and cultures. Users require effective, easy and enjoyable interaction, which is key to successful use and acceptance of applications. This study generated a model that can give rise to customized frameworks to evaluate three related, yet distinct, constructs: e-service quality, usability and user experience (e-SQUUX) of WBAs in an integrated manner.

Following a rigorous review of 264 credible literature sources, a set of unique dimensions was identified, each associated with one or more e-SQUUX constructs. Through an iterative reduction and evolution process, an integrated conceptual e-SQUUX model was derived, comprising 24 categories, 75 main dimensions and 163 associated dimensions. The model is 'open' in that practitioners and researchers can make their own personal 'choice' from the components of the model to synthesize an implementation of the model to be used as an evaluation framework.

References

  1. Abran, A., Khelifi, A., Suryn, W. and Seffah, A., 2003. Usability meanings and interpretations in ISO standards. Software Quality Journal, 11(4), pp. 325--338. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Agarwal, A. and Meyer, A., 2009, April. Beyond usability: evaluating emotional response as an integral part of the user experience. In CHI'09 Extended Abstracts on Human Factors in Computing Systems (pp. 2919--2930). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Al-Momani, K. and Noor, N.A.M., 2009. E-service quality, ease of use, usability and enjoyment as antecedents of e-CRM performance: an empirical investigation in Jordan mobile phone services. The Asian Journal of Technology Management, 2(2), pp. 50--64.Google ScholarGoogle Scholar
  4. Al-Shamayleh, H.Z., Aljaafreh, R., Aljaafreh, A., Albadayneh, D., Al-Ali, M., Bazin, N.E.N., Shamsuddin, S.M., Bamatraf, A., Latiff, M.S.B.A., Coulibaly, Y. and Khasawneh, A.M., 2015. Measuring the quality of E-services and its impact on students satisfaction at Jordanian universities. Journal of Theoretical and Applied Information Technology, 74(2).Google ScholarGoogle Scholar
  5. Barnes, S. and Vidgen, R.T., 2000. WebQual: an exploration of website quality. ECIS 2000 Proceedings, p.74.Google ScholarGoogle Scholar
  6. Bevan, N., 2009, August. What is the difference between the purpose of usability and user experience evaluation methods. In Proceedings of the Workshop UXEM (Vol. 9, pp. 1--4).Google ScholarGoogle Scholar
  7. Bhattacharya, D., Gulla, U. and Gupta, M.P., 2012. E-service quality model for Indian government portals: citizens' perspective. Journal of Enterprise Information Management, 25(3), pp. 246--271.Google ScholarGoogle ScholarCross RefCross Ref
  8. Bressolles, G. and Nantel, J., 2004, May. Electronic service quality: a comparison of three measurement scales. In Proc. of the 33 th EMAC Conference, Murcia, Spain.Google ScholarGoogle Scholar
  9. Carrasco, R.A., Sánchez-Fernández, J., Muñoz-Leiva, F., Blasco, M.F. and Herrera-Viedma, E., 2015. Evaluation of the hotels e-services quality under the user's experience. Soft Computing, pp. 1--17.Google ScholarGoogle Scholar
  10. Cebi, S., 2013. A quality evaluation model for the design quality of online shopping websites. Electronic Commerce Research and Applications, 12(2), pp. 124--135. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Chen, Y.H., Germain, C.A. and Rorissa, A., 2009. An analysis of formally published usability and Web usability definitions. Proceedings of the American Society for Information Science and Technology, 46(1), pp. 1--18.Google ScholarGoogle ScholarCross RefCross Ref
  12. Coursaris, C. and Kim, D., 2006. A qualitative review of empirical mobile usability studies. AMCIS 2006 Proceedings, p.352.Google ScholarGoogle Scholar
  13. Davis, F.D., 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly, pp. 319--340. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. DeLone, W.H. and McLean, E.R., 1992. Information systems success: The quest for the dependent variable. Information systems research, 3(1), pp. 60--95. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Delone, W.H. and McLean, E.R., 2003. The DeLone and McLean model of information systems success: a ten-year update. Journal of management information systems, 19(4), pp. 9--30. Google ScholarGoogle ScholarCross RefCross Ref
  16. Djouab, R., Abran, A. and Seffah, A., 2016. An ASPIRE-based method for quality requirements identification from business goals. Requirements Engineering, pp. 1--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. ELSEVIER. 2015. About SCOPUS. Available: https://www.elsevier.com/solutions/scopus. Accessed on 15 June 2015.Google ScholarGoogle Scholar
  18. Fowdur, T.P., Hurbungs, V. and Beeharry, Y., 2016, January. Statistical analysis of energy consumption of mobile phones for web-based applications in Mauritius. In 2016 International Conference on Computer Communication and Informatics (ICCCI) (pp. 1--8). IEEE.Google ScholarGoogle Scholar
  19. Gumussoy, C.A., 2016. Usability guideline for banking software design. Computers in Human Behavior, 62, pp. 277285. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Hassenzahl, M., 2008, September. User experience (UX): towards an experiential perspective on product quality. In Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine (pp. 11--15). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Hassenzahl, M., Diefenbach, S. and Göritz, A., 2010. Needs, affect, and interactive products--Facets of user experience. Interacting with computers, 22(5), pp. 353--362. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Hassenzahl, M. and Tractinsky, N., 2006. User experience-a research agenda. Behaviour & information technology, 25(2), pp. 91--97.Google ScholarGoogle Scholar
  23. Hedegaard, S. and Simonsen, J.G., 2013, April. Extracting usability and user experience information from online user reviews. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2089--2098). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Hoffmann, R. and Krauss, K., 2004, October. A critical evaluation of literature on visual aesthetics for the web. In Proceedings of the 2004 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries (pp. 205--209). South African Institute for Computer Scientists and Information Technologists. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Holzinger, A., Searle, G., Kleinberger, T., Seffah, A. and Javahery, H., 2008. Investigating usability metrics for the design and development of applications for the elderly (pp. 98--105). Springer Berlin Heidelberg. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Hornbaek, K. and Stage, J., 2006. The interplay between usability evaluation and user interaction design. International Journal of Human-Computer Interaction, 21(2), pp. 117--123.Google ScholarGoogle ScholarCross RefCross Ref
  27. Huang, S.J., Chen, W.C. and Chiu, P.Y., 2015, December. Evaluation Process Model of the Software Product Quality Levels. In Industrial Informatics-Computing Technology, Intelligent Technology, Industrial Information Integration (ICIICII), 2015 International Conference on (pp. 55--58). IEEE. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. ISO, 2008. ISO CD 9241-210: Ergonomics of human-system interaction-Part 210: Human-centred design process for interactive systems. International Organization for Standardization, Geneva.Google ScholarGoogle Scholar
  29. ISO/IEC, 2011. ISO/IEC 25010:2011, Systems and Software Engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - System and Software Quality Models. International Organization for Standardization, Geneva.Google ScholarGoogle Scholar
  30. Jiang, X. and JI, S., 2014, January. E-Government Web Portal Adoption: A Service Level and Service Quality Perspective. In System Sciences (HICSS), 2014 47th Hawaii International Conference on (pp. 2179--2188). IEEE. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Joo, S. and Yeon Lee, J., 2011. Measuring the usability of academic digital libraries: Instrument development and validation. The Electronic Library, 29(4), pp. 523--537.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Kitchenham, B., 2004. Procedures for performing systematic reviews. Keele, UK, Keele University, 33(2004), pp. 1--26.Google ScholarGoogle Scholar
  33. Koohang, A., 2004. Expanding the concept of usability. Informing Science, 7, pp. 129--141.Google ScholarGoogle ScholarCross RefCross Ref
  34. Kujala, S., Roto, V., Väänänen-Vainio-Mattila, K., Karapanos, E. and Sinnelä, A., 2011. UX Curve: A method for evaluating long-term user experience. Interacting with Computers, 23(5), pp. 473--483. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Kundu, S. and Datta, S.K., 2014. A Scale for Measuring Internet Banking Service Quality: Literature Review and Validation with Indian Public Sector Banks. Journal of Electronic Commerce in Organizations (JECO), 12(3), pp. 12--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Kuo, T., Lu, I.Y., Huang, C.H. and Wu, G.C., 2005. Measuring users' perceived portal service quality: An empirical study. Total quality management and business excellence, 16(3), pp. 309--320.Google ScholarGoogle Scholar
  37. Ladhari, R., 2010. Developing e-service quality scales: A literature review. Journal of Retailing and Consumer Services, 17(6), pp. 464--477.Google ScholarGoogle ScholarCross RefCross Ref
  38. Marimon, F., Vidgen, R., Barnes, S. and Cristóbal, E., 2010. Purchasing behaviour in an online supermarket: The applicability of ES-QUAL. International Journal of Market Research, 52(1), pp. 111--129.Google ScholarGoogle ScholarCross RefCross Ref
  39. Matera, Maristella, et al. "The usability dimension in the development of web applications." Handbook of Research on Web Information Systems Quality(2008): 234.Google ScholarGoogle Scholar
  40. Mayhew, D.J., 2005. Cost justification of usability engineering for international websites. Cost justifying usability: An update for the Internet age, pp. 359--384.Google ScholarGoogle Scholar
  41. Mazumder, F. and Das, U., 2014. Usability guidelines for usable user interface. International Journal of Research in Engineering and Technology, 3(9), pp. 79--82.Google ScholarGoogle ScholarCross RefCross Ref
  42. McNamara, N. and Kirakowski, J., 2006. Functionality, usability, and user experience: three areas of concern. Interactions, 13(6), pp. 26--28. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Miles, M.B. and Huberman, A.M., 1994. Qualitative data analysis: An expanded sourcebook. Sage Publications.Google ScholarGoogle Scholar
  44. Moczarny, I.M., De Villiers, M.R. and van Biljon, J.A., 2012, October. How can usability contribute to user experience?: a study in the domain of e-commerce. In Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference (pp. 216--225). ACM Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Montero, F., Lozano, M.D. and González, P., 2008. Usability-oriented quality model based on ergonomic criteria. Handbook of research on web information systems quality, pp. 220--233.Google ScholarGoogle Scholar
  46. Moumane, K., Idri, A. and Abran, A., 2016. Usability evaluation of mobile applications using ISO 9241 and ISO 25062 standards. SpringerPlus, 5(1), p.1.Google ScholarGoogle ScholarCross RefCross Ref
  47. Nathan, R.J. and Yeow, P.H., 2011. Crucial web usability factors of 36 industries for students: a large-scale empirical study. Electronic Commerce Research, 11(2), pp. 151--180. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Nielsen, J., 1993. Usability Engineering, Academic Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Ojasalo, J., 2010. E-service quality: a conceptual model. International Journal of Arts and Sciences, 7(3), pp. 127--143.Google ScholarGoogle Scholar
  50. Parasuraman, A., Zeithaml, V.A. and Berry, L.L., 1985. A conceptual model of service quality and its implications for future research. The Journal of Marketing, pp. 41--50.Google ScholarGoogle ScholarCross RefCross Ref
  51. Parasuraman, A., Zeithaml, V.A. and Berry, L.L., 1988. Servqual. Journal of retailing, 64(1), pp. 12--40.Google ScholarGoogle Scholar
  52. Parasuraman, A., Zeithaml, V.A. and Malhotra, A., 2005. ES-QUAL a multiple-item scale for assessing electronic service quality. Journal of service research, 7(3), pp. 213--233.Google ScholarGoogle ScholarCross RefCross Ref
  53. Park, J., Han, S.H., Kim, H.K., Oh, S. and Moon, H., 2013. Modeling user experience: A case study on a mobile device. International Journal of Industrial Ergonomics, 43(2), pp. 187--196.Google ScholarGoogle ScholarCross RefCross Ref
  54. Park, J., Han, S.H., Kim, H.K., Cho, Y. and Park, W., 2013. Developing elements of user experience for mobile phones and services: survey, interview, and observation approaches. Human Factors and Ergonomics in Manufacturing & Service Industries, 23(4), pp. 279--293.Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Preece, J.R. and Rogers, Y., 2007. SHARP (2002): Interaction Design: Beyond Human-Computer Interaction. Crawfordsville: John Wiley and Sons, Inc. Answers. com Technology. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Pucillo, F. and Cascini, G., 2014. A framework for user experience, needs and affordances. Design Studies, 35(2), pp. 160--179.Google ScholarGoogle ScholarCross RefCross Ref
  57. Roto, V. 2015. All about UX. Available: http://www.allaboutux.org/virpiroto. Accessed 15 March 2015.Google ScholarGoogle Scholar
  58. Roto, V., Rantavuo, H. and Väänänen-Vainio-Mattila, K., 2009, October. Evaluating user experience of early product concepts. In Proc. DPPI (Vol. 9, pp. 199--208).Google ScholarGoogle Scholar
  59. Sahi, G., 2015. User Satisfaction and Website Usability: Exploring the Linkages in B2C E-Commerce Context. In IT Convergence and Security (ICITCS), 2015 5th International Conference on (pp. 1--4). IEEE.Google ScholarGoogle ScholarCross RefCross Ref
  60. Sahi, G. and Madan, S., 2013. Assessing the Differential Effect of Web Usability Dimensions on Perceived Usefulness of a B2C E-Commerce Website. In Advances in Information Technology (pp. 198--211). Springer International Publishing.Google ScholarGoogle Scholar
  61. Seffah, A., Donyaee, M., Kline, R.B. and Padda, H.K., 2006. Usability measurement and metrics: A consolidated model. Software Quality Journal, 14(2), pp. 159--178. Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Strawderman, L. and Koubek, R., 2008. Human factors and usability in service quality measurement. Human Factors and Ergonomics in Manufacturing & Service Industries, 18(4), pp. 454--463. Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Unisa. 2015. Search library resources. Available: http://www.unisa.ac.za/Default.asp?Cmd=ViewContent&ContentID=95093. Accessed on 2 February 2015.Google ScholarGoogle Scholar
  64. van Wyk, E. and de Villiers, R., 2008, October. Usability context analysis for virtual reality training in South African mines. In Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology (pp. 276--285). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Venkatesh, V. and Bala, H., 2008. Technology acceptance model 3 and a research agenda on interventions. Decision sciences, 39(2), pp. 273--315.Google ScholarGoogle Scholar
  66. Venkatesh, V. and Davis, F.D., 2000. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management science, 46(2), pp. 186--204. Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Venkatesh, V., Thong, J.Y. and Xu, X., 2012. Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology. MIS quarterly, 36(1), pp. 157--178. Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Vermeeren, A.P., Roto, V. and Väänänen, K., 2015. Design-inclusive UX research: design as a part of doing user experience research. Behaviour & Information Technology, pp. 1--17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Winter, S., Wagner, S. and Deissenboeck, F., 2008. A comprehensive model of usability. In Engineering interactive systems (pp. 106--122). Springer Berlin Heidelberg. Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Zeithaml, V.A., Parasuraman, A. and Malhotra, A., 2002. Service quality delivery through websites: a critical review of extant knowledge. Journal of the academy of marketing science, 30(4), pp. 362--375.Google ScholarGoogle ScholarCross RefCross Ref

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    SAICSIT '16: Proceedings of the Annual Conference of the South African Institute of Computer Scientists and Information Technologists
    September 2016
    422 pages

    Copyright © 2016 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 26 September 2016

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate187of439submissions,43%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader