Herschel Nomdoe
ABSTRACT
Over a period spanning approximately twenty five years IS researchers have been plagued by the problem of how to evaluate IS effectiveness or success. After the advent of the WWW in the 1990s, questions have arisen regarding the relevance of previously established evaluation approaches to the evaluation of web-based IS. In this paper, we describe a holistic approach to Information Systems (IS) evaluation, focusing on web-based applications. In this context, a holistic perspective refers to a multi-stakeholder evaluation regarding perceptions of IS Success. The paper presents the results of a study in which a web-based IS at a national telecommunications company in South Africa was evaluated using e-Service Quality (e-SQ) constructs. The study demonstrates the operationalisation of an e-SQ instrument for the purposes of evaluating IS effectiveness amongst multi-stakeholders. Evidence is provided that measuring attitudes of different stakeholders provides a more holistic perspective of IS success.
- Babbie, E. & Mouton, J. 2004. The practice of social research. Cape Town: Oxford University Press.Google Scholar
- Delone, W. H. & McLean, E. R. 1992. Information systems success: The quest for the dependent variable. Information Systems Research, 3, 1, 60--95.Google ScholarDigital Library
- Delone, W. H. & McLean, E. R. 2002. Information systems success revisited. Proceeding of the 35th Hawaai international conference of system sciences. Google ScholarDigital Library
- Delone, W. H. & McLean, E. R. 2003. The Delone and McLean model of information systems success: a ten-year update. Journal of Management Information Systems, 19, 4, 9--30. Google ScholarDigital Library
- Grover, G., Jeong, S. R. & Segars, A. H. 1996. Information systems effectiveness: the construct space and patterns of application. Information and Management, 31, 4, 177--191. Google ScholarDigital Library
- Grover, V., Purvis, R. & Coffey, J. (eds). 2004. Information systems effectiveness. http://business.clemson.edu/ISE/ {14 June 2004}Google Scholar
- Molla, A. & Licker P. S. 2001. E-Commerce Systems Success: An Attempt to Extend and Respecify the Delone and McLean Model of IS Success. Journal of Electronic Commerce Research, 2, 4, 131--141.Google Scholar
- Myers, M. D. (ed). 1997. Qualitative research in information systems. http://www.qual.auckland.ac.nz {29 January 2005}.Google Scholar
- Parasuraman, A., Zeithaml, V. A. & Leonard, L. L. 1988. SERVQUAL: a multi-item scale for measuring consumer perceptions of service quality. Journal of Retailing, 64, 1, 12--40.Google Scholar
- Parasuraman, A., Zeithaml, V. A. & Malhotra, A. 2005. E-S-QUAL: A Multi-Item Scale for Assessing Electronic Service Quality. Journal of Service Research, 7, 3, 213--233.Google ScholarCross Ref
- Pather, S., Erwin, G. & Remenyi, D. 2004. E-commerce success: the quest for IS effectiveness measurement: a conceptual framework for the e-commerce environment. South African Computer Journal, 32, 34--43.Google Scholar
- Santos, J. 2003. E-service quality: a model of virtual service quality dimensions. Managing Service Quality, 13, 3, 233--246.Google ScholarCross Ref
- Saunders, M. N. K., & Williams, C. S. 2002. Towards an Informed Evaluation of Information Systems Services' Quality: The Development and Application of the Template Process. Electronic Journal of Business Research Methods, 1, 1, 42--49.Google Scholar
- Seddon, P. B., Staples, S., Patnayakuni R. & Bowtell, M. 1999. Dimensions of information systems success. Communications of the Association for Information Systems, 2, 3. http://cais.aisnet.org/articles/2-20/article.htm {23 June 2004}. Google ScholarDigital Library
- Smithson, S. & Hirschheim, R. 1998. Analysing information system evaluation: another look at an old problem. European Journal of Information Systems, 7, 3, 158--174. Google ScholarDigital Library
- Van Riel, A. C. R, Liljander, V. & Jurriens, P. 2001. Exploring consumer evaluations of e-services: a portal site. International Journal of Service Industry Management, 12, 4, 359--377.Google ScholarCross Ref
- Watson, R. T., Pitt, L. F., Cunningham, C. J. & Nel, D. 1993. User Satisfaction and service quality of the IS department: closing the gaps. Journal of Information Technology, 8.Google ScholarCross Ref
- Watson, R. T., Pitt, L. F., & Kavan, C. B. 1998. Measuring Information Systems Service Quality: Lessons form two longitudinal case studies. MIS Quarterly, 22, 1, 61--79. Google ScholarDigital Library
- Whyte, G., and Bytheway, A. 1996. Factors affecting information systems' success. International Journal of Service Industry Management, 7, 1, 74--93.Google ScholarCross Ref
- Whyte, G., Bytheway, A. & Edwards, C. 1997. Understanding user perceptions of information systems success. Journal of Strategic Information Systems, 6, 35--68.Google ScholarCross Ref
- Yang, Z. 2001. Consumer perceptions of service quality in Internet-based electronic commerce. Proceeding of the 30th EMAC Conference: Bergen, 8--11 May.Google Scholar
- Yin, R. K. 1994. Case study research, design and methods. 2nd ed. Newbury Park, CA: Sage.Google Scholar
- Zeithaml, V. A. 2002. Service excellence in electronic channels. Managing Service Quality, 12, 3, 135--139.Google ScholarCross Ref
Index Terms
- Providing a holistic perspective to evaluating e-service quality in web-based systems: a multi-stakeholder approach
Recommendations
Dynamic Fuzzy Evaluation for E-Commerce Service Quality Based on the SERVPERF
ICEE '10: Proceedings of the 2010 International Conference on E-Business and E-GovernmentThis paper reports on a study which evaluates electronic commerce service quality based on the dynamic fuzzy sets by improving the SERVPERF model. At first, this paper reviews literature on SERVQUAL, SERVPERF and some other electronic service quality ...
A Respecification and Extension of the DeLone and McLean Model of IS Success
DeLone and McLean's DeLone, W. H., E. R. McLean. 1992. Information systems success: The quest for the dependent variable. Inform. Systems Res.31 60--95. comprehensive review of different information system success measures concludes with a model of “...
Measuring organizational IS effectiveness: an overview and update of senior management perspectives
This paper reports the views of 80 senior IT managers about IT evaluation approaches, and the benefits that IT provides for their organizations. Their views were obtained through a survey mailed to medium to large organizations in both Europe and the ...
Comments