e-GovQual: A multiple-item scale for assessing e-government service quality

https://doi.org/10.1016/j.giq.2011.08.011Get rights and content

Abstract

A critical element in the evolution of governmental services through the internet is the development of sites that better serve the citizens' needs. To deliver superior service quality, we must first understand how citizens perceive and evaluate online. Citizen assessment is built on defining quality, identifying underlying dimensions, and conceptualizing measurements of these e-government services. In this article an e-gov service quality model (e-GovQual) is conceptualized and then a multiple-item scale for measuring e-gov service quality of governmental sites where citizens seek either information or service, is developed, refined, validated confirmed and tested.

Highlights

► We conceptualised a quality model (e-Gov-Qual) for e-government service quality. ► We developed, refined, validated and confirmed a multiple-item scale. ► E-GovQual is a four-dimensional, 21 item scale. ► Four dimensions are used: reliability, efficiency, citizen support and trust.

Introduction

The subject of e-service and website quality is very rich in context of definitions, models, and measurement instruments. Nevertheless, different quality dimensions have been proposed and there is no consensus on the component dimensions. Collectively, the extant literature suggests that e-service quality is a multidimensional construct although the content of what constitutes e-service quality varies across studies (Zeithaml, Parasuraman, & Malhorta, 2002).

While early in the development of e-government services, issues of accessibility were troubling and while some issues do remain, there is a new awareness raised by scholars like Bertot and Jaeger (2006).

While the literature is not as robust as we would like to see, the authors believe this manuscript will begin to provide a conceptual foundation examining what is necessary for determining quality of e-government services. The provision of such a study will further enhance the e-government's ability to exploit and further attract more citizens to make their transactions through the web.

The objective of this study is to develop and validate an instrument to measure citizens' perceptions of service quality from e-government sites or portals. Throughout this article we describe the development, refinement, psychometric evaluation, potential applications and limitations of a multiple-item scale (e-GovQual) for measuring e-government service quality of governmental sites, where citizens seek either information or service. As already noticed by Aladwani and Palvia (2002) there are three generic steps common in all models' construction and verification that include (1) conceptualization, (2) design, and (3) normalization. In the first step a model is conceptualized after an extensive literature survey. The second step focuses on construct validity and reliability analysis. In this step the refining of the sample of items takes place—in order to come up with an initial scale—deciding on such operational issues as question types and question sequence. The third and last step concerns the effort to normalize the scale that has been developed. It involves the important steps of subsequent independent verification and validation. In our research's first step, conceptualization, after an extensive literature review as provided in Section 22, we classified 33 e-government quality attributes under six main quality dimensions: Ease of Use, Trust, Functionality of the Interaction Environment, Reliability, Content and Appearance of Information, and Citizen Support. After creating the conceptual model we needed to confirm whether the quality indicators selected describe the construct of e-government service quality. As a next step, a questionnaire based on these criteria was designed to elicit and assess information on preferences of the citizens when evaluating e-government service and governmental websites. The scale was produced following guidelines for measurement development proposed by Churchill (1979). In order to refine and evaluate the scale to measure e-government quality we collected 630 responses via an online survey that took place from February to June of 2007. We refined the scale, tested its reliability, and looked for a stable factor structure that resulted in 21 quality attributes classified under four quality dimensions: Reliability, Efficiency, Citizen Support and Trust (e-GovQual). A second online survey with 264 respondents took place from November 2007 to February 2008 in order to verify, validate, and finally to confirm the scale. This instrument developed under the above process would be valuable to researchers and practitioners interested in designing, implementing, and managing governmental websites.

The rest of the paper consists of five sections. The next section reviews prior research related to e-government, e-service quality, website quality, portal quality, and service quality measurements; the third section includes the conceptualization of the e-government model and identifies the variables that capture e-government service quality and describes the development of the conceptual model relating six essential factors of e-government service quality to citizens' perceptions; the fourth section and its various subsections describe the design and the normalization of the scale including the data collection and the steps involved in scale development—preliminary scale, refinement, validation, testing, etc.; the next section discusses applications of the proposed scale, limitations of the current study, and directions of future research; the paper ends with our conclusions from the study.

Section snippets

Measurement of service quality

The studies that we embraced in the literature survey were on both website quality and e-service quality since the citizens that may use a governmental site may either be information seekers or may require a service. We consider that the provision of information is also a service, so from now on when we discuss e-service quality the website quality is also implied.

As already mentioned quality of e-services approaches focuses on the quality of the service delivered. Emphasis is put on the way

Development of an e-government model

In order to evaluate a product and discover its weak points, usability testing is a technique used to do so. Usability testing focuses on measuring a human-made product's capacity to meet its intended purpose. Usability testing can be divided into three categories: inquiry, inspection, and formal usability testing.

Inspection methods are conducted in a usability laboratory. These methods either do not require the involvement of users at all, or restrict user involvement based on the goals of the

Preliminary scale development

After creating the conceptual model there was a need to confirm whether the sample of items depicted there, captures the construct of e-government service quality. As a next step, a questionnaire based on these criteria was designed to elicit and assess information on preferences of the citizens when evaluating e-government service and governmental websites.

At first we arranged the attributes chosen in a questionnaire phrased in SERVQUAL's format (Zeithaml, Parasuraman, & Berry, 1990). Each

Discussion

Informed by insights from the extant literature, we set out to conceptualize, construct, refine, and test a multiple-item scale (e-GovQual) for measuring the service quality delivered by governmental websites. e-GovQual is a four-dimensional, 21-item scale. We hope that it will assist practitioners in systematically assessing and improving the service quality provided by governmental websites. We next offer directions for further research on the field and discuss practical implications of our

Conclusions

Electronic government is every day more and more important since nearly all transactions with the government tend to be electronic, and thus government will increasingly need a means of assessing the quality of an e-government website. E-government websites in many cases will fashion and could have an important impact on the citizens' view of the government. The development of high quality e-government information products and services is an important issue addressed through the development of

Xenia Papadomichelaki is a PhD candidate and senior researcher at the information Management Unit/National Technical University of Athens (NTUA). She is a Mechanical Engineer and has obtained her master in business administration degree from Canterbury Business School, Great Britain. Since then she has worked in several projects and is currently working as quality manager in Microwave and Fiber Optics Laboratory (MFOL) of NTUA and her research interests include quality management, e-government

References (93)

  • Y.S. Kang et al.

    Do visitors' interest level and perceived quantity of web page content matter in shaping the attitude toward a web site?

    Decision Support Systems

    (2006)
  • C. Kaylor et al.

    Gauging e-government: A report on implementing services among American cities

    Government Information Quarterly

    (2001)
  • A.G. Smith

    Applying evaluation criteria to New Zealand government websites

    International Journal of Information Management

    (2001)
  • Z. Yang et al.

    Development and validation of an instrument to measure user perceived service quality of information presenting web portals

    Information & Management

    (2005)
  • J. Zhao et al.

    Opportunities and threats: A security assessment of state e-government websites

    Government Information Quarterly

    (2010)
  • L.M. Alzola et al.

    Tangibility as a quality factor in electronic commerce B2C

    Managing Service Quality

    (2006)
  • American Customer Satisfaction Index

    The American Customer Satisfaction index—the voice of the nation's consumer

  • S.J. Barnes et al.

    Evaluating WAP news sites: The WEBQUAL/M approach, in global cooperation in the new millennium

  • S.J. Barnes et al.

    Assessing the quality of auction web sites

  • S.J. Barnes et al.

    An integrative approach to the assessment of e-commerce quality

    Journal of Electronic Commerce

    (2002)
  • S.J. Barnes et al.

    Interactive e-government: Evaluating the web site of the UK Inland Revenue

    Journal of Electronic Commerce in Organisations

    (2003)
  • S.J. Barnes et al.

    Interactive egovernment services: Modelling user perceptions with eQual

    Electronic Government

    (2004)
  • K. Barzilai-Nahon et al.

    Similarities and differences of e-commerce and e-government: Insights from a pilot study

  • H.H. Bauer et al.

    Measuring the quality of e-banking portals

    International Journal of Bank Marketing

    (2005)
  • J.C. Bertot et al.

    User-centered e-government: Challenges and benefits for government web sites

    Government Information Quarterly

    (2006)
  • A.A. Bessa et al.

    e-Commerce website quality evaluation

  • M. Brebner et al.

    The accessibility of New Zealand public library web sites to people who are blind or vision impaired

  • G. Büyüközkan et al.

    Evaluating e-learning web site quality in a fuzzy environment

    International Journal of Intelligent Systems

    (2007)
  • S. Cai et al.

    Internet users' perceptions of online service quality: A comparison of online buyers and information searchers

    Managing Service Quality

    (2003)
  • D.T. Campbell et al.

    Convergent and discriminant validation by the multitrait–multimethod matrix

    Psychological Bulletin

    (1959)
  • C. Cappiello et al.

    Qos in multichannel IS: the MAIS approach

  • A. Caro et al.

    Defining a quality model for portal data

  • G.A. Churchill

    A paradigm for developing better measures of marketing constructs

    Journal of Marketing Research

    (1979)
  • A.L. Clyde

    Library and the web: A strategic planning approach to web site management

    The Electronic Library

    (2000)
  • A.B. Costello et al.

    Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis

    Practical Assessment, Research & Evaluation

    (2005)
  • J. Cox et al.

    Key quality factors in web site design and use: An examination

    International Journal of Quality & Reliability Management

    (2002)
  • L.J. Cronbach

    Coefficient alpha and the internal structure of tests

    Psychometrika

    (1951)
  • L.J. Cronbach

    Test validation

    Washington, DC.R. L. Thorndike, Educational Measurement, American Council on Education

    (1971)
  • L.J. Cronbach et al.

    Construct validity in psychological tests

    Psychological Bulletin

    (1955)
  • eGovernment Unit, DG Information Society, European Commission

    Top of the web: User satisfaction and usage survey of e-government services

    (2004)
  • D. Gefen et al.

    Trust and TAM in online shopping: An integrated model

    MIS Quarterly

    (2003)
  • D. Goodhue

    Development and measurement validity of a task-technology fit instruments for user evaluations of information systems

    Decision Sciences

    (1998)
  • S. Gounaris et al.

    Assessing service quality on the web: Evidence from business-to-consumer portals

    Journal of Services Marketing

    (2003)
  • S. Gullikson et al.

    The impact of information architecture on academic web site usability

    The Electronic Library

    (1999)
  • J.F. Hair et al.

    Multivariate data analysis

    (1998)
  • E. Herrera-Viedma et al.

    Evaluating the information quality of web sites: A methodology based on fuzzy computing with words

    Journal of the American Society for Information Science and Technology

    (2006)
  • Cited by (214)

    View all citing articles on Scopus

    Xenia Papadomichelaki is a PhD candidate and senior researcher at the information Management Unit/National Technical University of Athens (NTUA). She is a Mechanical Engineer and has obtained her master in business administration degree from Canterbury Business School, Great Britain. Since then she has worked in several projects and is currently working as quality manager in Microwave and Fiber Optics Laboratory (MFOL) of NTUA and her research interests include quality management, e-government and applied multivariate techniques.

    Gregoris Mentzas is a professor in the School of Electrical and Computer Engineering at the National Technical University of Athens and Director of the Information Management Unit at the Institute of Communication and Computer Systems, Athens, Greece. His area of expertise is information technology management and his research concerns the integration of knowledge management, semantic web and e-service technologies, collaboration and workflow management, corporate knowledge management in e-government and e-business settings. He has published her work in more than 130 papers in international journals and conferences including many leading journals as presented in http://www.imu.iccs.gr. He has a Ph.D. in operations research and information systems from the National Technical University of Athens in Greece.

    1

    Fax: + 30 210 7723550.

    View full text