Article

Measuring e-government impact: existing practices and shortcomings

Authors:

Marijn Janssen,

Tom M. van EngersAuthors Info & Claims

ICEC '04: Proceedings of the 6th international conference on Electronic commerce

Pages 480 - 489

https://doi.org/10.1145/1052220.1052281

Published: 25 March 2004 Publication History

Abstract

Public administrations of all over the world invest an enormous amount of resources in e-government. How the success of e-government can be measured is often not clear. E-government involves many aspects of public administration ranging from introducing new technology to business process (re-)engineering. The measurement of the effectiveness of e-government is a complicated endeavor.In this paper current practices of e-government measurement are evaluated. A number of limitations of current measurement instruments are identified. Measurement focuses predominantly on the front (primarily counting the number of services offered) and not on the back-office processes. Interpretation of measures is difficult as all existing measurement instruments lack a framework depicting the relationships between the indicators and the use of resources. The different measures may fit the aim of the owners of the e-governmental services, however, due to conflicting aims and priorities little agreement exists on a uniform set of measures, needed for comparison of e-government development. Traditional methods of measuring e-government impact and resource usage fall short of the richness of data required for the effective evaluation of e-government strategies.

References

[1]

Accenture (2001). Governments Closing Gap Between Political Rhetoric and eGovernment Reality, http://www.accenture.com/xdoc/en/industries/government/2001FullReport.pdf.

[2]

Accenture (2002). eGovernment Leadership -Realizing the Vision, http://www.accenture.com/xd/xd.asp?it=enWeb&xd=industries/government/gove_welcome.xml<

[3]

Accenture (2003). eGovernment Leadership: Engaging the Customer, http://www.accenture.com/xd/xd.asp?it=enweb&xd=industries/government/gove_capa_egov.xml<

[4]

Armour, F. J. Kaisler, S. H. and Liu, S. Y. (1999). A big-picture look at Enterprise Architectures, IEEE IT Professional, 1(1): 35--42.

Digital Library

[5]

Bigné, E., Moliner, M. A., and Sánchez, J. (2003) Perceived Quality and satisfaction in multiservice organizations. The case of Spanish public services. Journal of Services Marketing, 17(4), pp. 420--442.

[6]

Boer, A. Engers, T. van and R. Winkels (2003). Using Ontologies for Comparing and Harmonizing Legislation. In Proceedings of the International Conference on Artificial Intelligence and Law (ICAIL), Edinburgh (UK), ACM Press.

Digital Library

[7]

Alexander Boer, Radboud Winkels, Rinke Hoekstra, and Tom M. van Engers. Knowledge Management for Legislative Drafting in an International Setting. In D. Bourcier, editor, Legal Knowledge and Information Systems. Jurix 2003: The Sixteenth Annual Conference., pages 91--100, Amsterdam, 2003. IOS Press.

[8]

Bons R., Ronald M. Lee and Tan, Yua-Hua, (1999). A Formal Specification of Automated Auditing of Trustworthy Trade Procedures for Open Electronic Commerce. Hawaii International Conference on System Sciences (HICCS).

Digital Library

[9]

Buckland and F. Gey (1994). The relationship between recall and precision. Journal of the American Society for Information Science, 45(1):12--19.

Digital Library

[10]

Bruin, H. de (2002). Performance measurement in the public sector: strategies to cope with the risks of performance measurement. The International Journal of Public Sector Management, vol. 15, no. 7, pp. 578--594.

[11]

Checkland, P. (1981). Systems Thinking, Systems Practice. Wiley, Chichester.

[12]

Coase, R. (1937). The Nature of the Firm. Economia, 4: 386--405.

[13]

European Commissions (2002). 2003 European Innovation Scoreboard: European Trend Chart on Innovation. Innovation/SMEs Programme.

[14]

European Commission (2004). Green paper on Public private partnerships and community law on public contracts and concessions, European Commission, no. 327.

[15]

Fagan, J. C. & Fagan, B. (2004). An accessibility study of state legislative web sites. Government Information Quarterly, 21: 65--85.

[16]

Galliers, R. D. (1992). Information Systems Research. Issues, methods and practical guidelines. Alfred Waller, Fawley, England.

[17]

Green, S. H. B. (1998), Cyberspace winners: how they did it, Business Week, 22 June, pp. 154--60.

[18]

Groot, H., de and R. Goudriaan (1991). De productiviteit van de overheid: over prestaties, personeel en uitgaven in de publieke sector. Academic Service, Schoonhoven, The Netherlands.

[19]

Hazlett, S. A. and Hill, F. (2003). E-government: the realities of using IT to transform the public sector. Managing Service Quality, Vol. 13, No. 6, pp. 445--452.

[20]

Janssen, M. F. W. H. A. (2001). Designing Electronic Intermediaries. Doctoral Dissertation, Delft University of Technology.

[21]

Janssen, Marijn & Davidse, Anouk (2004). Evaluation of a Performance-based Accountability System. The 4th European Conference on E-government (ECEG), Dublin Castle, Dublin, Ireland, 17-18 June 2004

[22]

Jensen, M. and Meckling, W. (1976). Theory of the Firm: Managerial behavior, agency costs, and capital structure, Journal of Financial Economics, 5: 305--360.

[23]

Layne, KJL & Lee, J. (2001) "Developing fully functional E-government: A four stage model", Government Information Quarterly, Vol 18, No. 2, pp 122--136.

[24]

Lee, J. K. (2003). A model for monitoring public sector web site strategy. Internet Research. Electronic networking application and policy. Vol. 13, no. 4, pp. 259--266.

[25]

Malone, T. W. & Crowston, K. (1994). The Interdisciplinary Study of Coordination. ACM Computing Surveys, vol. 26, no. 2, pp. 87--119.

Digital Library

[26]

Merwe, R. van der, and Bekker, J. (2003). A framework and methodology for evaluating e-commerce web sites. Internet Research: electronic Networking Applications and Policy. Vol. 13, No.5, pp. 330--341.

[27]

Moon, M. J. (2002). The Evolution of E-Government Among Municipalities; Rhetoric or reality? Public Administration Review. Vol. 62, no. 4, pp. 424--433.

[28]

Parasuraman, A., Zeithaml, V. A. and Berry, L. L. (1988). SERVQUAL: a multiple item scale for measuring consumer perceptions of service quality, Journal of Retailing, Vol. 64, pp. 12--40.

[29]

Peters, Rob and Wilson, Frank (2003). Natural Language access to regional information sources: the PortofRotterdam case: 4th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 2003.

[30]

Provincial council (2003) Innovatiebrief kenniseconomie Zuid-Holland "Kennismaken met Kenniszaken, http://www.zuid-holland.nl/images/126_107822.pdf, page 14.

[31]

Rohleder, S. J. et al. (2004). eGovernment Leadership: High Performance, Maximum Value. Fifth Annual Accenture eGovernment Study. Accenture Government Executive Studies, http://www.accenture.com/xdoc/en/industries/government/gove_egov_value.pdf

[32]

Simeon, R. (1999), "Evaluating domestic and international Web site strategies", Internet Research, Vol. 9 No. 4, pp. 297--308.

[33]

Quinn, R. E. and Rohrbaugh, J. W. (1983). A Spatial Model of Effectiveness criteria: Towards a competing values approach to organizational effectiveness. Management Science 29: 363--377.

Digital Library

[34]

Van Engers, T. M., 2004, Legal Engineering: A Knowledge Engineering Approach To Improving Legal Quality, in eGovernment and eDemocracy: Progress and Challenges, Padget, J., Neira, R., De León, J. L., Editors, Instituto Politéchnico Nacional Centro de Investigacion en Computación, ISBN 970-36-0152-9, p. 189--206.

[35]

Williamson, O. E. (1975). Market and Hierarchies, Analysis and Antitrust Implications. A study in the economics of internal organization. Macmillan, New York.

[36]

Yin, R. K. (1989). Case Study Research: Design and methods. Sage publications, Newbury Park, California.

Cited By

Yun LYun SXue H(2024)Improving citizen-government interactions with generative artificial intelligence: Novel human-computer interaction strategies for policy understanding through large language modelsPLOS ONE10.1371/journal.pone.031141019:12(e0311410)Online publication date: 17-Dec-2024
https://doi.org/10.1371/journal.pone.0311410
Przeybilovicz ECunha MRibeiro M(2023)Decolonizing e-government benchmarkingProceedings of the 24th Annual International Conference on Digital Government Research10.1145/3598469.3598534(570-582)Online publication date: 11-Jul-2023
https://dl.acm.org/doi/10.1145/3598469.3598534
Cheikhi LFath-Allah AAl-Qutaish RIdri AAbran A(2022)An E-Government Portal Maturity ModelImpact of Digital Twins in Smart Cities Development10.4018/978-1-6684-3833-6.ch002(24-79)Online publication date: 25-Nov-2022
https://doi.org/10.4018/978-1-6684-3833-6.ch002
Show More Cited By

Index Terms

Measuring e-government impact: existing practices and shortcomings
1. Applied computing

Recommendations

Open government and e-government: democratic challenges from a public value perspective
dg.o '11: Proceedings of the 12th Annual International Digital Government Research Conference: Digital Government Innovation in Challenging Times

We consider open government (OG) within the context of e-government and its broader implications for the future of public administration. We argue that the current US Administration's Open Government Initiative blurs traditional distinctions between e-...
A Citizen-Oriented Approach for Evaluating the Performance of e-Government in Sri Lanka

This paper presents an empirical study of the performance of e-government in Sri Lanka from the perspective of citizens within a public value based conceptual framework. The delivery of quality public services, the effectiveness of public organizations, ...
Open government and e-government: democratic challenges from a public value perspective
Special issue on Open Government and Public Participation: Issues and Challenges in Creating Public Value

We argue that the Obama Administration's Open Government Initiative blurs distinctions between e-democracy and e-government by incorporating historically democratic practices. now enabled by emerging technology. within administrative agencies. We ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICEC '04: Proceedings of the 6th international conference on Electronic commerce

March 2004

684 pages

ISBN:1581139306

DOI:10.1145/1052220

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ICEC: International Center for Electronic Commerce

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 March 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 150 of 244 submissions, 61%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

58
Total Citations
View Citations
3,066
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yun LYun SXue H(2024)Improving citizen-government interactions with generative artificial intelligence: Novel human-computer interaction strategies for policy understanding through large language modelsPLOS ONE10.1371/journal.pone.031141019:12(e0311410)Online publication date: 17-Dec-2024
https://doi.org/10.1371/journal.pone.0311410
Przeybilovicz ECunha MRibeiro M(2023)Decolonizing e-government benchmarkingProceedings of the 24th Annual International Conference on Digital Government Research10.1145/3598469.3598534(570-582)Online publication date: 11-Jul-2023
https://dl.acm.org/doi/10.1145/3598469.3598534
Cheikhi LFath-Allah AAl-Qutaish RIdri AAbran A(2022)An E-Government Portal Maturity ModelImpact of Digital Twins in Smart Cities Development10.4018/978-1-6684-3833-6.ch002(24-79)Online publication date: 25-Nov-2022
https://doi.org/10.4018/978-1-6684-3833-6.ch002
Mishra S(2022)Mediating Roles of Service Innovation and Perceived Corruption in the Relationship between E-government and Citizens’ SatisfactionInternational Journal of Public Administration10.1080/01900692.2022.213984547:7(437-451)Online publication date: 2-Nov-2022
https://doi.org/10.1080/01900692.2022.2139845
Cabana R(2022)Presenting, Representing, and Misrepresenting COVID-19 in the Five Central Asian States: The Political Underpinnings of Official State Coronavirus Websites in Authoritarian RegimesCOVID-19 and a World of Ad Hoc Geographies10.1007/978-3-030-94350-9_37(661-682)Online publication date: 16-Sep-2022
https://doi.org/10.1007/978-3-030-94350-9_37
Heidary Dahooie JVanaki ADaneshmoghadam SZavadskas E(2020)A Framework to Overcome Hesitancy of Decision-Makers in E-Government Web Site EvaluationInternational Journal of Fuzzy Systems10.1007/s40815-019-00790-zOnline publication date: 10-Feb-2020
https://doi.org/10.1007/s40815-019-00790-z
Islam ALi WJohnson KLauchande P(2019)How far has the integrated care come? Applying an asymmetric lens to inter-organisation trust amongst health and social care organisationsInternational Entrepreneurship and Management Journal10.1007/s11365-019-00583-8Online publication date: 4-May-2019
https://doi.org/10.1007/s11365-019-00583-8
Bakunzibake PKlein GIslam S(2019)E‐government implementation and monitoring: The case of Rwanda's ‘one‐stop’ E‐governmentTHE ELECTRONIC JOURNAL OF INFORMATION SYSTEMS IN DEVELOPING COUNTRIES10.1002/isd2.1208685:5Online publication date: 19-Feb-2019
https://doi.org/10.1002/isd2.12086
Edrees MMahmood A(2018)An Empirical Investigation into Assessing the Success of eGovernment SystemsInternational Journal of Technology Diffusion10.4018/IJTD.20180701019:3(1-12)Online publication date: Jul-2018
https://doi.org/10.4018/IJTD.2018070101
Fath-Allah ACheikhi LIdri AAl-Qutaish R(2018)A Best Practice Based E-Government E-portals Quality model: A detailed view2018 6th International Conference on Control Engineering & Information Technology (CEIT)10.1109/CEIT.2018.8751851(1-6)Online publication date: Oct-2018
https://doi.org/10.1109/CEIT.2018.8751851
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten