Abstract
This paper aims to discuss current approaches to smart city rankings following the main thesis that two decades of e-government benchmarking should be used as a source of inspiration on how to evaluate smart government. We use critical analysis of selected smart-city and two major e-government rankings for this purpose. As our findings show, smart city rankings are lacking for several reasons: there is no consensus on what a smart city is, there are no defined development stages, smart city rankings tend to use quantity indicators or concentrate on the supply-side, and they often suffer from dimension or company biases and often lack methodological transparency.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Jaeger, P.T.: The endless wire: E-government as global phenomenon. Gov. Inf. Q. 20(4), 323–331 (2003)
Echeverria, J., Unceta, A.: Citizenship and participation in the European Electronic space. Arbor-Ciencia Pensam. Y Cult. 188(756), 725–732 (2012)
Panopoulou, E., Tambouris, E., Zotou, M., Tarabanis, K.: Evaluating eParticipation sophistication of regional authorities websites: the case of Greece and Spain. In: Electronic Participation: Proceedings of the 1st IFIP WG 8.5 International Conference, ePart 2009, vol. 5694. Linz, Austria, pp. 67–77, 07 December 2009
Bwalya, K.J., Mutula, S.M.: E-government: Implementation, Adoption and Synthesis in Developing Countries. Degruyter, Boston
Bremer, E.S.: Incorporation by reference in an open-government age. Harv. J. Law Publ. Policy 36(1), 131–210 (2013)
Lemieux, V.L., Trapnell, S.E., Worker, J., Excell, C.: Transparency and open government: reporting on the disclosure of information. In: 5th Conference on E-Democracy Open Government (CeDEM 2015), vol. 7, no. 2, pp. 75–93, June 2015
Ho, A., Bender, K., Steenson, J., Roche, E.: Big data and local performance management: the experience of Kansas City, Missouri. In: Chen, Y.-C., Ahn, M.J. (eds.) Routledge Handbook on Information Technology in Government, pp. 95–107. Routledge, New York (2017)
Whitmore, A.: A statistical analysis of the construction of the United Nations e-Government development index. Gov. Inf. Q. 29(1), 68–75 (2012)
Waksberg-Guerrini, A., Aibar, E.: Towards a network government? A Critical Analysis of current assessment methods for e-government. In: Wimmer, M.A., Scholl, J., Grönlund, Å. (eds.) EGOV 2007. LNCS, vol. 4656, pp. 330–341. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74444-3_28
Baker, D.L.: Advancing e-government performance in the United States through enhanced usability benchmarks. Gov. Inf. Q. 26(1), 82–88 (2009)
Bertot, J.C., Jaeger, P.T.: User-centered e-government: challenges and benefits for government Web sites. Gov. Inf. Q. 23(2), 163–168 (2006)
Giffinger, R., Fertner, C., Kramar, H., Kalasek, R., Pichler-Milanović, N., Meijers, E.: Smart cities: ranking of European medium-sized cities, Vienna (2007)
Lee, J., Lee, H.: Developing and validating a citizen-centric typology for smart city services. Gov. Inf. Q. 31(S1), S93–S105 (2014)
Papa, R., Galderisi, A., Vigo Majello, M.C., Saretta, E.: Smart and resilient cities a systemic approach for developing cross-sectoral strategies in the face of climate change. Tema-J. L. Use Mobil. Environ. 8(1), 19–49 (2015)
Vázquez, D.G., Gil, M.T.N.: Sustainability in smart cities: the case of Vitoria-Gasteiz (Spain) – a commitment to a new urban paradigm. In: Carvalho, L.C. (ed.) Handbook of Research on Entrepreneurial Development and Innovation Within Smart Cities, pp. 248–268. Information Science Reference, Hershey (2017)
Bernardino, S., Santos, J.F.: Building smarter cities through social entrepreneurship. In: Carvalho, L.C. (ed.) Handbook of Research on Entrepreneurial Development and Innovation Within Smart Cities, pp. 327–362. Information Science Reference, Hershey (2017)
Andersen, K.V., Henriksen, H.Z.: E-government maturity models: extension of the Layne and Lee model. Gov. Inf. Q. 23(2), 236–248 (2006)
Lemke, F., Taveter, K., Erlenheim, R., Pappel, I., Draheim, D., Janssen, M.: Stage models for moving from e-government to smart government. In: Chugunov, A., Khodachek, I., Misnikov, Y., Trutnev, D. (eds.) EGOSE 2019. CCIS, vol. 1135, pp. 152–164. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-39296-3_12
Schellong, A.R.M.: Benchmarking EU e-government at the crossroads: a framework for e-government benchmark design and improvement. Transform. Gov. People, Process Policy 4(4), 365–385 (2010)
Jovanovska, M.B.: Demarcation of the field of e-government assessment. Transylvanian Rev. Adm. Sci. (48), 19–36 (2016)
Young-Jin, S., Seang-tae, K.: e-Government concepts, measures, and best practices. In: Al-Hakim, L. (ed.) Global e-Government: Theory, Applications and Benchmarking, pp. 340–369. Idea Group Inc., Hershey (2007)
Skargren, F.: What is the point of benchmarking e-government? An integrative and critical literature review on the phenomenon of benchmarking e-government. Inf. Polity 25, 67–89 (2020)
Janowski, T., Durkiewicz, J.: Towards synthetic and balanced digital government benchmarking. In: HICCS (2020). http://hdl.handle.net/10125/64000. Accessed 30 June 2020
Potnis, D.D., Pardo, T.A.: Mapping the evolution of e-Readiness assessments. Transform. Gov. People, Process Policy 5(4), 345–363 (2011)
Kunstelj, M., Jukić, T., Vintar, M.: Analysing the demand side of e-government: what can we learn from Slovenian users? In: Wimmer, M.A., Scholl, J., Grönlund, Å. (eds.) EGOV 2007. LNCS, vol. 4656, pp. 305–317. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74444-3_26
Magoutas, B., Halaris, C., Mentzas, G.: An ontology for the multi-perspective evaluation of quality in e-government services. In: Wimmer, M.A., Scholl, J., Grönlund, Å. (eds.) EGOV 2007. LNCS, vol. 4656, pp. 318–329. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74444-3_27
Jansen, A., Ølnes, S.: Benchmarking eGovernment quality: whose quality are we measuring? In: Electronic Government and Electronic Participation: Joint Proceedings of Ongoing Research and Projects of IFIP WG 8.5 EGOV and ePart 2013, vol. 221. Koblenz, Germany, pp. 43–53 (2013)
Siskos, E., Malafekas, M., Askounis, D., Psarras, J.: e-Government benchmarking in European Union: a multicriteria extreme ranking approach. In: Collaborative, Trusted and Privacy-Aware e/m-Services. 12th IFIP WG 6.11 Conference on e-Business, e-Services, and e-Society, pp. 338–348 (2013)
Gonçalo P.D.: Policy matters? An analysis of outliers in the UN e-Government index. In: ECDG 2019 19th European Conference on Digital Government, pp. 10–18 (2019)
Das, A., Singh, H., Joseph, D.: A longitudinal study of e-government maturity. In: 15th Pacific Asia Conference on Information Systems (PACIS 2011), pp. 1–12 (2011)
Máchová, R., Lněnička, M.: Reframing e-government development indices with respect to new trends in ICT. Rev. Econ. Perspect. 15(4), 383–411 (2015)
Wahid, J.A., Shi, L., Saleem, K.: Incorporation of social media indicator in e-government index. In: 5th International Conference on Communication and Information Processing, pp. 201–209 (2019)
Tassabehji, R., Hackney, R., Maruyama, T.: Evaluating digital public services: a contingency value approach within three exemplar developing countries. Inf. Technol. People 32(4), 1021–1043 (2019)
Janssen, M., van Veenstra, A.F.: Stages of growth in e-government: an architectural approach. Electron. J. e-Gov. 3(4), 193–200 (2005)
Boulos, M.N.K., Tsouros, A.D., Holopainen, A.: ‘Social, innovative and smart cities are happy and resilient’: insights from the WHO EURO 2014 International Healthy Cities Conference. Int. J. Health Geogr. 14 (2015)
Marsal-Llacuna, M.-L.: City indicators on social sustainability as standardization technologies for smarter (citizen-centered) governance of cities. Soc. Indic. Res. 128(3), 1193–1216 (2015)
Maheshwari, D., Janssen, M.: Reconceptualizing measuring, benchmarking for improving interoperability in smart ecosystems: the effect of ubiquitous data and crowdsourcing. Gov. Inf. Q. 31(S1), S84–S92 (2014)
Jurevičienė, D., Biekšaitė, A.: Valuation of Lithuanian cities’s smartness. Econ. Cult. 17(1), 104–115 (2020)
Noori, N., De Jong, M., Hoppe, T.: Towards an integrated framework to measure smart city readiness: the case of Iranian cities. Smart Cities 3, 676–703 (2020)
Anthopoulos, L., Janssen, M., Weerakkody, V.: A Unified Smart City Model (USCM) for smart city conceptualization and benchmarking. Int. J. Electron. Gov. Res. 12(2), 77–93 (2016)
Batlle-Montserrat, J., Blat, J., Abadal, E.: Local e-government benchlearning: impact analysis and applicability to smart cities benchmarking. Inf. Polity 21(1), 43–59 (2016)
Top 50 Smart City Governments. Eden Strategy Institute, ONG&ONG Pte Ltd. (2018). https://static1.squarespace.com/static/5b3c517fec4eb767a04e73ff/t/5b513c57aa4a99f62d168e60/1532050650562/Eden-OXD_Top+50+Smart+City+Governments.pdf. Accessed 05 May 2019
Hales, M., Pena, A.M., Peterson, E., Dessibourg-Freer, N.: A question of talent: how human capital will determine the next global leaders. 2019 Global Cities Report. ATKearney (2019)
Bris, A., Chee, C.H., Lanvin, B.: Sart city index (2019). https://www.imd.org/globalassets/wcc/docs/smart_city/smart_city_index_digital.pdf. Accessed 12 Dec 2019
Bris, A., Chee, C.H., Lanvin, B.: Smart city index methodology (2019). https://www.imd.org/globalassets/wcc/docs/smart_city/smart_city_index_methodology_and_groups.pdf. Accessed 12 Dec 2019
Batten, J.: Citizen centric cities. the sustainable cities index 2018. Arcadis (2018). https://www.arcadis.com/media/1/D/5/%7B1D5AE7E2-A348-4B6E-B1D7-6D94FA7D7567%7DSustainable_Cities_Index_2018_Arcadis.pdf. Accessed 20 Jun 2019
Smart Cities Index 2019. EasyPark Group (2019). https://www.easyparkgroup.com/smart-cities-index/. Accessed 05 May 2019
Berrone, P., Ricart, J.E.: IESE cities in motion index (2019). https://media.iese.edu/research/pdfs/ST-0509-E.pdf. Accessed 07 Dec 2019
Holzer, M., Manoharan, A.P., Melitski, J., Moon, M.J.: Global E-Government Survey (2018-19). National Center for Public Performance, Boston (2020)
Obi, T., Iwasaki, N.: A Decade of World e-Government Rankings. IOS Press BV, Amsterdam (2015)
Wauters, P., Kerschot, H.: Web-based survey on electronic public services: results of the second measurement: April 2002. Summary report. Cap Gemini Ernst & Young (2002). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 Jun 2020
van der Linden, N., eGovernment benchmark 2019: empowering europeans through trusted digital public services. Background report. Capgemini, IDC, Sogeti, and Politecnico di Milano (2019). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
Wauters, P., Colclough, G.: On-line availability of public services: how is Europe progressing? Web based survey on electronic public services. In: Report of the 6th Measurement. Capgemini (2006). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
eEurope - an information society for all. European Commission, COM(1999) 687 final (1999). https://eur-lex.europa.eu/legal-content/EN/TXT/HTML/?uri=URISERV:l24221&from=EN. Accessed 15 June 2020
Koussouris, S., Charalabidis, Y., Gionis, G., Tsitsanis, T., Psarras, J.: Building a local administration services portal for citizens and businesses: service composition, architecture and back-office interoperability issues. In: Wimmer, M.A., Scholl, J., Grönlund, Å. (eds.) EGOV 2007. LNCS, vol. 4656, pp. 80–91. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74444-3_8
Wauters, P.: Benchmarking e-government policy within the e-Europe programme. Aslib Proc. 58(5), 389–403 (2006)
Bavec, C., Vintar, M.: What matters in the development of the e-government in the EU? In: Wimmer, M.A., Scholl, J., Grönlund, Å. (eds.) EGOV 2007. LNCS, vol. 4656, pp. 424–435. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74444-3_36
i2010 – A European Information Society for growth and employment. European Commission, COM(2005) 229 final (2005). https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52005DC0229&from=EN. Accessed 15 June 2020
Wauters, P., Nijskens, M., Tiebout, J.: The user challenge benchmarking the supply of online public services 7th measurement. Capgemini (2007). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
Colclough, G., Tinholt, D.: Smarter, faster, better egovernment. 8th benchmark measurement. CAPGEMINI, RAND EUROPE, IDC, SOGETI AND DTI (2009). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
Codagnone, C.: Benchmarking on-line public services. To develop and improve the eGovernment indicators, second year contract: final report. RSO SPA, IDC Italy (2008). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
Colclough, G., Tinholt, D., Lörincz, B.: Digitizing public services in Europe: putting ambition into action. 9th benchmark measurement. Capgemini, IDC, Rand Europe, Sogeti and DTi (2010). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
Tinholt, D., van der Linden, N.: Delivering the European advantage? ‘How European governments can and should benefit from innovative public services’. Final Background Report. Capgemini, IDC, Sogeti, IS-practice (2014). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
Tinholt, D., van der Linden, N.: Public services online ‘digital by default or by detour?’ Assessing user centric eGovernment performance in Europe – eGovernment benchmark 2012. Final insight report. Capgemini, IDC, Sogeti (2012). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
Tinholt, D., Lörincz, B.: 2011 eGovernment benchmark pilot on open government and transparency measuring the potential of eGovernment to foster open government and transparency in Europe. Capgemini, IDC, Rand Europe, Sogeti and DTi (2011). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
van der Linden, N., Tinholt, D.: eGovernment benchmark 2017. Taking stock of user-centric design and delivery of digital public services in Europe. Capgemini, IDC, Sogeti, and Politecnico di Milano (2017). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
Tinholt, D., van der Linden, N.: Future-proofing eGovernment for a digital single market. Final insight report. Capgemini, IDC, Sogeti, and Politecnico di Milano (2015). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
Tinholt, D., van der Linden, N.: eGovernment benchmark 2016. A turning point for eGovernment development in Europe? Capgemini, IDC, Sogeti, and Politecnico di Milano (2016). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
van der Linden, N., Tinholt, D.: eGovernment benchmark 2018: securing eGovernment for all. Capgemini, IDC, Sogeti, and Politecnico di Milano (2018). https://administracionelectronica.gob.es/pae_Home/pae_OBSAE/Posicionamiento-Internacional/Comision_Europea_OBSAE/benchmark-egovernment.html. Accessed 15 June 2020
Ronaghan, S.A.: Benchmarking e-Government: a global perspective. United Nations, Division for Public Economics and Public Administration (2002). https://publicadministration.un.org/en/research/un-e-government-surveys. Accessed 30 June 2020
Bertucci, G., Hafeez, S.: UN global e-Government survey 2003. United Nations, Department of Economic and Social Affairs (2003). https://publicadministration.un.org/en/research/un-e-government-surveys. Accessed 30 June 2020
Bertucci, G., Hafeez, S.: UN global e-Government readiness report 2004. United Nations, Department of Economic and Social Affairs (2004). https://publicadministration.un.org/en/research/un-e-government-surveys. Accessed 30 June 2020
Bertucci, G., Hafeez, S.: UN global e-Government readiness report 2005. United Nations, Department of Economic and Social Affairs (2005). https://publicadministration.un.org/en/research/un-e-government-surveys. Accessed 30 June 2020
Bertucci, G.: United Nations e-Government Survey 2008. United Nations, New York (2008)
Qian, H.: United Nations e-Government Survey 2010. United Nations, New York (2010)
Qian, H., Kauzya, J.-M., Aquaro, V.: United Nations e-Government Survey 2012. United Nations, New York (2012)
Qian, H., Aquaro, V.: United Nations e-Government Survey 2014. United Nations, New York (2014)
Zhu, J., Barthélemy, M.: United Nations e-Government Survey 2016. United Nations, New York (2016)
Aquaro, V., Barthélemy, M., Schweinfest, S.: United Nations e-Government Survey 2018. United Nations, New York (2018)
Aquaro, V.: e-Government Survey 2020 Digital Government in the Decade of Action for Sustainable Development. Department of Economic and Social Affairs, United Nations, New York (2020)
Mora, L., Angelidou, M., Reid, A.: The current status of smart city research: exposing the division. In: Komninos, N., Kakderi, C. (eds.) Smart Cities in the Post-Algorithmic Era, pp. 17–35. Edward Elgar Pub. (2019)
Barth, J., et al.: Informational urbanism. a conceptual framework of smart cities. In: Proceedings of the 50th Hawaii International Conference on System Science (HICSS-50), Waikoloa Village, Hawaii, USA, pp. 2814–2823 (2017)
Albino, V., Dangelico, R.M., Berardi, U.: Smart cities: definitions, dimensions, performance, and initiatives. J. Urban Technol. 22(1), 3–21 (2015)
Anthopoulos, L.G.: The rise of the smart city. In: Anthopoulos, L.G. (ed.) Understanding Smart Cities: A Tool for Smart Government or an Industrial Trick?, pp. 5–45. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-57015-0_2
Cohen, B.: The 3 generations of smart cities. Fast Company (2015). https://www.fastcompany.com/3047795/the-3-generations-of-smart-cities. Accessed 30 June 2020
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Luterek, M. (2020). Why are Rankings of ‘Smart Cities’ Lacking? An Analysis of Two Decades of e-Government Benchmarking. In: Themistocleous, M., Papadaki, M., Kamal, M.M. (eds) Information Systems. EMCIS 2020. Lecture Notes in Business Information Processing, vol 402. Springer, Cham. https://doi.org/10.1007/978-3-030-63396-7_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-63396-7_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63395-0
Online ISBN: 978-3-030-63396-7
eBook Packages: Computer ScienceComputer Science (R0)