Skip to main content
SpringerLink
Log in

How does the normalization of data affect the ARWU ranking?

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

The aim of this paper is to present new ideas in evaluating Shanghai University’s Academic Ranking of World Universities (ARWU). In particular, this paper shall try to determine whether the normalization of data affects University ranks. In accordance with this, both the normalized and original (raw) data for each of the six variables has been obtained. Based on a sample containing the 54 US universities which are placed in the ARWU top 100, the statistical I-distance method was performed. The results showed great inconsistencies between university ranks obtained for the original and normalized data. These findings were then analyzed and the universities that had the greatest fluctuation in their ranks were noted.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

References

  • Agasisti, T., & Perez-Esparrells, C. (2010). Comparing efficiency in a cross-country perspective: the case of Italian and Spanish state universities. Higher Education, 59, 85–103.

    Article  Google Scholar 

  • Aguillo, I., Bar-IIan, J., Levene, M., & Ortega, J. L. (2010). Comparing university rankings. Scientometrics, 85(1), 243–256.

    Article  Google Scholar 

  • Al-Lagilli, S., Jeremic, V., Seke, K., Jeremic, D., & Radojicic, Z. (2011). Evaluating the health of nations: A Libyan perspective. Libyan Journal of Medicine, 6, 6021.

    Google Scholar 

  • ARWU (2010). Academic ranking of world universities. http://www.arwu.org/ARWUMethodology2010.jsp. Accessed 14 Jan 2012.

  • Billaut, J. C., Bouyssou, D., & Vincke, P. (2010). Should you believe in the Shanghai ranking: An MCDM view. Scientometrics, 84(1), 237–263.

    Article  Google Scholar 

  • Bornmann, L., & Leydesdorff, L. (2011). Which cities produce more excellent papers than can be expected? A new mapping approach—using google maps—based on statistical significance testing. Journal of the American Society of Information Science and Technology, 62(10), 1954–1962.

    Article  Google Scholar 

  • Bornmann, L., & Waltman, L. (2011). The detection of “hot regions” in the geography of science: A visualization approach by using density maps. Journal of Informetrics, 5(4), 547–553.

    Article  Google Scholar 

  • Bowman, N., & Bastedo, M. (2011). Anchoring effects in world university rankings: Exploring biases in reputation scores. Higher Education, 61(4), 431–444.

    Article  Google Scholar 

  • Dehon, C., McCathie, A., & Verardi, V. (2010). Uncovering excellence in academic rankings: A closer look at the Shanghai ranking. Scientometrics, 83(2), 515–524.

    Article  Google Scholar 

  • Docampo, D. (2008). International rankings and quality of the university systems. Revista Education, Sp. Iss. SI, 149–176.

  • Docampo, D. (2011). On using the Shanghai ranking to assess the research performance of university systems. Scientometrics, 86(1), 77–92.

    Article  Google Scholar 

  • Docampo, D. (2012). Adjusted sum of institutional scores as an indicator of the presence of university systems in the ARWU ranking. Scientometrics, 90(2), 701–713.

    Article  Google Scholar 

  • Fields (2010). Fields medals laureates. http://www.mathunion.org/general/prizes. Accessed 25 Jan 2012.

  • HiCi (2010). Highly cited authors. http://www.isihighlycited.com/. Accessed 18 Jan 2012.

  • Hien, P. D. (2010). A comparative study of research capabilities of East Asian countries and implications for Vietnam. Higher Education, 60, 615–625.

    Article  Google Scholar 

  • Ivanovic, B. (1973). A method of establishing a list of development indicators. Paris: United Nations educational, scientific and cultural organization.

    Google Scholar 

  • Ivanovic, B. (1977). Classification theory. Belgrade: Institute for Industrial Economics.

    Google Scholar 

  • Ivanovic, B., & Fanchette, S. (1973). Grouping and ranking of 30 countries of sub-Saharan Africa, two distance-based methods compared. Paris: United Nations educational, scientific and cultural organization.

    Google Scholar 

  • Jeremic, V., & Radojicic, Z. (2010). A new approach in the evaluation of team chess championships rankings. Journal of Quantitative Analysis in Sports, 6(3), 6. doi:10.2202/1559-0410.1257.

  • Jeremic, V., Bulajic, M., Martic, M., & Radojicic, Z. (2011a). A fresh approach to evaluating the academic ranking of world universities. Scientometrics, 87(3), 587–596.

    Article  Google Scholar 

  • Jeremic, V., Isljamovic, S., Petrovic, N., Radojicic, Z., Markovic, A., & Bulajic, M. (2011b). Human development index and sustainability: What’s the correlation? Metalurgia International, 16(7), 63–67.

    Google Scholar 

  • Jeremic, V., Vukmirovic, D., Radojicic, Z., & Djokovic, A. (2011c). Towards a framework for evaluating ICT infrastructure of countries: A Serbian perspective. Metalurgia International, 16(9), 15–18.

    Google Scholar 

  • Jeremic, V., Markovic, A., & Radojicic, Z. (2011d). ICT as crucial component of socio-economic development. Management, 16(60), 5–9.

    Google Scholar 

  • Jeremic, V., Seke, K., Radojicic, Z., Jeremic, D., Markovic, A., Slovic, D., et al. (2011e). Measuring health of countries: A novel approach. Health MED, 5(6), 1762–1766.

    Google Scholar 

  • Knezevic, S., Jeremic, V., Zarkic-Joksimovic, N., & Bulajic, M. (2012). Evaluating the Serbian banking sector: A statistical approach. Metalurgia International, 17(1), 171–174.

    Google Scholar 

  • Leydesdorff, L., & Shin, J. C. (2011). How to evaluate universities in terms of their relative citation impacts: Fractional counting of citations and the normalization of differences among disciplines. Journal of the American Society of Information Science and Technology, 62(6), 1146–1155.

    Article  Google Scholar 

  • Liu, N. C., & Cheng, Y. (2005). Academic ranking of world universities: Methodologies and problems. Higher Education in Europe, 30(2), 127–136.

    Article  Google Scholar 

  • Liu, N. C., Cheng, Y., & Liu, L. (2005). Academic ranking of world universities using scientometrics: A comment to the "fatal attraction". Scientometrics, 64(1), 101–109.

    Article  Google Scholar 

  • Mihailovic, N., Bulajic, M., & Savic, G. (2009). Ranking of banks in Serbia. Yugoslav Journal of Operational Research, 19(2), 323–334.

    Article  MATH  Google Scholar 

  • Nobel (2010). Nobel price laureates. http://nobelprize.org/. Accessed 23 Jan 2012.

  • Radojicic, Z., Isljamovic, S., Petrovic, N., & Jeremic, V. (2012). A novel approach to evaluating sustainable development. Problemy Ekorozwoju—Problems of Sustainable Development, 7(1), 81–85.

    Google Scholar 

  • Stolz, I., Hendel, D., & Horn, A. (2010). Ranking of rankings: Benchmarking twenty-five higher education ranking systems in Europe. Higher Education, 60(5), 507–528.

    Article  Google Scholar 

  • Torres-Salinas, D., Moreno-Torres, J. G., Delgado-Lopez-Cezar, E., & Herrera, F. (2011). A methodology for institution-field rankings based on a bidimensional analysis: The IFQ2A index. Scientometrics, 88(3), 771–786.

    Article  Google Scholar 

  • van Raan, A. F. J. (2005a). Fatal attraction: Ranking of universities by bibliometric methods. Scientometrics, 62, 133–145.

    Article  Google Scholar 

  • van Raan, A. F. J. (2005b). Reply to the comments of Liu et al. Scientometrics, 64(1), 111–112.

    Article  Google Scholar 

  • Web of Knowledge (2010). Web of Knowledge. http://www.isiknowledge.com. Accessed 22 Jan 2012.

Download references

Author information

Authors and Affiliations

  1. Faculty of Organizational Sciences, University of Belgrade, Jove Ilica 154, 11000, Belgrade, Serbia

    Milica Jovanovic, Veljko Jeremic, Gordana Savic, Milica Bulajic & Milan Martic

Authors
  1. Milica Jovanovic
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Veljko Jeremic
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gordana Savic
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Milica Bulajic
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Milan Martic
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Veljko Jeremic.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jovanovic, M., Jeremic, V., Savic, G. et al. How does the normalization of data affect the ARWU ranking?. Scientometrics 93, 319–327 (2012). https://doi.org/10.1007/s11192-012-0674-0

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-012-0674-0

Keywords

JEL Classification

Mathematics Subject Classification

Search

Navigation