Skip to main content
Log in

A fresh approach to evaluating the academic ranking of world universities

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

The aim of this article is to present new ideas in evaluating Shanghai University’s Academic Ranking of World Universities (ARWU). One issue frequently put forth in various publications is that the Shanghai rankings are sensitive to the relative weight they attribute to each variable. As a possible remedy to this issue, the statistical I-distance method is proposed to be used. Based on a sample containing the top 100 ranked universities, the results show a significant correlation with the official ARWU list. However, some inconsistencies concerning European universities have been noticed and elaborated upon.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  • Agasisti, T., & Perez-Esparrells, C. (2010). Comparing efficiency in a cross-country perspective: The case of Italian and Spanish state universities. Higher Education, 59, 85–103.

    Article  Google Scholar 

  • Aguillo, I., Bar-IIan, J., Levene, M., & Ortega, J. L. (2010). Comparing university rankings. Scientometrics, 85(1), 243–256.

    Article  Google Scholar 

  • Billaut, J. C., Bouyssou, D., & Vincke, P. (2010). Should you believe in the Shanghai ranking: An MCDM view. Scientometrics, 84(1), 237–263.

    Article  Google Scholar 

  • Bowman, N., & Bastedo, M. (2010). Anchoring effects in world university rankings: Exploring biases in reputation scores. Higher Education. doi: 10.1007/s10734-010-9339-1.

  • Dehon, C., McCathie, A., & Verardi, V. (2010). Uncovering excellence in academic rankings: A closer look at the Shanghai ranking. Scientometrics, 83(2), 515–524.

    Article  Google Scholar 

  • Docampo, D. (2008). International rankings and quality of the university systems. Revista Education, 15(SI), 149–176.

    Google Scholar 

  • Docampo, D. (2011). On using the Shanghai ranking to assess the research performance of university systems. Scientometrics, 86(1), 77–92.

    Article  Google Scholar 

  • Florian, R. V. (2007). Irreproducibility of the results of the Shanghai academic ranking of world universities. Scientometrics, 72(1), 25–32.

    Article  MathSciNet  Google Scholar 

  • Hien, P. D. (2010). A comparative study of research capabilities of East Asian countries and implications for Vietnam. Higher Education, 60, 615–625.

    Article  Google Scholar 

  • Ivanovic, B. (1973). A method of establishing a list of development indicators. Paris: United Nations educational, scientific and cultural organization.

    Google Scholar 

  • Ivanovic, B. (1977). Classification theory. Belgrade: Institute for Industrial Economics.

    Google Scholar 

  • Ivanovic, B., & Fanchette, S. (1973). Grouping and ranking of 30 countries of Sub-Saharan Africa, two distance-based methods compared. Paris: United Nations educational, scientific and cultural organization.

    Google Scholar 

  • Jeremic, V., & Radojicic, Z. (2010). A new approach in the evaluation of team chess championships rankings. Journal of Quantitative Analysis in Sports, 6(3). doi:10.2202/1559-0410.1257.

  • Liu, N. C., & Cheng, Y. (2005). Academic ranking of world universities: Methodologies and problems. Higher Education in Europe, 30(2), 127–136.

    Article  Google Scholar 

  • Liu, N. C., Cheng, Y., & Liu, L. (2005). Academic ranking of world universities using scientometrics: A comment to the “fatal attraction”. Scientometrics, 64(1), 101–109.

    Article  Google Scholar 

  • Lukman, R., Krajnc, D., & Glavic, P. (2010). University ranking using research, educational and environmental indicators. Journal of Cleaner Production, 18(7), 619–628.

    Article  Google Scholar 

  • Mihailovic, N., Bulajic, M., & Savic, G. (2009). Ranking of banks in Serbia. Yugoslav Journal of Operations Research, 19(2), 323–334. doi:10.2298/YUJOR0902323M.

    Google Scholar 

  • Stolz, I., Hendel, D., & Horn, A. (2010). Ranking of rankings: Benchmarking twenty-five higher education ranking systems in Europe. Higher Education, 60(5), 507–528.

    Article  Google Scholar 

  • van Raan, A. F. J. (2005a). Fatal attraction: Ranking of universities by bibliometric methods. Scientometrics, 62, 133–145.

    Article  Google Scholar 

  • van Raan, A. F. J. (2005b). Reply to the comments of Liu et al. Scientometrics, 64(1), 111–112.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Veljko Jeremic.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jeremic, V., Bulajic, M., Martic, M. et al. A fresh approach to evaluating the academic ranking of world universities. Scientometrics 87, 587–596 (2011). https://doi.org/10.1007/s11192-011-0361-6

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-011-0361-6

Keywords

Navigation