Skip to main content
Log in

Irreproducibility of the results of the Shanghai academic ranking of world universities

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

I discuss the difficulties that I encountered in reproducing the results of the Shanghai ranking of world universities. In the Shanghai ranking, the dependence between the score for the SCI indicator and the weighted number of considered articles obeys a power law, instead of the proportional dependence that is suggested by the official methodology of the ranking. Discrepancies from proportionality are also found in some of the scores for the N&S and Size indicators. This shows that the results of the Shanghai ranking cannot be reproduced, given raw data and the public methodology of the ranking.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. http://ed.sjtu.edu.cn/rank/2005/ARWU2005Main.htm

  2. R. Florian, Universităţile din România şi clasamentul Shanghai [Romanian universities and the Shanghai ranking; in Romanian]. Ad Astra 5, 2006, http://www.ad-astra.ro/journal/8/florian_shanghai_romania.pdf

  3. http://ed.sjtu.edu.cn/rank/2005/ARWU2005Methodology.htm; another document presenting a slightly different methodology is also linked from the ranking homepage and is available at http://ed.sjtu.edu.cn/rank/file/ARWU-M&P.pdf, but this latter one presents the methodology of the 2004 ranking, not of concern to us.

  4. http://ed.sjtu.edu.cn/rank/2005/ARWU2005.xls

  5. http://rai.ijs.si/mezi/iassatena/shanghai-relative.html

  6. http://scientific.thomson.com/mjl

  7. http://www.ucop.edu/ucophome/uwnews/stat

  8. Van Raan, A. F. J., Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62(1) (2005) 133–143.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Răzvan V. Florian.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Florian, R.V. Irreproducibility of the results of the Shanghai academic ranking of world universities. Scientometrics 72, 25–32 (2007). https://doi.org/10.1007/s11192-007-1712-1

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-007-1712-1

Keywords

Navigation