Skip to main content
Log in

High-end performance or outlier? Evaluating the tail of scientometric distributions

Scientometrics Aims and scope Submit manuscript

Abstract

The present paper attempts to shed light on outstanding research performance using the example of citation distributions. In order to answer the question of how the analysis of outstanding performance, in general, and highly cited papers, in particular, could be integrated into standard techniques of evaluative scientometrics. Two general methods are proposed: One solution aims at quantifying the performance represented by the tail of citation distributions independently of the “mainstream”, the second one, a parameter-free solution, provides performance classes for any level. Advantages and shortcoming of both methods are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

References

  • Beirlant, J., Dierckx, G., Goegebeur, Y., & Matthys, G. (1999). Tail index estimation and an exponential regression model. Extremes, 2(2), 177–200.

    Article  MathSciNet  MATH  Google Scholar 

  • Beirlant, J., Goegebeur, Y., Segers, J., & Teugels, J. L. (2004). Statistics of extremes: Theory and application. Chichester: Wiley.

    Book  Google Scholar 

  • Beirlant, J., Glänzel, W., Carbonez, A., & Leemans, H. (2007). Scoring research output using statistical quantile plotting. Journal of Informetrics, 1(3), 185–192.

    Article  Google Scholar 

  • Einmahl, J. H. J., Fils-Villetard, A., & Guillou, A. (2008). Statistics of extremes under random censoring. Bernoulli, 14(1), 207–227.

    Article  MathSciNet  MATH  Google Scholar 

  • Fisher, R. A., & Tippett, L. H. C. (1928). Limiting forms of the frequency distribution of the largest or smallest member of a sample. Proceedings of the Cambridge Philosophical Society, 24, 180–190.

    Article  MATH  Google Scholar 

  • Glänzel, W., Telcs, A., & Schubert, A. (1984). Characterization by truncated moments and its application to Pearson-type distributions. Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gebiete, 66, 173–183. (Correction: Probability Theory and Related Fields, 1987, 74, 317).

  • Glänzel, W., & Schubert, A. (1988a). Theoretical and empirical studies of the tail of scientometric distributions. In L. Egghe & R. Rousseau (Eds.), Informetrics 87/88 (pp. 75–83). Amsterdam: Elsevier Science Publisher B.V.

  • Glänzel, W., & Schubert, A. (1988b). Characteristic scores and scales in assessing citation impact. Journal of Information Science, 14(2), 123–127.

    Article  Google Scholar 

  • Glänzel, W. (2007). Characteristic scores and scales. A bibliometric analysis of subject characteristics based on long-term citation observation. Journal of Informetrics, 1(1), 92–102.

    Article  Google Scholar 

  • Glänzel, W. (2009). The multi-dimensionality of journal impact. Scientometrics, 78(2), 355–374.

    Article  Google Scholar 

  • Glänzel, W., & Moed, H. F. (2013). Thoughts and facts on bibliometric indicators. Scientometrics. doi:10.1007/s11192-012-0898-z.

  • Gumbel, E. J. (1958). Statistics of extremes. New York: Columbia University Press.

    MATH  Google Scholar 

  • Hill, B. M. (1975). A simple general approach to inference about the tail of a distribution. Annals of Statistics, 3, 1163–1174.

    Article  MathSciNet  MATH  Google Scholar 

  • Leydesdorff, L., Bornmann, L., Mutz, R., & Opthof, T. (2011). Turning the tables on citation analysis one more time: Principles for comparing sets of documents. Journal of the American Society for Information Science and Technology, 62(7), 1370–1381.

    Article  Google Scholar 

  • Matthys, G., Delafosse, E., Guillou, A., & Beirlant, J. (2004). Estimating catastrophic quantile levels for heavy-tailed distributions. Insurance Mathematics & Economics, 34(3), 517–537.

    Article  MathSciNet  MATH  Google Scholar 

  • Waltman, L., Calero-Medina, C., Kosten, J., Noyons, E. C. M., Tijssen, R. J. W., van Eck, N. J., van Leeuwen, Th. N., van Raan, A. F. J., Visser, M. S., & Wouters, P. (2012). The Leiden Ranking 2011/2012: Data collection, indicators, and interpretation. In E. Archambault, Y. Gingras & V. Lariviere (Eds.), Proceedings of STI 2012 Montreal (17th International Conference on Science and Technology Indicators), Volume II (pp. 791–802).

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wolfgang Glänzel.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Glänzel, W. High-end performance or outlier? Evaluating the tail of scientometric distributions. Scientometrics 97, 13–23 (2013). https://doi.org/10.1007/s11192-013-1022-8

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-013-1022-8

Keywords

Navigation