Skip to main content
SpringerLink
Log in

The effect of highly cited papers on national citation indicators

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Citation distributions are extremely skewed. This paper addresses the following question: To what extent are national citation indicators influenced by a small minority of highly cited articles? This question has not been studied before at the level of national indicators. Using the scientific production of Norway as a case, we find that the average citation rates in major subfields are highly determined by one or only a few highly cited papers. Furthermore, there are large annual variations in the influence of highly cited papers on the average citation rate of the subfields. We conclude that an analysis of the underlying data for national indicators may be useful in creating awareness towards the occurrence of particular articles with great influence on what is normally considered an indicator of “national performance”, and that the common interpretation of the indicator on research policy level needs to be informed by this fact.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. D. J. De Solla Price, Networks of scientific papers, Science, 149 (1965) 510-515.

    Google Scholar 

  2. P. O. Seglen, The skewness of science, Journal of the American Society for Information Science, 43 (1992) 628-638.

    Article  Google Scholar 

  3. W. GlÄnzel, Science in Scandinavia: A bibliometric approach, Scientometrics, 48 (2000) 121-150.

    Article  Google Scholar 

  4. H. F. Moed, T. N. Van Leeuwen, J. Reedijk, Towards appropriate indicators of journal impact, Scientometrics, 46 (1999) 575-589.

    Article  Google Scholar 

  5. E. Garfield, The use of journal impact factors and citation analysis for evaluation of science, Paper presented at the 41st Annual Meeting of the Council of Biology Editors, Salt Lake City (1998), available at: http://www.garfield.library.upenn.edu/papers/eval_of_science_CBE(Utah).html

  6. National Science Board, Science and Engineering Indicators — 2002. National Science Foundation, Arlington 2002.

    Google Scholar 

  7. D. W. Aksnes, Characteristics of highly cited papers, Research Evaluation, 12(3) (2003).

  8. European Commission, Third European Report on Science & Technology Indicators 2003, Brussels 2003.

  9. P. O. Seglen, Causal relationship between article citedness and journal impact, Journal of the American Society for Information Science, 45 (1994) 1-11.

    Article  Google Scholar 

  10. B. R. Martin, J. Irvine, Assessing basic research: Some partial indicators of scientific progress in radio astronomy, Research Policy, 12 (1983) 61-90.

    Article  Google Scholar 

  11. R. Plomp, The highly cited papers of professors as an indicator of a research group's scientific performance, Scientometrics, 29 (1994) 377-393.

    Article  Google Scholar 

  12. B. R. Martin, The use of multiple indicators in the assessment of basic research, Scientometrics, 36 (1996) 343-362.

    Article  Google Scholar 

  13. R. J. W. Tijssen, M. S. Visser, T. N. Van Leeuwen, Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? Scientometrics, 54 (2002) 381-397.

    Article  Google Scholar 

  14. European Commission, Key Figures 2001. Special Edition. Indicators for Benchmarking of National Research Policies. Brussels 2001.

Download references

Author information

Authors and Affiliations

  1. Norwegian Institute for Studies in Research and Higher Education (NIFU), Hegdehaugsvn. 31, NO-0352, Oslo, Norway

    Dag W. Aksnes & Gunnar Sivertsen

Authors
  1. Dag W. Aksnes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gunnar Sivertsen
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Aksnes, D.W., Sivertsen, G. The effect of highly cited papers on national citation indicators. Scientometrics 59, 213–224 (2004). https://doi.org/10.1023/B:SCIE.0000018529.58334.eb

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:SCIE.0000018529.58334.eb

Keywords

Search

Navigation