Skip to main content
SpringerLink
Log in

The state of the art in publication counting

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

The proceedings of the ISSI conferences in Stockholm, 2005, and Madrid, 2007, contain 85 contributions based on publication counting. The methods used in these contributions have been analyzed. The counting methods used are stated explicitly in 26 contributions and can be derived implicitly from the discussion of methods in 10 contributions. In only five contributions, there is a justification for the choice of method. Only one contribution gives information about different results obtained by using different methods. The non-additive results from whole counting give problems in the calculation of shares in seven contributions, but these problems are not mentioned. Only 11 contributions give a term (terms) for the counting method(s) used. To illustrate the problems, 11 of the contributions are discussed in detail. The conclusion is that 40 years of publication counting have not resulted in general agreement on definitions of methods and terminology nor in any kind of standardization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Aksnes, D.W., Sandström, U. (2006), National citation indicators, their methodological foundation and political interpretation. Abstracts of 9th International Conference on Science and Technology Indicators, Leuven, Belgium, pp. 3–5.

  • Anderson, J., Collins, P. M. D., Irvine, J., Isard, P. A., Martin, B. R., Narin, F., Stevens, K. (1988), On-line approaches to measuring national scientific output: a cautionary tale, Science and Public Policy, 15: 153–161.

    Google Scholar 

  • Barjak, F., Robinson, S. (2007), International collaboration, mobility and team diversity in the life sciences: Impact on research performance. In: D. Torres-Salinas, H. F. Moed, (Eds), Proceedings of ISSI 2007. 11th International Conference of the International Society for Scientometrics and Informetrics. Published for the International Society for Informetrics and Scientometrics (ISSI) by the Centre for Scientific Information and Documentation of the Spanish Research Council, Madrid, Spain, Vol. 1, pp. 63–73.

    Google Scholar 

  • Braun, T., Glänzel, W., Schubert, A. (1991), The bibliometric assessment of UK scientific performance: some comments on Martin’s ‘Reply’, Scientometrics, 20: 359–362.

    Article  Google Scholar 

  • Gauffriau, M., Larsen, P. O. (2005a), Counting methods are decisive for rankings based on publication and citation studies, Scientometrics, 64: 85–93.

    Article  Google Scholar 

  • Gauffriau, M., Larsen, P. O. (2005b), Different outcomes of different counting methods for publications and citations. In: P. Ingwersen, B. Larsen, (Eds), (2005), Proceedings of ISSI 2005. 10th International Conference of the International Society for Scientometrics and Informetrics. Published for the International Society for Informetrics and Scientometrics (ISSI) by Karolinska University Press, Stockholm, Sweden, Vol. 1, pp. 242–246.

    Google Scholar 

  • Gauffriau, M., Larsen, P. O., Maye, I, Roulin-Perriard, A., von Ins, M. (2007), Publication, cooperation and productivity measures in scientific research, Scientometrics, 73: 175–214.

    Article  Google Scholar 

  • Gauffriau, M., Larsen, P. O., Maye, I, Roulin-Perriard, A., von Ins, M. (2008), Comparisons of results of publication counting using different methods, Scientometrics, 77: 147–176.

    Article  Google Scholar 

  • Glänzel, W., Janssens, F., Thijs, B. (2007), A comparative analysis of publication activity and citation impact based on the core literature in bioinformatics. In: D. Torres-Salinas, H. F. Moed, (Eds), Proceedings of ISSI 2007. 11th International Conference of the International Society for Scientometrics and Informetrics. Published for the International Society for Informetrics and Scientometrics (ISSI) by the Centre for Scientific Information and Documentation of the Spanish Research Council, Madrid, Spain, Vol. 1, pp. 321–334.

    Google Scholar 

  • Glänzel, W., Schlemmer, B., Schubert, A., Thijs, B. (2005), Proceedings literature as additional data source for bibliometric analysis. In: Ingwersen, P., Larsen, B., (Eds), (2005), Proceedings of ISSI 2005. 10th International Conference of the International Society for Scientometrics and Informetrics. Karolinska University Press, Stockholm, Sweden, Vol. 1, pp. 159–166.

    Google Scholar 

  • Ingwersen, P., Larsen, B., (Eds), (2005), Proceedings of ISSI 2005. 10th International Conference of the International Society for Scientometrics and Informetrics. Karolinska University Press, Stockholm, Sweden, Vol. 1, page I–XIV, 1–436, 1–2, Vol. 2, page I–X, 437–799.

    Google Scholar 

  • Katz, J. S. (2000), Scale-independent indicators and research evaluation, Science and Public Policy, 27: 23–36.

    Article  Google Scholar 

  • King, D. A. (2004), The scientific impact of nations. What different countries get for their researchspending, Nature, 430: 311–316.

    Article  Google Scholar 

  • Lewison, G. (2005), Biomedical research and the regional burden of disease. In: Ingwersen, P., Larsen, B., (Eds), (2005), Proceedings of ISSI 2005. 10th International Conference of the International Society for Scientometrics and Informetrics. Karolinska University Press, Stockholm, Sweden, Vol. 2, pp. 585–594.

    Google Scholar 

  • Lewison, G. (2007a), The references on UK Cancer Clinical Guidelines. In: D. Torres-Salinas, H. F. Moed, (Eds), Proceedings of ISSI 2007. 11th International Conference of the International Society for Scientometrics and Informetrics. Published for the International Society for Informetrics and Scientometrics (ISSI) by the Centre for Scientific Information and Documentation of the Spanish Research Council, Madrid, Spain, Vol. 1, pp. 489–498.

    Google Scholar 

  • Lewison, G. (2007b), Counting Citations: Fractionation of addresses and “world-scale”, a new scalar. In: D. Torres-Salinas, H. F. Moed, (Eds), Proceedings of ISSI 2007. 11th International Conference of the International Society for Scientometrics and Informetrics. Published for the International Society for Informetrics and Scientometrics (ISSI) by the Centre for Scientific Information and Documentation of the Spanish Research Council, Madrid, Spain, Vol. 2, pp. 880–881.

    Google Scholar 

  • Leydesdorff, L., Wagner, C. (2007), Is the United States losing ground in science? A global perspective on the world science system in 2005. In: D. Torres-Salinas, H. F. Moed, (Eds), Proceedings of ISSI 2007. 11th International Conference of the International Society for Scientometrics and Informetrics. Published for the International Society for Informetrics and Scientometrics (ISSI) by the Centre for Scientific Information and Documentation of the Spanish Research Council, Madrid, Spain, Vol. 1, pp. 499–507.

    Google Scholar 

  • Martin, B. R. (1991), The bibliometric assessment of UK scientific performance. A reply to Braun, Glänzel and Schubert, Scientometrics, 20: 333–357.

    Article  Google Scholar 

  • Persson, O., Glänzel, W., Danell, R. (2004), Inflationary bibliometric values: The role of scientific collaboration and the need for relative indicators in evaluative studies, Scientometrics, 60: 421–432.

    Article  Google Scholar 

  • Sanz-Casado, E., Suárez-Balseiro, C., Iribarren-Maestro, I., Ramirez-De Santa Pau, M., De Pedero-Cuesta, J. (2005), Bibliometric study of scientific research on prion diseases encephalopathy and Creutzfeldt-Jakob Disease, 1973–2002. In: Ingwersen, P., Larsen, B., (Eds), (2005), Proceedings of ISSI 2005. 10th International Conference of the International Society for Scientometrics and Informetrics. Karolinska University Press, Stockholm, Sweden, Vol. 2, pp. 595–603.

    Google Scholar 

  • Schubert, A., Braun, T. (1990), International collaboration in the sciences, 1981–1985, Scientometrics, 19: 3–10.

    Article  Google Scholar 

  • Shelton, R. D., Foland, P., Gorelskyy, R. (2007), Do new SCI journals have a different national bias? In: D. Torres-Salinas, H. F. Moed, (Eds), Proceedings of ISSI 2007. 11th International Conference of the International Society for Scientometrics and Informetrics. Published for the International Society for Informetrics and Scientometrics (ISSI) by the Centre for Scientific Information and Documentation of the Spanish Research Council, Madrid, Spain, Vol. 2, pp. 708–717.

    Google Scholar 

  • Torres-Salinas, D., Moed, H. F., (Eds), Proceedings of ISSI 2007. 11th International Conference of the International Society for Scientometrics and Informetrics. Published for the International Society for Informetrics and Scientometrics (ISSI) by the Centre for Scientific Information and Documentation of the Spanish Research Council, Madrid, Spain, Vol. 1, page I–XVII, 19–530, Vol. 2, page I–VI, 541–975.

  • van Leeuwen, T. T., Tijssen, R. J. W. (2007), Strength and weakness of national science systems. A bibliometric analysis through cooperation patterns. In: D. Torres-Salinas, H. F. Moed, (Eds), Proceedings of ISSI 2007. 11th International Conference of the International Society for Scientometrics and Informetrics. Published for the International Society for Informetrics and Scientometrics (ISSI) by the Centre for Scientific Information and Documentation of the Spanish Research Council, Madrid, Spain, Vol. 1, pp. 469–479.

    Google Scholar 

  • Visser, M. S., Medina, C. M. C., Moed, H. F. (2007), Beyond rankings: the role of large research universities in the global scientific communication system. In: D. Torres-Salinas, H. F. Moed, (Eds), Proceedings of ISSI 2007. 11th International Conference of the International Society for Scientometrics and Informetrics. Published for the International Society for Informetrics and Scientometrics (ISSI) by the Centre for Scientific Information and Documentation of the Spanish Research Council, Madrid, Spain, Vol. 2, pp. 760–765.

    Google Scholar 

  • Zhou, P., Leydesdorff, L (2006), The emergence of China as a leading nation in science. Research Policy, 35:83–104.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Marievej 10A, 2, DK-2900, Hellerup, Denmark

    Peder Olesen Larsen

Authors
  1. Peder Olesen Larsen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Peder Olesen Larsen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Larsen, P.O. The state of the art in publication counting. Scientometrics 77, 235–251 (2008). https://doi.org/10.1007/s11192-007-1991-6

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-007-1991-6

Keywords

Search

Navigation