Abstract
In the first part of the paper the citations in 1986 and 1987 of 3938 papers published in 1985 by 324 research groups in the faculties of science and of medicine of eight universities in the Netherlands are analyzed. Because of the large statistical spread of (1) the number of short-term citations of papers cited equally frequently over a long period, and (2) the number of citations over a long period of papers by the same author, short-term citation scores appear to be an unreliable indicator of a research group's contribution to science. In the second part of the paper an alternative approach is presented, based on a subdivision of the 3938 papers in papers authored by professors with 0–2, 3–8, or ≥9 highly cited papers (HCPs, ≥25 citations) to their name. Very large citation score differences were found for the three categories. For example: for papers first-authored by a professor, the average number of citations per person in 1986 and 1987 for 1985 papers was for 161 professors with ≥9 HCPs a factor 14 larger than for 575 professors with only 0–2 HCPs; for papers co-authored by professors, this factor was 6.6. These findings justify the conclusion that the number of HCPs scored by the professors (and other senior scientists) during their entire career is a much more reliable predictor of the performance of a research group than the number of short-term citations of the articles published by the group within a short period. A research group's contribution to science is primarily determined by the individual scientifictalents of its members.
Similar content being viewed by others
References
R. Plomp, Statistical reliability of citation frequency as an indicator of scientific impact,Scientometrics, 17 (1989) 71–81.
R. Plomp, The significance of the number of highly cited papers as an indicator of scientific prolificacy,Scientometrics, 19 (1990) 185–197.
J. Witkowski, Fifty years on: Molecular biology's hall of fame,Life Science — Job Trends, 2 (1988) 7–13.
J. A. Anderson, E. Rosenfeld,Neurocomputing — Foundations of Research, MIT Press, Cambridge, Mass., 1988.
T. Braun, W. Glänzel, A. Schubert, The newest version of the facts and figures on publication output and relative citation impact in the life sciences and chemistry 1981–1985,Scientometrics, 14 (1988) 3–15.
H. F. Moed, W. J. M. Burger, J. G. Frankfort, A. F. J. van Raan, The use of bibliometric data for the measurement of university research performance,Research Policy, 14 (1985) 131–149.
J. Mehra, H. Rechenberg,The Historical Development of the Quantum Theory, Springer, New York, N. Y., Vols 1-, 1982-.
H. F. Judson,The Eighth Day of Creation — The Makers of the Revolution in Biology, Simon and Schuster, New York, N. Y., 1979.
H. F. Moed, W. J. M. Burger, J. G. Frankfort, A. F. J. Van Raan, A comparative study of bibliometric past performance analysis and peer judgement,Scientometrics, 8 (1985) 149–159.
J. A. Virgo, A statistical procedure for evaluating the importance of scientific papers,The Library Quarterly, 47 (1977) 415–430.
S. M. Lawani, A. E. Bayer, Validity of citation criteria for assessing the influence of scientific publications: New evidence with peer assessment,Journal of the American Society for Information Science, 34 (1983) 59–66.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Plomp, R. The highly cited papers of professors as an indicator of a research group's scientific performance. Scientometrics 29, 377–393 (1994). https://doi.org/10.1007/BF02033446
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF02033446