Abstract
The article deals with the statistical problem of the difference between the mean citation frequencies of two sets of papers required to be significantly different. An analysis of citation data indicated that, as a first-order approximation, (1) The relative spread due to a short observation interval is independent of the long-term citation frequency and (2) the relative spread in long-term citation frequencies of different papers from the same author is independent of the mean citation score for the papers by that author. As a rule-of-thumb, these two sources of variance can be characterized by standard deviations of a ratio (factor) of 2 and 3, respectively. By applying these results to citation data published in the literature, it is shown that sometimes statistically unjustified conclusions have been drawn in the past.
Similar content being viewed by others
References
J. IRVINE, B. R. MARTIN, J. ABRAHAM, T. PEACOCK, Assessing basis research: Reappraisal and update of an evaluation of four radio astronomy observatories,Research Policy, 16 (1987) 213.
H. F. MOED, W. J. M. BURGER, J. G. FRANKFORT, A. F. J. Van RAAN, The use of bibliometric data for the measurement of university research performance,Research Policy, 14 (1985) 131.
N. L. GELLER, J. S. De CANI, R. E. DAVIES, Lifetime-citation rates to compare scientists' work,Social Science Research, 7 (1978) 345.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Plomp, R. Statistical reliability of citation frequency as an indicator of scientific impact. Scientometrics 17, 71–81 (1989). https://doi.org/10.1007/BF02017724
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF02017724