Skip to main content
Log in

The relationship between reviewers’ quality-scores and number of citations for papers published in the journal Physics in Medicine and Biology from 2003–2005

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

For each of the years 2003, 2004, and 2005 the number of citations for individual papers published in Physics in Medicine and Biology was compared to the mean quality-score assigned to the manuscript by two independent experts as part of the normal peer review process. A low but statistically significant correlation was found between citations and quality score (1 best to 5 worst) for every year: 2003: −0.227 (p < 0.001); 2004: −0.238 (p < 0.001); 2005: −0.154 (p < 0.01). Papers in the highest quality category (approximately 10 per cent of those published) were cited about twice as often as the average for all papers. Data were also examined retrospectively by dividing the papers published in each year into five citation quintiles. A paper of the highest quality is about ten times more likely to be found in the most cited quintile than in the least cited quintile. By making the assumption that the mean number of citations per paper is a reasonable surrogate for the impact factor, it was also shown that the impact factor for Physics in Medicine and Biology could be increased substantially by rejecting more papers based on the reviewers’ scores. To accomplish this, however, would require a reduction in the acceptance rate of manuscripts from about 50 per cent to near 10 per cent.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. P. Nieminen, J. Carpenter, G. Rucker, M. Schumacher, The relationship between quality of research and citation frequency, BMC Med. Res. Methodol., 6 (2006) 42.

    Article  Google Scholar 

  2. R. West, A. McIlwaine, What do citation counts count for in the field of addiction? An empirical evaluation of citation counts and their link with peer ratings of quality, Addiction, 97 (2002) 501–504.

    Article  Google Scholar 

  3. D. D. Bergh, J. Perry, R. Hanke, Some predictors of SMJ article impact, Strategic Management Journal, 27 (2006) 81–100.

    Article  Google Scholar 

  4. D. W. Aksnes, Characteristics of highly cited papers, Research Evaluation, 12 (2003) 159–170.

    Article  Google Scholar 

  5. R. N. Kostoff, The difference between highly and poorly cited medical articles in the journal Lancet, Scientometrics, 72 (2007) 513–520.

    Article  Google Scholar 

  6. J. Hudson, Be known by the company you keep: Citations - quality or chance?, Scientometrics, 71 (2007) 231–238.

    Article  Google Scholar 

  7. P. Nieminen, G. Rucker, J. Miettunen, J. Carpenter, M. Schumacher, Statistically significant papers in psychiatry were cited more often than others, Journal of Clinical Epidemiology, 60 (2007) 939–946.

    Article  Google Scholar 

  8. M. Callaham, R. L. Wears, E. Weber, Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals, JAMA-Journal of the American Medical Association, 287 (2002) 2847–2850

    Article  Google Scholar 

  9. G. Pasterkamp, J. I. Rotmans, D. V. P. De Kleijn, C. Borst, Citation frequency: A biased measure of research impact significantly influenced by the geographical origin of research articles, Scientometrics, 70 (2007) 153–165.

    Article  Google Scholar 

  10. M. Bhandari, J. Busse, P. J. Devereaux, V. M. Montori, M. Swiontkowski, P. Tornetta, T. A. Einhorn, V. Khera, E. H. Schemitsch, Factors associated with citation rates in the orthopedic literature, Canadian Journal of Surgery, 50 (2007) 119–123.

    Google Scholar 

  11. E. Garfield, Journal impact factor: a brief review, CMAJ,. 161, 979–980 (1999).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael S. Patterson.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Patterson, M.S., Harris, S. The relationship between reviewers’ quality-scores and number of citations for papers published in the journal Physics in Medicine and Biology from 2003–2005. Scientometrics 80, 343–349 (2009). https://doi.org/10.1007/s11192-008-2064-1

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-008-2064-1

Keywords

Navigation