Abstract
Vanclay’s proposal (Vanclay (2012). Impact factor: outdated artefact or stepping-stone to journal certification? Scientometrics doi: 10.1007/s11192-011-0561-0) is discussed. We agree that a major overhaul is necessary: journal evaluation must be performed using instruments and not artefacts.
References
Althouse, B. M., West, J. D., Bergstrom, C. T., & Bergstrom, T. (2009). Differences in impact factor across fields and over time. Journal of the American Society for Information Science and Technology, 60(1), 27–34.
Bouyssou, D., & Marchant, T. (2010). Consistent bibliometric rankings of authors and of journals. Journal of Informetrics, 4(3), 365–378.
Bouyssou, D., & Marchant, T. (2011a). Bibliometric rankings of journals based on journal impact factors: an axiomatic approach. Journal of Informetrics, 5(1), 75–86.
Bouyssou, D., & Marchant, T. (2011b). Ranking scientists and departments in a consistent manner. Journal of the American Society for Information Science and Technology, 62(9), 1761–1769.
Brumback, R. A. (2009). Impact factor: let’s be unreasonable! Epidemiology, 20, 932–933.
Drijvers, P., & Gravemeijer, K. (2004). Computer algebra as an instrument: examples of algebraic schemes. In D. Guin, K. Ruthven, & L. Trouche (Eds.), The didactical challenge of symbolic calculators: turning a computational device into a mathematical instrument (pp. 171–206). Dordrecht: Kluwer.
Garfield, E. (1998). The Impact Factor and using it correctly. Der Unfallchirurg, 101(6), 413–414.
Garfield, E. (2006). The history and meaning of the journal impact factor. Journal of the American Medical Association, 295(1), 90–93.
Glänzel, W. (1996). The need for standards in bibliometric research and technology. Scientometrics, 35(2), 167–176.
Hyndman, R. J., & Fan, Y. (1996). Sample quantiles in statistical packages. The American Statistician, 50(4), 361–364.
Ingwersen, P., Larsen, B., Rousseau, R., & Russell, J. (2001). The publication-citation matrix and its derived quantities. Chinese Science Bulletin, 46(6), 524–528.
Ketcham, C. M. (2007). Predicting impact factor one year in advance. Laboratory Investigation, 87, 520–526.
Kurmis, A. P. (2003). Understanding the limitations of the journal impact factor. The Journal of Bone and Joint Surgery, 85, 2449–2454.
Leydesdorff, L. (2011). Scientific certainty. SIGMETRICS (December 2, 2011). Available at: http://listserv.utk.edu/archives/sigmetrics.html.
Leydesdorff, L., & Bornmann, L. (2011). Integrated impact indicators compared with impact factors: An alternative research design with policy implications. Journal of the American Society for Information Science and Technology, 62(11), 2133–2146.
Naik, G. (2011). Scientists’ elusive goal: reproducing study results. Wall Street Journal online. (Available from: http://online.wsj.com/article/SB10001424052970203764804577059841672541590.html, accessed on 2012-01-10).
Pendlebury, D.A. (2007). Thomson Scientific corrects inaccuracies in editorial. (Available from: http://community.thomsonreuters.com/t5/Citation-Impact-Center/bg-p/citation, accessed on 2012-01-10).
Rossner, M., Van Epps, H., & Hill, E. (2007). Show me the data. Journal of Cell Biology, 179(6), 1091–1092.
Rousseau, R. (1988). Citation distribution of pure mathematics journals. In L. Egghe & R. Rousseau (Eds.), Informetrics 87/88 (pp. 249–262). Amsterdam: Elsevier.
Rousseau, R. (2002). Journal evaluation: technical and practical issues. Library Trends, 50(3), 418–439.
Rousseau, R. (2005). Impact factors and databases as instruments for research evaluation. In J. P. Qiu (Ed.), University evaluation & research evaluation (pp. 255–262). Beijing: Hua Xia Publishing House.
Schubert, A., & Glänzel, W. (1983). Statistical reliability of comparisons based on the citation impact of scientific publications. Scientometrics, 5(1), 59–74.
Seglen, P. O. (1994). Causal relationship between article citedness and journal impact factor. Journal of the American Society for Information Science, 45(1), 1–11.
Vanclay, J.K. (2012). Impact factor: outdated artefact or stepping-stone to journal certification? Scientometrics. doi: 10.1007/s11192-011-0561-0.
Wu, X. F., Fu, Q., & Rousseau, R. (2008). On indexing in the web of science and predicting impact factor. Journal of Zhejiang University Science B, 9(7), 582–590.
Acknowledgments
The author thanks the National Library of Sciences CAS (Beijing) for its hospitality during his stay while this comment has been written. He thanks in particular Liying Yang for useful discussions on the topic of the impact factor.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Rousseau, R. Updating the journal impact factor or total overhaul?. Scientometrics 92, 413–417 (2012). https://doi.org/10.1007/s11192-012-0649-1
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-012-0649-1