Abstract
An empirical distribution function of citations to journal articles (EDF for short) can become fundamental tool for analyzing the scientific journals. Endeavors at making bibliometric analysis independent of the intuition conveyed by average citation levels have led us to the study of qualitative properties of physics journals in the functional space of EDFs. We show that the structure of this space establishes the connections and relationships that determine the essential features of physics journals. The research provides an analysis of 240 physics journals indexed in Journal Citation Reports 2015. The relevance of EDFs clustering is discussed. Our findings reveal four-cluster space of physics journals. The space brings to light the essential distinctions between physics journals and shows different level of influence of scientific publishers belonging to different types (professional physics societies, transnational and local publishers). The study of EDFs grouped by publishers reveals two binary oppositions that structure relations between them: “global–local” publishers and “high cited–low cited” publishers.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bar-Ilan, J. (2008). Informetrics at the beginning of the 21st century—A review. Journal of Informetrics, 2(1), 1–52. doi:10.1016/j.joi.2007.11.001.
Barabási, A. L., Jeong, H., Néda, Z., Ravasz, E., Schubert, A., & Vicsek, T. (2002). Evolution of the social network of scientific collaborations. Physica A: Statistical Mechanics and Its Applications, 311(3), 590–614. doi:10.1016/S0378-4371(02)00736-7.
Barmak, J. A. (ed.) (2011). Basic topological properties of finite spaces. In Algebraic topology of finite topological spaces and applications. No. 2032, lecture notes in mathematics (pp 19–35). Berlin: Springer. doi:10.1007/978-3-642-22003-6_2.
Beer, D. (2016). Coda: Metric power and the production of uncertainty (How does metric power make us feel?). London: Palgrave Macmillan. doi:10.1057/978-1-137-55649-3_6.
Blanford, C. F. (2016). Impact factors, citation distributions and journal stratification. Journal of Materials Science, 51(23), 10319–10322. doi:10.1007/s10853-016-0285-x.
Borg, I., Groenen, P. J. F., & Mair, P. (2013). Applied multidimensional scaling. Berlin, Heidelberg: Springer. doi:10.1007/978-3-642-31848-1.
Börner, K., Boyack, K. W., Milojević, S., & Morris, S. (2012). An introduction to modeling science: Basic model types, key definitions, and a general framework for the comparison of process models. In A. Scharnhorst, K. Börner, & P. van den Besselaar (Eds.), Models of science dynamics: Encounters between complexity theory and information sciences (pp. 3–22). Berlin, Heidelberg: Springer. doi:10.1007/978-3-642-23068-4_1.
Bornmann, L., & Marx, W. (2016). The Journal Impact Factor and alternative metrics. EMBO Reports, 17(8), 1094–1097. doi:10.15252/embr.201642823.
Bornmann, L., & Pudovkin, A. I. (2017). The journal impact factor should not be discarded. Journal of Korean Medical Science, 32(2), 180–182. doi:10.3346/jkms.2017.32.2.180.
Borovkov, A. A. (1998). Mathematical statistics. Gordon & Breach Science Publishers, Amsterdam. http://www.ams.org/mathscinet-getitem?mr=1712750.
Bourbaki, N. (ed.) (1995). Topological Structures. In General topology: Elements of mathematics, chapters 1–4 (Vol. 18, 1st edn, pp. 17–168). Berlin: Springer. doi:10.1007/978-3-642-61701-0.
Bourdieu, P. (1985). The social space and the genesis of groups. Theory and Society, 14(6), 723–744. doi:10.1007/BF00174048.
Bouyssou, D., & Marchant, T. (2014). An axiomatic approach to bibliometric rankings and indices. Journal of Informetrics, 8(3), 449–477. doi:10.1016/j.joi.2014.03.001.
Chorus, C., & Waltman, L. (2016). A large-scale analysis of impact factor biased journal self-citations. PLOS ONE, 11(8), 1–11. doi:10.1371/journal.pone.0161021.
Chua, S., Qureshi, A., Krishnan, V., Pai, D., Kamal, L., Gunasegaran, S., et al. (2017). The impact factor of an open access journal does not contribute to an article’s citations. F1000Research, 6(208). doi:10.12688/f1000research.10892.1.
Cronin, B., & Sugimoto, C.R. (2014). Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact. MIT Press, Cambridge, MA. https://mitpress.mit.edu/books/beyond-bibliometrics.
Ferrer-Sapena, A., Sánchez-Pérez, E. A., Peset, F., González, L. M., & Aleixandre-Benavent, R. (2016). The impact factor as a measuring tool of the prestige of the journals in research assessment in mathematics. Research Evaluation, 25(3), 306–314. doi:10.1093/reseval/rvv041.
Finardi, U. (2013). Correlation between journal impact factor and citation performance: An experimental study. Journal of Informetrics, 7(2), 357–370. doi:10.1016/j.joi.2012.12.004.
Garfield, E. (2006). The history and meaning of the journal impact factor. JAMA, 295(1), 90–93. doi:10.1001/jama.295.1.90.
Gasparyan, A. Y., Nurmashev, B., Yessirkepov, M., Udovik, E. E., Baryshnikov, A. A., & Kitas, G. D. (2017). The journal impact factor: Moving toward an alternative and combined scientometric approach. Journal of Korean Medical Science, 32(2), 173–179. doi:10.3346/jkms.2017.32.2.173.
Glänzel, W., & Moed, H. F. (2002). Journal impact measures in bibliometric research. Scientometrics, 53(2), 171–193. doi:10.1023/A:1014848323806.
Glänzel, W., & Moed, H. F. (2013). Opinion paper: Thoughts and facts on bibliometric indicators. Scientometrics, 96(1), 381–394. doi:10.1007/s11192-012-0898-z.
Golosovsky, M., & Solomon, S. (2017). Growing complex network of citations of scientific papers: Modeling and measurements. Physical Review E, 95(012), 324. doi:10.1103/PhysRevE.95.012324.
Gómez-Núñez, A. J., Vargas-Quesada, B., & de Moya-Anegón, F. (2016). Updating the SCImago journal and country rank classification: A new approach using Ward’s clustering and alternative combination of citation measures. Journal of the Association for Information Science and Technology, 67(1), 178–190. doi:10.1002/asi.23370.
Greshake, B. (2017). Looking into Pandora’s box: The content of Sci–Hub and its usage. F1000Research, 6, 541. doi:10.12688/f1000research.11366.1.
Hjørland, B. (2016). Informetrics needs a foundation in the theory of science. In C. R. Sugimoto (Ed.), Theories of informetrics and scholarly communication (pp. 20–46). Berlin; Boston, MA: De Gruyter. doi:10.1515/9783110308464-005.
Huang, D. W. (2017). Impact factor distribution revisited. Physica A: Statistical Mechanics and Its Applications, 482, 173–180. doi:10.1016/j.physa.2017.04.038.
Jacod, J., & Shiryaev, A. N. (eds.) (2003). Skorokhod topology and convergence of processes. In Limit theorems for stochastic processes. No. 288, Grundlehren der mathematischen Wissenschaften (pp 324–388). Berlin: Springer. doi:10.1007/978-3-662-05265-5_6.
Kiesslich, T., Weineck, S. B., & Koelblinger, D. (2016). Reasons for Journal Impact Factor changes: Influence of changing source items. PLOS ONE, 11(4), e0154199. doi:10.1371/journal.pone.0154199.
Kinouchi, R. R. (2014). Scientometrics: The project for a science of science transformed into an industry of measurements. Scientiae Studia, 12, 147–159. doi:10.1590/S1678-31662014000400008.
Kosten, J. (2016). A classification of the use of research indicators. Scientometrics, 108(1), 457–464. doi:10.1007/s11192-016-1904-7.
Larivière, V., Haustein, S., & Mongeon, P. (2015). The oligopoly of academic publishers in the digital era. PLoS ONE, 10(6), e0127502. doi:10.1371/journal.pone.0127502.
Larivière, V., Kiermer, V., MacCallum, C. J., McNutt, M., Patterson, M., Pulverer, B., et al. (2016). A simple proposal for the publication of journal citation distributions. bioRxiv. doi:10.1101/062109.
Leeuwen, T. N., & Wouters, P. (2017). Analysis of publications on Journal Impact Factor over time. Frontiers in Research Metrics and Analytics, 2, 4. doi:10.3389/frma.2017.00004.
Leydesdorff, L., Wouters, P., & Bornmann, L. (2016). Professional and citizen bibliometrics: Complementarities and ambivalences in the development and use of indicators—A state-of-the-art report. Scientometrics, 109(3), 2129–2150. doi:10.1007/s11192-016-2150-8.
Leydesdorff, L., Bornmann, L., & Wagner, C. S. (2017). Generating clustered journal maps: An automated system for hierarchical classification. Scientometrics, 110(3), 1601–1614. doi:10.1007/s11192-016-2226-5.
Liu, X. L., Gai, S. S., & Zhou, J. (2016). Journal impact factor: Do the numerator and denominator need correction? PLOS ONE, 11(3), e0151414. doi:10.1371/journal.pone.0151414.
May, P. (2008). Finite topological spaces. Notes for REU Available at http://www.math.uchicago.edu/~may/MISC/FiniteSpaces.pdf.
Milojević, S., Radicchi, F., & Bar-Ilan, J. (2017). Citation success index—An intuitive pair-wise journal comparison metric. Journal of Informetrics, 11(1), 223–231. doi:10.1016/j.joi.2016.12.006.
Mingers, J., & Leydesdorff, L. (2015). A review of theory and practice in scientometrics. European Journal of Operational Research, 246(1), 1–19. doi:10.1016/j.ejor.2015.04.002.
Mingers, J., & Yang, L. (2017). Evaluating journal quality: A review of journal citation indicators and ranking in business and management. European Journal of Operational Research, 257(1), 323–337. doi:10.1016/j.ejor.2016.07.058.
Moed, H. F. (2005). Citation analysis in research evaluation, information science and knowledge management (Vol. 9). Berlin, New York: Springer. doi:10.1007/1-4020-3714-7.
Mossel, E., Sly, A., & Tamuz, O. (2015). Strategic learning and the topology of social networks. Econometrica, 83(5), 1755–1794. doi:10.3982/ECTA12058.
Murtagh, F., & Legendre, P. (2014). Ward’s hierarchical agglomerative clustering method: Which algorithms implement Ward’s criterion? Journal of Classification, 31(3), 274–295. doi:10.1007/s00357-014-9161-z.
Palla, G., Tibély, G., Mones, E., Pollner, P., & Vicsek, T. (2015). Hierarchical networks of scientific journals. Palgrave Communications, 1(15), 016. doi:10.1057/palcomms.2015.16.
Paulus, F. M., Rademacher, L., Schäfer, T. A. J., Müller-Pinzler, L., & Krach, S. (2015). Journal Impact Factor shapes scientists’ reward signal in the prospect of publication. PLOS ONE, 10(11), 1–15. doi:10.1371/journal.pone.0142537.
Phelps, R. R. (1993). Convex functions, monotone operators and differentiability (2nd ed., Vol. 1364)., Lecture notes in mathematics Berlin, Heidelberg: Springer. doi:10.1007/978-3-540-46077-0.
Rachev, S. T., Klebanov, L. B., Stoyanov, S. V., & Fabozzi, F. J. (2013). The methods of distances in the theory of probability and statistics. New York: Springer. doi:10.1007/978-1-4614-4869-3.
Radicchi, F., & Castellano, C. (2015). Understanding the scientific enterprise: Citation analysis, data and modeling. In B. Gonçalves & N. Perra (Eds.), Social phenomena: From data analysis to models, computational social sciences (pp. 135–151). Cham: Springer. doi:10.1007/978-3-319-14011-7_8.
Rijcke, Sd, Wouters, P. F., Rushforth, A. D., Franssen, T. P., & Hammarfelt, B. (2016). Evaluation practices and effects of indicator use—A literature review. Research Evaluation, 25(2), 161. doi:10.1093/reseval/rvv038.
Seiler, C., & Wohlrabe, K. (2014). How robust are journal rankings based on the impact factor? Evidence from the economic sciences. Journal of Informetrics, 8(4), 904–911. doi:10.1016/j.joi.2014.09.001.
Shanahan, D. R. (2016). Auto-correlation of journal impact factor for consensus research reporting statements: A cohort study. PeerJ, 4, e1887. doi:10.7717/peerj.1887.
Stern, D. I. (2013). Uncertainty measures for economics journal impact factors. Journal of Economic Literature, 51(1), 173–189. doi:10.1257/jel.51.1.173.
Tahamtan, I., Safipour Afshar, A., & Ahamdzadeh, K. (2016). Factors affecting number of citations: A comprehensive review of the literature. Scientometrics, 107(3), 1195–1225. doi:10.1007/s11192-016-1889-2.
Thomson Reuters. (2010). The Thomson Reuters impact factor. http://wokinfo.com/essays/impact-factor/.
Todeschini, R., & Baccini, A. (2016). Handbook of bibliometric indicators: Quantitative tools for studying and evaluating research. Weinheim: Wiley. doi:10.1002/9783527681969.
van Eck, N. J., & Waltman, L. (2017). Citation-based clustering of publications using CitNetExplorer and VOSviewer. Scientometrics, 111(2), 1053–1070. doi:10.1007/s11192-017-2300-7.
Varin, C., Cattelan, M., & Firth, D. (2016). Statistical modelling of citation exchange between statistics journals. Journal of the Royal Statistical Society: Series A, 179(1), 1–63. doi:10.1111/rssa.12124.
Vitanov, N. K. (2016). Science dynamics and research production: Indicators, indexes, statistical laws and mathematical models. Qualitative and quantitative analysis of scientific and scholarly communication. Cham: Springer. doi:10.1007/978-3-319-41631-1.
Waltman, L. (2016). A review of the literature on citation impact indicators. Journal of Informetrics, 10(2), 365–391. doi:10.1016/j.joi.2016.02.007.
Waltman, L., & Traag, V. A. (2017). Use of the journal impact factor for assessing individual articles need not be wrong. arXiv:1703.02334.
Waumans, M. C., Nicodème, T., & Bersini, H. (2015). Topology analysis of social networks extracted from literature. PLOS ONE, 10(6), 1–30. doi:10.1371/journal.pone.0126470.
Wouters, P. (2017). Bridging the evaluation gap. Engaging Science, Technology, and Society, 3, 108–118. doi:10.17351/ests2017.115.
Ye, M., Liu, J., Anderson, B., Yu, C., & Başar, T. (2017). Evolution of social power in social networks with dynamic topology. arXiv:1705.09756.
Zhang, Z., & Poucke, S. V. (2017). Citations for randomized controlled trials in sepsis literature: The halo effect caused by Journal Impact Factor. PLOS ONE, 12(1), 1–13. doi:10.1371/journal.pone.0169398.
Zhu, Y., Yan, E., & Song, I. Y. (2015). Topological analysis of interdisciplinary scientific journals: Which journals will be the next Nature or Science? In Proceedings of the 2015 conference on research in adaptive and convergent systems, ACM, New York, NY, RACS (pp. 56–61). doi:10.1145/2811411.2811475.
Acknowledgements
The article was prepared within the framework of the Basic Research Program at the National Research University Higher School of Economics (HSE) and supported within the framework of a subsidy by the Russian Academic Excellence Project “5-100”.
Author information
Authors and Affiliations
Corresponding author
Appendix 1: Physics journals in the sample
Rights and permissions
About this article
Cite this article
Katchanov, Y.L., Markova, Y.V. The “space of physics journals”: topological structure and the Journal Impact Factor. Scientometrics 113, 313–333 (2017). https://doi.org/10.1007/s11192-017-2471-2
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-017-2471-2