Abstract
National scientific qualification (NSQ) is a procedure to regulate access to Italian academic positions. An increased use of self-citations could favor the achievement of the minimum bibliometric requirements. The aim of this study was to retrospectively analyze the self-citing behavior of successful candidates who applied for the NSQ in the Allied Health Professions (AHP) scientific field. Bibliometric indexes of all candidates qualified in the three first sessions (2012, 2013, and 2016) were retrieved from the Scopus database. We developed a new index (ΔSCR) to detect changes in the candidate's habits based on the difference between the Self Citation Rate (SCR) in the year preceding NSQ and that of the previous 10 years. The Kruskal–Wallis test was used to analyze the ΔSCR between sessions. Multivariate regressions were run to investigate the relationship between ΔSCR and six independent factors. Differences in ΔSCR were found between 2012 and 2013 (p = 0.008), between 2013 and 2016 (p < 0.0001), but not between 2012 and 2016 (p = 1.000). Regressions showed highest R2 in ΔSCR ≥ 10 subsets (2012: R2 = 0.373; 2013: R2 = 0.645; 2016: R2 = 0.511). The difference in citation habits (ΔC) was a significant ΔSCR predictor in 2012 and 2013, while publication habits (ΔP) and the difference in the H-index with vs. without self-citations (ΔH) were significant variables in 2012 and 2016, respectively. In the AHP sector, there was an increase in the use of self-citations in the 2013 session. Higher ΔSCR was associated with ΔC, ΔH and ΔP.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abilitazione Scientifica Nazionale. (2020). Retrieved January 24, 2021, from http://abilitazione.miur.it/public/index.php
Baccini, A., De Nicolao, G., & Petrovich, E. (2019). Citation gaming induced by bibliometric evaluation: A country-level comparative analysis. PLoS ONE, 14(9), e0221212. https://doi.org/10.1371/journal.pone.0221212
Buttner, F., Ardern, C. L., Blazey, P., Dastouri, S., McKay, H. A., Moher, D., & Khan, K. M. (2021). Counting publications and citations is not just irrelevant: It is an incentive that subverts the impact of clinical research. British Journal of Sports Medicine, 55(12), 647–648. https://doi.org/10.1136/bjsports-2020-103146
COPE: Committee on Publication Ethics. (2021). Retrieved January 24, 2021, from https://publicationethics.org/files/COPE_DD_A4_Citation_Manipulation_Jul19_SCREEN_AW2.pdf
Copiello, S. (2019). On the skewness of journal self-citations and publisher self-citations: Cues for discussion from a case study. Learned Publishing, 32(3), 249–258.
Ernat, J. J., Yheulon, C. G., Lopez, A. J., & Warth, L. C. (2020). Does the h-index and self-citation affect external funding of orthopedic surgery research? An analysis of fellowship directors and their subspecialties. Journal of Orthopaedics, 20, 92–96. https://doi.org/10.1016/j.jor.2020.01.019
Flatt, J. W., Blasimme, A., & Vayena, E. (2017). Improving the measurement of scientific success by reporting a self-citation index. Publications, 5(3), 20.
Fowler, J., & Aksnes, D. (2007). Does self-citation pay? Scientometrics, 72(3), 427–437.
Franchignoni, F., Ozcakar, L., & Negrini, S. (2018). Basic bibliometrics for dummies and others: An overview of some journal-level indicators in physical and rehabilitation medicine. European Journal of Physical and Rehabilitation Medicine, 54(5), 792–796. https://doi.org/10.23736/S1973-9087.18.05462-X
Gatti, R., Paci, M., Vercelli, S., & Baccini, M. (2014). Has the Italian academia missed an opportunity? Physical Therapy, 94(9), 1358–1360. https://doi.org/10.2522/ptj.2014.94.9.1358
Gatti, R., Paci, M., Vercelli, S., & Baccini, M. (2015). Teaching how to improve activities and participation of elderly subjects: The carelessness of the Italian Academia shown by the national qualification for physiotherapists. Aging Clinical and Experimental Research, 27(2), 243–244. https://doi.org/10.1007/s40520-014-0309-9
Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences of the USA, 102(46), 16569–16572. https://doi.org/10.1073/pnas.0507655102
Hyland, K., & Jiang, F. K. (2018). Changing patterns of self-citation: Cumulative inquiry or self-promotion? Text and Talk, 38(3), 365–387.
Ioannidis, J. P. (2015). A generalized view of self-citation: Direct, co-author, collaborative, and coercive induced self-citation. Journal of Psychosomatic Research, 78(1), 7–11. https://doi.org/10.1016/j.jpsychores.2014.11.008
Italian Law 240/2010, S. I., Art. 16, paragraph 1. (2010). Retrieved January 24, 2021, from https://www.camera.it/parlam/leggi/10240l.htm
Merton, R. K. (1942). Science and technology in a democratic order. Journal of Legal and Political Sociology, 1(1), 115–126.
Miccoli, P., & Rumiati, R. I. (2019). Italy’s evaluators: Rankings boom is real. Nature, 574(7779), 486. https://doi.org/10.1038/d41586-019-03206-y
Peebles, E., Scandlyn, M., & Hesp, B. R. (2020). A retrospective study investigating requests for self-citation during open peer review in a general medicine journal. PLoS ONE, 15(8), e0237804. https://doi.org/10.1371/journal.pone.0237804
Pfirrman, S. J., Yheulon, C. G., & Parziale, J. R. (2022). The Hirsch Index and self-citation in academic physiatry among graduate medical education program directors. American Journal of Physical Medicine and Rehabilitation, 101(3), 294–297. https://doi.org/10.1097/PHM.0000000000001902
Sanfilippo, F., Astuto, M., Tigano, S. L., Rosa, V., Morgana, A., Zanghì, A., & Cappellani, A. (2021a). Author self-citation policies, the influence on journals’ impact factors, and self-citation rate in general surgery. European Surgery, 53, 329–334. https://doi.org/10.1007/s10353-021-00732-w
Sanfilippo, F., Tigano, S., Morgana, A., Murabito, P., & Astuto, M. (2021b). Self-citation policies and journal self-citation rate among critical care medicine journals. Journal of Intensive Care, 9(1), 15. https://doi.org/10.1186/s40560-021-00530-2
Sanfilippo, F., Tigano, S., Morgana, A., Murabitol, P., & Astuto, M. (2021c). Self-citation policies in anaesthesiology journals. British Journal of Anaesthesia, 126(1), e21–e25. https://doi.org/10.1016/j.bja.2020.10.002
Saracco, A. (2020). Dr. Strangelove or: How I learned to stop worrying and love the citations. http://arxiv.org/abs/2002.09371.
Scarpa, F., Bianco, V., & Tagliafico, L. A. (2018). The impact of the national assessment exercises on self-citation rate and publication venue: An empirical investigation on the engineering academic sector in Italy. Scientometrics, 117(2), 997–1022.
Scopus. (2021). Retrieved January 24, 2021, from https://www.scopus.com
Seeber, M., Cattaneo, M., Meoli, M., & Malighetti, P. (2019). Self-citations as strategic response to the use of metrics for career decisions. Research Policy, 48(2), 478–491.
Szomszor, M., Pendlebury, D. A., & Adams, J. (2020). How much is too much? The difference between research influence and self-citation excess. Scientometrics, 123(2), 1119–1147.
Van Noorden, R., & Singh Chawla, D. (2019). Hundreds of extreme self-citing scientists revealed in new database. Nature, 572(7771), 578–579. https://doi.org/10.1038/d41586-019-02479-7
Wouters, P., Thelwall, M., Kousha, K., Waltman, L., de Rijcke, S., Rushforth, A., & Wouters, P. (2015). The metric tide. Literature review. Supplementary report I to the Independent review of the role of metrics in research assessment and management, HEFCE. Sage.
Author information
Authors and Affiliations
Contributions
Study conception: SV, LP, DP. Data collection: AC, SV. Statistical analyses: DP, LP. Interpretation of data: SV, LP, DP. Drafted manuscript: SV, LP, DP, AC, FC, CMC. Approved final manuscript: SV, LP, AC, CMC, FC, DP.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Vercelli, S., Pellicciari, L., Croci, A. et al. Self-citation behavior within the health allied professions’ scientific sector in Italy: a bibliometric analysis. Scientometrics 128, 1205–1217 (2023). https://doi.org/10.1007/s11192-022-04599-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-022-04599-w