Abstract
The number of citations is one of the main bibliometric indicators. However, not all citations can be considered equivalent; scite (https://scite.ai/), a new tool based on artificial intelligence, was developed to determine whether citations are positive, negative or neutral. We assessed whether publications first/last authored by women were more often cited positively (or negatively) than those first/last authored by men. Using the 2021 Journal Citation Reports (JCR) impact factor, we selected the ten highest impact journals in nine medical disciplines. Using Web of Science, we extracted all research and review articles published between January 2012 and December 2021 in these journals. We used Namsor to determine first/last authors’ gender and scite to categorize article citations as positive (“supporting”), negative (“contradicting”), neutral (“mentioning”) and “unclassified”. There were 141,921 articles in the database, of which 116,204 had unabbreviated first/last names. We found that the proportion of positive and negative citations was higher for publications whose first/last authors were women (vs. men), while the opposite was true for neutral citations. This is the first study to our knowledge to document the association between gender and citation type. Further research is needed in the future to investigate the reasons for these gender differences, and to assess whether the type of citation is also associated with the gender of the citing author.
Data availability statement
The data underlying this article will be shared on reasonable request to the corresponding author.
References
Ashmos Plowman, D., & Smith, A. D. (2011). The gendering of organizational research methods: Evidence of gender patterns in qualitative research. Qualitative Research in Organizations and Management: an International Journal, 6(1), 64–82. https://doi.org/10.1108/17465641111129399
Chatterjee, P., & Werner, R. M. (2021). Gender disparity in citations in high-impact journal articles. JAMA Network Open, 4(7), e2114509. https://doi.org/10.1001/jamanetworkopen.2021.14509
Lund, B., & Shamsi, A. (2023). Examining the use of supportive and contrasting citations in different disciplines: a brief study using Scite (scite.ai) data. Scientometrics, 128(8), 4895–4900.
Nicholson, J. M., Mordaunt, M., Lopez, P., et al. (2021). Scite: A smart citation index that displays the context of citations and classifies their intent using deep learning. Quantitative Science Studies, 2(3), 882–898. https://doi.org/10.1162/qss_a_00146
Santamaría, L., & Mihaljević, H. (2018). Comparison and benchmark of name-to-gender inference services. PeerJ Computer Science, 4, e156. https://doi.org/10.7717/peerj-cs.156
Sebo, P. (2021). Performance of gender detection tools: A comparative study of name-to-gender inference services. Journal of the Medical Library Association: JMLA, 109(3), 414–421. https://doi.org/10.5195/jmla.2021.1185
Sebo, P., & Clair, C. (2022a). Gender gap in authorship: A study of 44,000 articles published in 100 high-impact general medical journals. European Journal of Internal Medicine, 97, 103–105. https://doi.org/10.1016/j.ejim.2021.09.013
Sebo, P., & Clair, C. (2022b). Gender inequalities in citations of articles published in high-impact general medical journals: A cross-sectional study. Journal of General Internal Medicine. https://doi.org/10.1007/s11606-022-07717-9
Acknowledgements
None.
Funding
None.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interest
The authors declare that they have no conflict of interest.
Ethical approval
Since this study did not involve the collection of personal health-related data it did not require ethical review, according to current Swiss law.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Sebo, P., Shamsi, A. Author gender and citation categorization: a study of high-impact medical journals. Scientometrics 128, 6299–6306 (2023). https://doi.org/10.1007/s11192-023-04827-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-023-04827-x