Abstract
Social media is one of the major channels for knowledge diffusion, including scientific discovery. As a consequence, it has been under discussion whether altmetrics can be used as an alternative indicator for research evaluation, complementing the traditional indicators such as citations. The study contributes to the discussion by exploring the factors relevant to the attention that publications receive on social media. Based on 20,310 academic papers published by the Royal Society in the past ten years, the study found that posting accounts are the major force for boosting the amount of attention received on Twitter. Timely posting and accessibility also help to increase the attention. The findings suggest that publications’ social popularity can be easily influenced by non-paper factors.




Similar content being viewed by others
References
Adler, N. J., & Harzing, A. (2009). When knowledge wins: Transcending the sense and nonsense of academic rankings. Academy of Management Learning & Education, 8(1), 72–95.
Aharony, N., Bar-Ilan, J., Julien, H., Benyamin-Kahana, M., & Cooper, T. (2019). Acceptance of altmetrics by LIS scholars: An exploratory study. Journal of Librarianship and Information Science, 51(3), 843–851.
Alotaibi, N. M., Guha, D., Fallah, A., Aldakkan, A., Nassiri, F., Badhiwala, J. H., et al. (2016). Social media metrics and bibliometric profiles of neurosurgical departments and journals: is there a relationship? World Neurosurgery, 90, 574-579.e7.
Altmetric.com. (2020). The donut and Altmetric Attention Score. Retrieved December 25, 2019, from https://www.altmetric.com/about-our-data/the-donut-and-score/
Asaad, M., Howell, S. M., Rajesh, A., Meaike, J., & Tran, N. V. (2020). Altmetrics in plastic surgery journals: Does it correlate with citation count? Aesthetic Surgery Journal, 40(11), NP628–NP635.
Baek, S., Yoon, D. Y., Lim, K. J., Hong, J. H., Moon, J. Y., Seo, Y. L., &, , et al. (2020). Top-cited articles versus top Altmetric articles in nuclear medicine: A comparative bibliometric analysis. ACTA Radiologica, 61(10), 1343–1349.
Bar-Ilan, J., Haustein, S., Peters, I., Priem, J., Shema, H., & Terliesner, J. (2012). Beyond citations: Scholars’ visibility on the social web. Arxiv preprint, 1205, 5611.
Bar-Ilan, J., Shema, H., & Thelwall, M. (2014). Bibliographic references in Web 2. 0. In B. Cronin & C. R. Sugimoto (Eds.), Beyond Bibliometrics: Harnessing Multidimensional Indicators of Scholarly Impact (pp. 307–325). Britain, MIT Press: Cambridge.
Bornmann, L. (2014a). Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics. Journal of Informetrics, 8(4), 895–903.
Bornmann, L. (2014b). Is there currently a scientific revolution in scientometrics? Journal of the Association for Information Science and Technology, 65(3), 647–648.
Bornmann, L. (2014c). Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime. Journal of Informetrics, 8(4), 935–950.
Bornmann, L., & Haunschild, R. (2016). How to normalize Twitter counts? A first attempt based on journals in the Twitter Index. Scientometrics, 107(3), 1405–1422.
Bornmann, L., & Haunschild, R. (2017). Measuring field-normalized impact of papers on specific societal groups: An altmetrics study based on mendeley data. Research Evaluation, 26(3), 230–241.
Bornmann, L., Schier, H., Marx, W., & Daniel, H.-D. (2012). What factors determine citation counts of publications in chemistry besides their quality? Journal of Informetrics, 6(1), 11–18.
Boyd, C. J., Ananthasekar, S., Kurapati, S., & King, T. W. (2020). Examining the correlation between altmetric score and citations in the plastic surgery literature. Plastic and Reconstructive Surgery, 146(6), 808E-815E.
Callaham, M., Wears, R. L., & Weber, E. (2002). Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer reviewed journals. JAMA-Journal of the American Medical Association, 287(21), 2847–2850.
Castillo, C., Mendoza, M., & Poblete, B. (2013). Predicting information credibility in time-sensitive social media. Internet Research, 23(5), 560–588.
Chandrashekhar, Y., & Shaw, L. (2019). Journal Editors and Altmetrics Moth to the Flame? JACC-Cardiovascular Imaging, 12(9), 1899–1902.
Costas, R., Zahedi, Z., & Wouters, P. (2015). Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology, 66(10), 2003–2019.
Dardas, L. A., Woodward, A., Scott, J., Xu, H. Z., & Sawair, F. A. (2019). Measuring the social impact of nursing research: An insight into altmetrics. Journal of Advanced Nursing, 75(7), 1394–1405.
Davis, P. M., & Fromerth, M. J. (2007). Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles? Scientometrics, 71(2), 203–215.
Dhiman, A. K. (2016). Bibliometrics to altmetrics: Changing trends in assessing research impact. Desidoc Journal of Library and Information Technology, 35(4), 310–316.
Dowling, G. R. (2014). Playing the citations game: From publish or perish to be cited or sidelined. Australasian Marketing Journal, 22(4), 280–287.
Elsevier. (2017a). Article sharing. Retrieved December 25, 2019, from https://www.elsevier.com/about/company-information/policies/sharing
Elsevier. (2017b). Sharing and promoting your article. Retrieved December 25, 2019, from https://www.elsevier.com/authors/journal-authors/submit-your-paper/sharing-and-promoting-your-article
Ezema, I. J., & Ugwu, C. I. (2019). Correlating research impact of library and information science journals using citation counts and altmetrics attention. Information Discovery and Delivery, 47(3), 143–153.
Galetti, M., & Costa-Pereira, R. (2017). Scientists need social media influencers. Science, 357(6354), 880.2-881.
Gingras, Y., & Wallace, M. L. (2010). Why it has become more difficult to predict Nobel Prize winners: A bibliometric analysis of nominees and winners of the chemistry and physics prizes (1901–2007). Scientometrics, 82(2), 401–412.
Glänzel, W., & Schubert, A. (2005). Handbook of Quantitative Science and Technology Research (pp. 257–276). Springer.
Griffin, S. A., Oliver, C. W., & Murray, A. (2018). "Altmetrics’! Can you afford to ignore it? British Journal of Sports Medicine, 52(18), 1160–1161.
Hassan, Saeed-Ul., Aljohani, N. R., Idrees, N., Sarwar, R., Nawaz, R., Martinez-Camara, E., &, , et al. (2020). Predicting literature’s early impact with sentiment analysis in Twitter. Knowledge-based Systems, 192, 105383.
Haunschild, R., & Bornmann, L. (2016). Normalization of mendeley reader counts for impact assessment. Journal of Informetrics, 10(1), 62–73.
Haustein, S., Larivière, V., Thelwall, M., Amyot, D., & Peters, I. (2014). Tweets vs. mendeley readers: how do these two social media metrics differ? IT-Information Technology, 56(5), 207–215.
Haustein, S., Peters, I., Bar-Ilan, J., Priem, J., Shema, H., & Terliesner, J. (2014b). Coverage and adoption of altmetrics sources in the bibliometric community. Scientometrics, 101(2), 1145–1163.
Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M., & Lariviere, V. (2014c). Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology, 65(4), 656–669.
Holmberg, K., Hedman, J., Bowman, T. D., Didegah, F., & Laakso, M. (2020). Do articles in open access journals have more frequent altmetric activity than articles in subscription-based journals? An investigation of the research output of Finnish universities. Scientometrics, 122(1), 645–659.
Hong, J. H., Yoon, D. Y., Lim, K. J., Moon, J. Y., Baek, S., Seo, Y. L., &, , et al. (2020). Characteristics of the most cited, most downloaded, and most mentioned articles in general medical journals: a comparative bibliometric analysis. Healthcare, 8(4), 492.
Kunze, K. N., Polce, E. M., Vadhera, A., Williams, B. T., Nwachukwu, B. U., Nho, S. J., et al. (2020). What is the predictive ability and academic impact of the altmetrics score and social media attention? American Journal of Sports Medicine, 48(5), 1056–1062.
Larivière, V., Sugimoto, C. R., Macaluso, B., Milojevic, S., Cronin, B., & Thelwall, M. (2014). ArXiv e-prints and the journal of record: An analysis of roles and relationships. Journal of the Association for Information Science and Technology, 65(6), 1157–1169.
Leydesdorff, L., & Wagner, C. (2009). Is the United States losing ground in science? A global perspective on the world science system. Scientometrics, 78, 23–36.
Melero, R. (2015). Altmetrics: A complement to conventional metrics. Biochemia Medica, 25(2), 152–160.
Merton, R. K. (1968). The Matthew effect in science. Science, 159(3810), 56–63.
Moed, H. F., & Halevi, G. (2016). On full text download and citation distributions in scientific-scholarly journals. Journal of the Association for Information Science and Technology, 67(2), 412–431.
Mohammadi, E., Thelwall, M., Haustein, S., & Lariviere, V. (2015). Who reads research articles? an altmetrics analysis of mendeley user categories. Journal of the Association for Information Science and Technology, 66(9), 1832–1846.
Morales, A. J., Borondo, J., Losada, J. C., & Benito, R. M. (2014). Efficiency of human activity on information spreading on Twitter. Social Networks, 39(1), 1–11.
Neuhaus, C., & Daniel, H.-D. (2009). A new reference standard for citation analysis in chemistry and related fields based on the sections of Chemical Abstracts. Scientometrics, 78(2), 219–229.
Neylon, C., & Wu, S. (2009). Article-level metrics and the evolution of scientific impact. PLoS Biology, 7(11), e1000242.
Ortega, J. L. (2016). To be or not to be on twitter, and its relationship with the tweeting and citation of research papers. Scientometrics, 109(2), 1353–1364.
Peters, H. P. F., & van Raan, A. F. J. (1994). On determinants of citation scores: A case study in chemical engineering. Journal of the American Society for Information Science, 45(1), 39–49.
Piwowar, H., Priem, J., Larivière, V., Alperin, J. P., Matthias, L., Norlander, B., et al. (2018). The state of OA: a large-scale analysis of the prevalence and impact of Open Access articles. PeerJ, 6, e4375.
Priem, J. (2014) In B. Cronin, & C. R. Sugimoto (Eds.), Beyond Bibliometrics: Harnessing Multidimensional Indicators of Scholarly Impact (pp. 263–287). Cambridge, Britain, MIT Press.
Priem, J., & Hemminger, B. M. (2010). Scientometrics 2.0: New metrics of scholarly impact on the social Web. First Monday, 15(7), 16.
Priem, J., Piwowar, H. A., & Hemminger, B. M. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. Arxiv preprint, 1203, 4745.
Saberi, M. K., & Ekhtiyari, F. (2019). Usage, captures, mentions, social media and citations of LIS highly cited papers: An altmetrics study. Performance Measurement and Metrics, 20(1), 37–47.
Shu, F., & Haustein, S. (2017). On the citation advantage of tweeted papers at the journal level. Proceedings of the Association for Information Science and Technology, 54(1), 366–372.
Shu, F., Lou, W., & Haustein, S. (2018). Can twitter increase the visibility of Chinese publications? Scientometrics, 116(1), 505–519.
Strevens, M. (2006). The role of the Matthew effect in science. Studies in History and Philosophy of Science, 37(2), 159–170.
Sud, P., & Thelwall, M. (2014). Evaluating altmetrics. Scientometrics, 98(2), 1131–1143.
The Royal Society. (2019). Select your journal. Retrieved December 25, 2019, from https://royalsociety.org/journals/authors/
Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013). Do altmetrics work? Twitter and ten other social web services. PLoS ONE, 8(5), e64841.
Van Noorden, R. (2014). Scientists and the social network. Nature, 512(7513), 126–129.
Wang, J., Alotaibi, N. M., Ibrahim, G. M., Kulkarni, A. V., & Lozano, A. M. (2017). The spectrum of altmetrics in neurosurgery: The Top 100 “Trending” articles in neurosurgical journals. World Neuros Urgery, 103, 883.
Wang, J., & Shapira, P. (2015). Is there a relationship between research sponsorship and publication impact? An analysis of funding acknowledgments in nanotechnology papers. PLoS ONE, 10(2), e0117727. https://doi.org/10.1371/journal.pone.0117727
Wang, J., & Zhang, L. W. (2018). Proximal advantage in knowledge diffusion: The time dimension. Journal of Informetrics, 12(3), 858–867.
Wang, M. Y., Yu, G., Xu, J. Z., He, H. X., Yu, D. R., & An, S. (2012). Development a case-based classifier for predicting highly cited papers. Journal of Informetrics, 6(4), 586–599.
Wang, X. W., Fang, Z. C., & Guo, X. H. (2016). Tracking the digital footprints to scholarly articles from social media. Scientometrics, 109(2), 1365–1376.
Wang, X. W., Liu, C., Mao, W. L., & Fang, Z. (2015). The open access advantage considering citation, article usage and social media attention. Scientometrics, 103(2), 555–564.
Warren, H. R., Raison, N., & Dasgupta, P. (2017). The rise of altmetrics. JAMA-Journal of the American Medical Association, 317(2), 131–132.
Warren, V. T., Patel, B., & Boyd, C. J. (2020). Analyzing the relationship between Altmetric score and literature citations in the Implantology literature. Clinical Implant Dentistry and Related Research, 22(1), 54–58.
Wasike, B. (2019). Citations gone #Social: Examining the effect of altmetrics on citations and readership in communication research. Social Science Computer Review, 39(3), 416–433. https://doi.org/10.1177/0894439319873563
Wilsdon, J., Allen, L., Belfiore, E., Campbell, P., Curry, S., & Hill, S. (2015). The metric tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management. Higher Education Funding Council for England.
Zahedi, Z., Costas, R., & Wouters, P. (2014). How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications. Scientometrics, 101(2), 1491–1513.
Zhang, G. Y., Wang, Y. Q., Xie, W. X., Du, H., Jiang, C. L., & Wang, X. W. (2020). The open access usage advantage: A temporal and spatial analysis. Scientometrics. https://doi.org/10.1007/s11192-020-03836-4
Zhang, L. W., & Wang, J. (2018). Why highly cited articles are not highly tweeted? A Biology Case. Scientometrics, 117(1), 495–509.
Acknowledgements
The study receives financial support from the National Natural Science Foundation of China (NSFC) (No. 72004118), and ISTIC-CLARIVATE Analytics Joint Laboratory for Scientometrics.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, L., Wang, J. What affects publications’ popularity on Twitter?. Scientometrics 126, 9185–9198 (2021). https://doi.org/10.1007/s11192-021-04152-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-021-04152-1