Abstract
Our objective was to study the relationship between the design and content of randomized clinical trials (RCTs) and the subsequent number of citations in the medical literature and attention in online news and social media. We studied RCTs published during 2014 in five highly cited medical journals. This was a retrospective review focusing on characteristics of the individual trials and measures of citation and lay media attention. Primary outcome measures included citation count and Altmetric® scores (a composite score measuring attention in news, blogs, Twitter®, and Facebook®). Two hundred and forty two RCTs were included in the final analysis. Trial characteristics that were positive predictors of citation count included investigation of Hepatitis C treatment (r = 0.35, p < 0.001), private funding (r = 0.24, p < 0.001), mortality-related endpoint (r = 0.22, p < 0.001), and research setting within the United States (r = 0.13, p < 0.001). The trial characteristic that positively predicted Altmetric score was the population size potentially affected (r = 0.39, p < 0.001). The only negative predictor of citation count was the size of the population potentially affected (r = −0.21, p < 0.001). Negative predictors of the Altmetric score included investigation of Hepatitis C treatment (r = −0.21, p < 0.001) and private funding (r = −0.13, p < 0.001). While correlation magnitudes were weak, the predictors of biomedical literature citation and non-academic media coverage were different. These predictors may affect editorial decisions and, given the rising influence of health journalism, further study is warranted.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
About us (2016). Learn more about altmetric. https://www.altmetric.com/about-us/. Accessed Mar 27, 2016.
Andersen JP, Haustein S. (2015). Influence of study type on Twitter activity for medical research papers. arXiv preprint arXiv:150700154.
Bhandari, M., Busse, J., Devereaux, P., & Montori, V. M. (2007). Factors associated with citation rates in the orthopedic literature. Canadian Journal of Surgery, 50(2), 119.
Brodie, M., Hamel, E. C., Altman, D. E., Blendon, R. J., & Benson, J. M. (2003). Health news and the American public, 1996–2002. Journal of Health Politics, Policy and Law, 28(5), 927–950.
Callaham, M., Wears, R. L., & Weber, E. (2002). Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals. JAMA, 287(21), 2847–2850.
Costas, R., Zahedi, Z., & Wouters, P. (2015). Do, “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology, 66(10), 2003–2019.
de Winter, J. C. (2015). The relationship between tweets, citations, and article views for PLOS ONE articles. Scientometrics, 102(2), 1773–1779.
Fergie G, Hilton S, Hunt K. (2015). Young adults’ experiences of seeking online information about diabetes and mental health in the age of social media. Health Expectations, 19(6), 1324–1335.
Garfield E. (1972). Citation analysis as a tool in journal evaluation. Science, 178(4060), 471–479.
Guyatt GH, Haynes RB, Jaeschke RZ, et al. (2000). Users’ guides to the medical literature: XXV. Evidence-based medicine: principles for applying the users’ guides to patient care. Evidence-based medicine working group. JAMA. 284(10):1290–1296.
Haustein, S., Costas, R., & Larivière, V. (2015). Characterizing social media metrics of scholarly papers: the effect of document properties and collaboration patterns. PLoS ONE, 10(3), e0120495.
Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M., & Larivière, V. (2014). Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology, 65(4), 656–669.
Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences of the United States of America, 102(46), 16569–16572.
Ioannidis, J. P. (2005a). Why most published research findings are false. PLoS Medicine, 2(8), e124.
Ioannidis, J. P. (2005b). Contradicted and initially stronger effects in highly cited clinical research. JAMA, 294(2), 218–228.
Jacobs, A. K., Kushner, F. G., Ettinger, S. M., et al. (2013). ACCF/AHA clinical practice guideline methodology summit report: A report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. Journal of the American College of Cardiology, 61(2), 213–265.
Kulkarni, A. V., Busse, J. W., & Shams, I. (2007). Characteristics associated with citation rate of the medical literature. PLoS ONE, 2(5), e403.
McMurray, J. J., Packer, M., Desai, A. S., et al. (2014). Angiotensin–neprilysin inhibition versus enalapril in heart failure. New England Journal of Medicine, 371(11), 993–1004.
Moynihan, R., Bero, L., Ross-Degnan, D., et al. (2000). Coverage by the news media of the benefits and risks of medications. New England Journal of Medicine, 342(22), 1645–1650.
Patsopoulos, N. A., Analatos, A. A., & Ioannidis, J. P. (2005). Relative citation impact of various study designs in the health sciences. JAMA, 293(19), 2362–2366.
Phillips B, Ball C, Sackett D, et al. (2009). Levels of evidence. http://www.cebm.net/oxford-centre-evidence-based-medicine-levels-evidence-march-2009/. Accessed Mar 27, 2016.
Prasad, V., & Cifu, A. (2012). A medical burden of proof: Towards a new ethic. Biosocieties, 7(1), 72–87.
Razavi, H., ElKhoury, A. C., Elbasha, E., et al. (2013). Chronic hepatitis C virus (HCV) disease burden and cost in the United States. Hepatology, 57(6), 2164–2170.
Robinson-García N, Torres-Salinas D, Zahedi Z, Costas R. (2014). New data, new possibilities: exploring the insides of Altmetric. com. arXiv preprint arXiv:14080135.
Schwitzer, G. (2008). How do US journalists cover treatments, tests, products, and procedures? An evaluation of 500 stories. PLoS Medicine, 5(5), e95.
Selvaraj, S., Borkar, D. S., & Prasad, V. (2014). Media coverage of medical journals: do the best articles make the news? PLoS ONE, 9(1), e85355.
Sharma, V., Dowd, M. D., Swanson, D. S., Slaughter, A. J., & Simon, S. D. (2003). Influence of the news media on diagnostic testing in the emergency department. Archives of Pediatrics and Adolescent Medicine, 157(3), 257–260.
Team, R. C. (2015). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.
Thackeray, R., Crookston, B. T., & West, J. H. (2013). Correlates of health-related social media use among adults. Journal of Medical Internet Research, 15(1), e21.
Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013). Do altmetrics work? Twitter and ten other social web services. PLoS ONE, 8(5), e64841.
Wang, Z., & Gantz, W. (2010). Health content in local television news: a current appraisal. Health Communication, 25(3), 230–237.
Wang X, Liu C, Fang Z, Mao W. (2014). From attention to citation, what and how does altmetrics work? arXiv.
Willis, D. L., Bahler, C. D., Neuberger, M. M., & Dahm, P. (2011). Predictors of citations in the urological literature. BJU International, 107(12), 1876–1880.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
JC, ZH, and AS declare that they have no conflicts of interest.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Chapa, J., Haq, Z. & Cifu, A.S. Comparative analysis of the factors associated with citation and media coverage of clinical research. Scientometrics 112, 1271–1283 (2017). https://doi.org/10.1007/s11192-017-2428-5
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-017-2428-5