Skip to main content
SpringerLink
Log in

Introducing the ‘alt-index’ for measuring the social visibility of scientific research

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

We propose a new metric called ‘alt-index’, which is analagous to the h-index, but uses altmetrics data to measure both the volume and social media activity of scientific literature. The dataset includes over 1.1 million papers and their associated altmetrics score. A correlation analysis of the h-index and alt-index is conducted at three different levels: field level, source (journal) level, and author level. Our results show a strong positive correlation between the two indexes across all levels. We conclude that the alt-index can be adopted to measure the social activity of publications in situations where there is agreement amongst various social media channels.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Bartneck, C., & Kokkelmans, S. (2010). Detecting h-index manipulation through self-citation analysis. Scientometrics,87(1), 85–98.

    Article  Google Scholar 

  • Bornmann, L., & Haunschild, R. (2015). t factor: A metric for measuring impact on Twitter. ArXiv Preprint arXiv:1508.02179.

  • Bornmann, L., Mutz, R., & Daniel, H.-D. (2008). Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine. Journal of the American Society for Information Science and Technology,59(5), 830–837.

    Article  Google Scholar 

  • Braun, T., Glänzel, W., & Schubert, A. (2006). A Hirsch-type index for journals. Scientometrics,69(1), 169–173.

    Article  Google Scholar 

  • Burrell, Q. L. (2007). On the h-index, the size of the Hirsch core and Jin’s A-index. Journal of Informetrics,1(2), 170–177.

    Article  MathSciNet  Google Scholar 

  • Colonia, G. (2002). Informationswissenschaftliche Zeitschriften in szientometrischer Analyse. Fachbereich Informationswissenschaft: Fachhochschule Köln.

    Google Scholar 

  • Costas, R., Zahedi, Z., & Wouters, P. (2015). Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology,66(10), 2003–2019.

    Article  Google Scholar 

  • de Winter, J. C. (2015). The relationship between tweets, citations, and article views for PLOS ONE articles. Scientometrics,102(2), 1773–1779.

    Article  Google Scholar 

  • Egghe, L. (2006). An improvement of the h-index: The g-index. ISSI.

  • Egghe, L., & Rousseau, R. (2008). An h-index weighted by citation impact. Information Processing and Management,44(2), 770–780.

    Article  Google Scholar 

  • Eysenbach, G. (2011). Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact. Journal of Medical Internet Research,13(4), e123.

    Article  Google Scholar 

  • Garfield, E. (1994). The impact factor. Current Contents,25(20), 3–7.

    Google Scholar 

  • Haddawy, P., Hassan, S.-U., Abbey, C. W., & Lee, I. B. (2017). Uncovering fine-grained research excellence: The global research benchmarking system. Journal of Informetrics,11(2), 389–406.

    Article  Google Scholar 

  • Hassan, S.-U., Imran, M., Gillani, U., Aljohani, N. R., Bowman, T. D., & Didegah, F. (2017). Measuring social media activity of scientific literature: An exhaustive comparison of scopus and novel altmetrics big data. Scientometrics,113(2), 1037–1057.

    Article  Google Scholar 

  • Haustein, S. (2012). Multidimensional journal evaluation: Analyzing scientific periodicals beyond the impact factor. Berlin: Walter de Gruyter.

    Book  Google Scholar 

  • Haustein, S. (2016). Grand challenges in altmetrics: Heterogeneity, data quality and dependencies. Scientometrics,108(1), 413–423.

    Article  Google Scholar 

  • Haustein, S., Bowman, T. D., Holmberg, K., Tsou, A., Sugimoto, C. R., & Larivière, V. (2016). Tweets as impact indicators: Examining the implications of automated “bot” accounts on Twitter. Journal of the Association for Information Science and Technology,67(1), 232–238.

    Article  Google Scholar 

  • Haustein, S., Costas, R., & Larivière, V. (2015). Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE,10(3), e0120495.

    Article  Google Scholar 

  • Haustein, S., & Peters, I. (2012). Using social bookmarks and tags as alternative indicators of journal content description. First Monday, 17(11). Available at: https://firstmonday.org/ojs/index.php/fm/article/download/4110/3357.

  • Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M., & Larivière, V. (2014). Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology,65(4), 656–669.

    Article  Google Scholar 

  • Haustein, S., & Siebenlist, T. (2011). Applying social bookmarking data to evaluate journal usage. Journal of Informetrics,5(3), 446–457.

    Google Scholar 

  • Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences,102(46), 16569–16572.

    Article  Google Scholar 

  • Hirsch, J. E. (2019). h α: An index to quantify an individual’s scientific leadership. Scientometrics,118(2), 673–686.

    Article  Google Scholar 

  • Jin, B., Liang, L., Rousseau, R., & Egghe, L. (2007). The R-and AR-indices: Complementing the h-index. Chinese Science Bulletin,52(6), 855–863.

    Article  Google Scholar 

  • Konkiel, S. (2016). Altmetrics: Diversifying the understanding of influential scholarship. Palgrave Communications,2, 1–7.

    Article  Google Scholar 

  • Kosmulski, M. (2006). A new Hirsch-type index saves time and works equally well as the original h-index. ISSI Newsletter,2(3), 4–6.

    Google Scholar 

  • Kousha, K., & Thelwall, M. (2019). Can Google Scholar and Mendeley help to assess the scholarly impacts of dissertations? Journal of Informetrics,13(2), 467–484.

    Article  Google Scholar 

  • Kwok, R. (2013). Research impact: Altmetrics make their mark. Nature,500(7463), 491–493.

    Article  Google Scholar 

  • Meschede, C., & Siebenlist, T. (2018). Cross-metric compatability and inconsistencies of altmetrics. Scientometrics,115(1), 283–297.

    Article  Google Scholar 

  • Mingers, J., Macri, F., & Petrovici, D. (2012). Using the h-index to measure the quality of journals in the field of business and management. Information Processing and Management,48(2), 234–241.

    Article  Google Scholar 

  • Nuzzolese, A. G., Ciancarini, P., Gangemi, A., Peroni, S., Poggi, F., & Presutti, V. (2019). Do altmetrics work for assessing research quality? Scientometrics,118(2), 539–562.

    Article  Google Scholar 

  • Piwowar, H. (2013). Altmetrics: Value all research products. Nature,493(7431), 159.

    Article  Google Scholar 

  • Priem, J., & Hemminger, B. H. (2010). Scientometrics 2.0: New metrics of scholarly impact on the social Web. First Monday, 15(7).

  • Priem, J., Piwowar, H. A., & Hemminger, B. M. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. ArXiv Preprint arXiv:1203.4745.

  • Repiso, R., Castillo-Esparcia, A., & Torres-Salinas, D. (2019). Altmetrics, alternative indicators for Web of Science Communication studies journals. Scientometrics,119(2), 941–958.

    Article  Google Scholar 

  • Rolla, P. J. (2011). User tags versus subject headings. Library Resources and Technical Services,53(3), 174–184.

    Article  Google Scholar 

  • Rousseau, R. (2006). New developments related to the Hirsch index. Science Focus, 1(4), 23–25 (in Chinese). English version available at: http://eprints.rclis.org/7616/1/Hirsch_new_developments.pdf.

  • Said, A., Bowman, T. D., Abbasi, R. A., Aljohani, N. R., Hassan, S.-U., & Nawaz, R. (2019). Mining network-level properties of Twitter altmetrics data. Scientometrics,120(1), 217–235.

    Article  Google Scholar 

  • Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013). Do altmetrics work? Twitter and ten other social web services. PLoS ONE,8(5), e64841.

    Article  Google Scholar 

  • Tunger, D., Clermont, M., & Meier, A. (2018). Altmetrics: State of the art and a look into the future. In M. Jibu & Y. Osabe (Eds.), Scientometrics (pp. 123–134). IntechOpen. Available at: https://doi.org/10.5772/intechopen.76874.

    Google Scholar 

  • Wilhite, A. W., & Fong, E. A. (2012). Coercive citation in academic publishing. Science,335(6068), 542–543.

    Article  Google Scholar 

  • Xia, F., Su, X., Wang, W., Zhang, C., Ning, Z., & Lee, I. (2016). Bibliographic analysis of nature based on twitter and facebook altmetrics data. PLoS ONE,11(12), e0165997.

    Article  Google Scholar 

  • Yin, C.-Y., Aris, M., & Chen, X. (2009). Combination of Eigenfactor TM and h-index to evaluate scientific journals. Scientometrics,84(3), 639–648.

    Article  Google Scholar 

  • Zahedi, Z., & Costas, R. (2018). General discussion of data quality challenges in social media metrics: Extensive comparison of four major altmetric data aggregators. PLoS ONE,13(5), e0197326.

    Article  Google Scholar 

  • Zhang, X., Wang, X., Zhao, H., de Pablos, P. O., Sun, Y., & Xiong, H. (2019). An effectiveness analysis of altmetrics indices for different levels of artificial intelligence publications. Scientometrics,119(3), 1311–1344.

    Article  Google Scholar 

Download references

Acknowledgements

Salem Alelyani and Saeed-Ul Hassan are grateful for the financial support received from King Khalid University for this research Under Grant No. 239, 2019.

Author information

Authors and Affiliations

  1. Information Technology University, 346-B, Ferozepur Road, Lahore, Pakistan

    Saeed-Ul Hassan & Sehrish Iqbal

  2. Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Kingdom of Saudi Arabia

    Naif R. Aljohani

  3. Center for Artificial Intelligence (CAI), King Khalid University, P.O. Box 9004, Abha, 61413, Kingdom of Saudi Arabia

    Salem Alelyani

  4. College of Computer Science, King Khalid University, P.O. Box 9004, Abha, 61413, Saudi Arabia

    Salem Alelyani

  5. Department of Communication, University of Copenhagen, Karen Blixens Vej 8, 2300, Copenhagen, Denmark

    Alesia Zuccala

Authors
  1. Saeed-Ul Hassan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sehrish Iqbal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Naif R. Aljohani
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Salem Alelyani
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Alesia Zuccala
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alesia Zuccala.

Additional information

This paper is dedicated to the memory of Judit Bar-Ilan (1958–2019), an outstanding scholar and an inimitable friend and colleague.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hassan, SU., Iqbal, S., Aljohani, N.R. et al. Introducing the ‘alt-index’ for measuring the social visibility of scientific research. Scientometrics 123, 1407–1419 (2020). https://doi.org/10.1007/s11192-020-03447-z

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-020-03447-z

Keywords

Search

Navigation