Skip to main content

Analyzing Scientometric Indicators of Journals and Chief Editors: A Case Study in Artificial Intelligence (AI) Domain

  • Conference paper
  • First Online:
Computational Data and Social Networks (CSoNet 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13831))

Included in the following conference series:

  • 487 Accesses

Abstract

This study investigates the relationship between the rankings of artificial intelligence (AI) journals and the chief editor’s scholarly reputations by mining various scientometric data. The associations between these two types of entities are studied with respect to the top AI journals (selected based on Google Scholar ranking) and journals from various quartiles (based on Scimago quartile ranking). Three quantitative reputation metrics (i.e., citation count, h-index, and i10-index) of editor-in-chief (EiC) and four journal ranking metrics (i.e., h5-index, h5-median, the impact factor (IF), and Scimago Journal Rank (SJR)) of journals are considered to find any relationships. To determine the correlation between various pairs of scholarly metrics of EiC and top AI journals, we employ the Spearman and Kendall correlation coefficients. Furthermore, we investigate whether machine learning (ML) classifiers can predict the SJR and IF of journals utilizing EIC’s scholarly reputation metrics. It is observed that the comparative rankings (based on various metrics) of top AI journals do not correlate with the EiC’s scholarly achievements. The high prediction errors of ML classifiers indicate that the EiC’s scholarly indices are not comprehensive enough to build a good model for predicting the IF or SJR of top AI journals. Nevertheless, when AI journals of various qualities are analyzed, we observe that Q1 journals usually have EiCs with a much higher number of citations and h-index compared to the EiCs from the journals from the bottom two quarterlies (Q3 and Q4). The Mann-Whitney U test indicates the differences between the scholarly metrics of EiCs of Q1 journals and journals from Q3 and Q4 are significant. The results imply that while selecting the EiC of a journal, scientometric indices should be considered prudently.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/sazzadcsedu/AIJournalList.

  2. 2.

    https://www.scimagojr.com/.

  3. 3.

    https://github.com/sazzadcsedu/AIJournalList.

  4. 4.

    https://scholar.google.com/.

  5. 5.

    https://www.scimagojr.com/.

  6. 6.

    https://www.elsevier.com/connect/how-do-publishers-choose-editors-and-how-do-they-work-together.

References

  1. Asnafi, S., Gunderson, T., McDonald, R.J., Kallmes, D.F.: Association of h-index of editorial board members and impact factor among radiology journals. Acad. Radiol. 24(2), 119–123 (2017)

    Article  Google Scholar 

  2. Bedeian, A.G., Van Fleet, D.D., Hyman III, H.H.: Scientific achievement and editorial board membership (2009)

    Google Scholar 

  3. Bornmann, L., Daniel, H.D.: What do citation counts measure? A review of studies on citing behavior. J. Doc. 64(1), 45–80 (2008)

    Article  Google Scholar 

  4. Bornmann, L., Marx, W., Gasparyan, A.Y., Kitas, G.D.: Diversity, value and limitations of the journal impact factor and alternative metrics. Rheumatol. Int. 32(7), 1861–1867 (2012)

    Article  Google Scholar 

  5. Burgess, T.F., Shaw, N.E.: Editorial board membership of management and business journals: a social network analysis study of the financial times 40. Br. J. Manag. 21(3), 627–648 (2010)

    Article  Google Scholar 

  6. Cai, L., et al.: Scholarly impact assessment: a survey of citation weighting solutions. Scientometrics 118(2), 453–478 (2019)

    Article  Google Scholar 

  7. García-Carpintero, E., Granadino, B., Plaza, L.: The representation of nationalities on the editorial boards of international journals and the promotion of the scientific output of the same countries. Scientometrics 84(3), 799–811 (2010)

    Article  Google Scholar 

  8. Hardin, W.G., Liano, K., Chan, K.C., Fok, R.C.: Finance editorial board membership and research productivity. Rev. Quant. Financ. Account. 31(3), 225–240 (2008)

    Article  Google Scholar 

  9. Herteliu, C., Ausloos, M., Ileanu, B.V., Rotundo, G., Andrei, T.: Quantitative and qualitative analysis of editor behavior through potentially coercive citations. Publications 5(2), 15 (2017)

    Article  Google Scholar 

  10. Kay, J., et al.: The h-index of editorial board members correlates positively with the impact factor of sports medicine journals. Orthop. J. Sports Med. 5(3), 2325967117694024 (2017)

    Google Scholar 

  11. Lowe, D.J., Van Fleet, D.D.: Scholarly achievement and accounting journal editorial board membership. J. Account. Educ. 27(4), 197–209 (2009)

    Article  Google Scholar 

  12. Mann, H.B., Whitney, D.R.: On a test of whether one of two random variables is stochastically larger than the other. Ann. Math. Stat. 50–60 (1947)

    Google Scholar 

  13. Marks, M.S., Marsh, M., Schroer, T.A., Stevens, T.H.: Misuse of journal impact factors in scientific assessment (2013)

    Google Scholar 

  14. Mazov, N., Gureev, V.: The editorial boards of scientific journals as a subject of scientometric research: a literature review. Sci. Tech. Inf. Process. 43(3), 144–153 (2016)

    Article  Google Scholar 

  15. Mendonça, S., Pereira, J., Ferreira, M.E.: Gatekeeping african studies: what does “editormetrics” indicate about journal governance? Scientometrics 117(3), 1513–1534 (2018)

    Google Scholar 

  16. Metz, I., Harzing, A.W., Zyphur, M.J.: Of journal editors and editorial boards: who are the trailblazers in increasing editorial board gender equality? Br. J. Manag. 27(4), 712–726 (2016)

    Article  Google Scholar 

  17. Mingers, J., Yang, L.: Evaluating journal quality: a review of journal citation indicators and ranking in business and management. Eur. J. Oper. Res. 257(1), 323–337 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  18. Pagel, P., Hudetz, J.: An analysis of scholarly productivity in united states academic anaesthesiologists by citation bibliometrics. Anaesthesia 66(10), 873–878 (2011)

    Article  Google Scholar 

  19. Pedregosa, F., et al.: Scikit-learn: machine learning in python. J. Mach. Learn. Res. 12, 2825–2830 (2011)

    MathSciNet  MATH  Google Scholar 

  20. Primack, R.B., et al.: Are scientific editors reliable gatekeepers of the publication process? (2019)

    Google Scholar 

  21. Sazzed, S.: Association between the rankings of top bioinformatics and medical informatics journals and the scholarly reputations of chief editors. Publications 9(3) (2021). https://doi.org/10.3390/publications9030042, https://www.mdpi.com/2304-6775/9/3/42

  22. Valderrama, P., Escabias, M., Jiménez-Contreras, E., Rodríguez-Archilla, A., Valderrama, M.J.: Proposal of a stochastic model to determine the bibliometric variables influencing the quality of a journal: application to the field of dentistry. Scientometrics 115(2), 1087–1095 (2018)

    Article  Google Scholar 

  23. Walters, W.H.: Citation-based journal rankings: Key questions, metrics, and data sources. IEEE Access 5, 22036–22053 (2017)

    Article  Google Scholar 

  24. Wu, D., Lu, X., Li, J., Li, J.: Does the institutional diversity of editorial boards increase journal quality? The case economics field. Scientometrics 124(2), 1579–1597 (2020)

    Article  Google Scholar 

  25. Zdeněk, R., Lososová, J.: An analysis of editorial board members’ publication output in agricultural economics and policy journals. Scientometrics 117(1), 563–578 (2018)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Salim Sazzed .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sazzed, S. (2023). Analyzing Scientometric Indicators of Journals and Chief Editors: A Case Study in Artificial Intelligence (AI) Domain. In: Dinh, T.N., Li, M. (eds) Computational Data and Social Networks . CSoNet 2022. Lecture Notes in Computer Science, vol 13831. Springer, Cham. https://doi.org/10.1007/978-3-031-26303-3_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-26303-3_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-26302-6

  • Online ISBN: 978-3-031-26303-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics