Abstract
Evaluating scientists based on their scientific production is often a controversial topic. Nevertheless, bibliometrics and algorithmic approaches can assist traditional peer review in numerous tasks, such as attributing research grants, deciding scientific committees, or choosing faculty promotions. Traditional bibliometrics focus on individual measures, disregarding the whole data (i.e., the whole network). Here we put forward OTARIOS, a graph-ranking method which combines multiple publication/citation criteria to rank authors. OTARIOS divides the original network in two subnetworks, insiders and outsiders, which is an adequate representation of citation networks with missing information. We evaluate OTARIOS on a set of five real networks, each with publications in distinct areas of Computer Science. When matching a metric’s produced ranking with best papers awards received, we observe that OTARIOS is \({>} 20\%\) more accurate than traditional bibliometrics. We obtain the best results when OTARIOS considers (i) the author’s publication volume and publication recency, (ii) how recently his work is being cited by outsiders, and (iii) how recently his work is being cited by insiders and how individual he his.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Note that we define variants using notation APV+AVW+AVW, where the addends define the criteria used at each group. The first for productivity, the second for outsiders influence and the last for score term. For the example in the text, the variant nomenclature is A+V+V.
- 2.
Awards information obtained from: https://jeffhuang.com/best_paper_awards.
References
Elvesier, B.V.: Research Metrics Guidebook. Elvesier, Amsterdam (2018)
Ding, Y.: Applying weighted pagerank to author citation networks. J. Am. Soc. Inf. Sci. Technol. 62(2), 236–245 (2009). https://doi.org/10.1002/asi.21452. https://onlinelibrary.wiley.com/doi/abs/10.1002/asi.21452
Dunaiski, M., Visser, W.: Comparing paper ranking algorithms.In: Proceedings of the South African Institute for ComputerScientists and Information Technologists Conference, pp. 21–30. ACM (2012)
Hirsch, J.E.: An index to quantify an individual’s scientific research output. Proc. Natl. Acad. Sci. 102(46), 16569–16572 (2005)
Hwang, W.S., Chae, S.M., Kim, S.W., Woo, G.: Yet another paper ranking algorithm advocating recent publications. In: Proceedings of the 19th International Conference on World Wide Web, pp. 1117–1118. ACM (2010)
Järvelin, K., Kekäläinen, J.: Cumulated gain-based evaluation of ir techniques. ACM Trans. Inf. Syst. (TOIS) 20(4), 422–446 (2002)
Page, L., Brin, S., Motwani, R., Winograd, T., et al.: The Pagerank Citation Ranking: Bringing Order to the Web (1998)
Radicchi, F., Fortunato, S., Markines, B., Vespignani, A.: Diffusion of scientific credits and the ranking of scientists. Phys. Rev. E 80(5), 056,103 (2009)
Sidiropoulos, A., Manolopoulos, Y.: Generalized comparison of graph-based ranking algorithms for publications and authors. J. Syst. Softw. 79(12), 1679–1700 (2006)
Tang, J., Zhang, J., Yao, L., Li, J., Zhang, L., Su, Z.: Arnetminer: Extraction and Mining of Academic Social Networks. In: KDD 2008, pp. 990–998 (2008)
Tang, J., Zhang, J., Yao, L., Li, J., Zhang, L., Su, Z.: Citation Network Dataset. https://aminer.org/citation (2017). Accessed 14 Sep 2018
Valente, T.W., Coronges, K., Lakon, C., Costenbader, E.: How correlated are network centrality measures? Connections (Toronto, Ont.) 28(1), 16 (2008)
Vieira, E.S., Cabral, J.A., Gomes, J.A.: How good is a model based on bibliometric indicators in predicting the final decisions made by peers? J. Inf. 8(2), 390–405 (2014)
Wang, H., Shen, H.W., Cheng, X.Q.: Scientific credit diffusion: researcher level or paper level? Scientometrics 109(2), 827–837 (2016)
West, J.D., Jensen, M.C., Dandrea, R.J., Gordon, G.J., Bergstrom, C.T.: Author-level eigenfactor metrics: Evaluating the influence of authors, institutions, and countries within the social science research network community. J. Am. Soc. Inf. Sci. Technol. 64(4), 787–801 (2013)
Acknowledgments
This work is partially funded by the ERDF through the COMPETE 2020 Programme within project POCI-01-0145-FEDER-006961, and by National Funds through the FCT as part of project UID/EEA/50014/2013. Jorge Silva is supported by a FCT/MAP-i PhD grant (PD/BD/128157/2016). David Aparício is also supported by a FCT/MAP-i PhD grant (PD/BD/105801/2014).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Silva, J., Aparício, D., Silva, F. (2019). OTARIOS: OpTimizing Author Ranking with Insiders/Outsiders Subnetworks. In: Aiello, L., Cherifi, C., Cherifi, H., Lambiotte, R., Lió, P., Rocha, L. (eds) Complex Networks and Their Applications VII. COMPLEX NETWORKS 2018. Studies in Computational Intelligence, vol 812. Springer, Cham. https://doi.org/10.1007/978-3-030-05411-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-05411-3_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05410-6
Online ISBN: 978-3-030-05411-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)