Abstract
The present contribution contains the formalisation of a method (not based on bibliometric indicators) for assigning analytical scores to the scientific production of researchers who challenge in an open competitive exam in a Socioeconomic Scientific Sector. The preliminary decisions of the evaluation board are described subdividing them into six decision steps. The role of decision-making about a priori criteria is pointed out in relation to the respect of the researcher’s identity and of the spontaneous evolution of science. In this work, also an example of application is proposed to the evaluation board. Some algebraic implications are highlighted and it is suggested to reflect on the usefulness of the rules of Boole’s Algebra for the calculation of total scores deriving from the simultaneous application of criteria having different logical characteristics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Archambault, E., Gagné, É.V.: The use of bibliometrics in the social sciences and humanities. (Social Sciences and Humanities Research Council of Canada (SSHRCC)). Science-Metrix, Quebec (2004). http://www.science-metrix.com/pdf/SM_2004_008_SSHRC_Bibliometrics_Social_Science.pdf
Bana e Costa, C.A., Oliveira, M.D.: A multicriteria decision analysis model for faculty evaluation. Omega 40(4), 424–436 (2012). doi:10.1016/j.omega.2011.08.006
Dahler-Larsen, P.: The Evaluation Society. Stanford University Press (2012). http://www.amazon.com/The-Evaluation-Society-Peter-Dahler-Larsen/dp/080477692X
De Bruin, R.E., Kint, A., Luwel, M., Moed, H.F.: A study of research evaluation and planning: the University of Ghent. Res. Eval. 3(1), 25–41 (1993)
Engels, T.C.E., Ossenblok, T.L.B., Spruyt, E.H.J.: Changing publication patterns in the social sciences and humanities, 2000–2009. Scientometrics 93(2), 373–390 (2012). doi:10.1007/s11192-012-0680-2
Gantman, E.R.: Economic, linguistic, and political factors in the scientific productivity of countries. Scientometrics 93(3), 967–985 (2012). doi:10.1007/s11192-012-0736-3
González-Alcaide, G., Valderrama-Zurián, J.C., Aleixandre-Benavent, R.: The impact factor in non-english-speaking countries. Scientometrics 92(2), 297–311 (2012). doi:10.1007/s11192-012-0692-y
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., Rafols, I.: Bibliometrics: The Leiden Manifesto for research metrics. Nature 520, 429–431 (2015). http://www.nature.com/news/bibliometrics-the-leiden-manifesto-for-research-metrics-1.17351
Pinto, M.J., Fernandes, S.: New questions arise: are bibliometric indicators adequate for evaluating the scientific production of the Social Sciences and Humanities? Qual. Quant. Method Libr. Spec. Issue Bibliometr. Scientometr. 161–169 (2015)
Ministry of Education, University and Research of Italy: Ministerial Decree 11th May 2011, n. 243 (2011)
Moed, H.F., Burger, W.J.M., Frankfort, J.G., Van Raan, A.F.J.: The use of bibliometric data for the measurement of university research performance. Res. Policy 14, 131–149 (1985)
Nederhof, A.J.: Bibliometric monitoring of research performance in the social sciences and the humanities: a review. Scientometrics 66(1), 81–100 (2006). doi:10.1007/s11192-006-0007-2
Van Raan, A.F.J.: Scientometrics: state-of-the-art. Scientometrics 38(1), 205–218 (1997)
Zitt, M.: Facing diversity of science: a challenge for bibliometric indicators. Meas. Interdisc. Res. Perspect. 3(1), 38–49 (2005). doi:10.1207/s15366359mea0301_6
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Pagliari, C., Mattoscio, N. (2018). Evaluation of Scientific Production Without Using Bibliometric Indicators: Decision-Making on a Priori Criteria. In: Bucciarelli, E., Chen, SH., Corchado, J. (eds) Decision Economics: In the Tradition of Herbert A. Simon's Heritage. DCAI 2017. Advances in Intelligent Systems and Computing, vol 618. Springer, Cham. https://doi.org/10.1007/978-3-319-60882-2_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-60882-2_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-60881-5
Online ISBN: 978-3-319-60882-2
eBook Packages: EngineeringEngineering (R0)