Abstract
The accuracy of interdisciplinarity measurements depends on how well the data is used for this purpose and whether it can meaningfully inform about work that crosses disciplinary domains. At present, there are no ad hoc databases compiling information only and exclusively about interdisciplinary research, and those interested in assessing it have to reach out to existing databases that have been compiled for other purposes. Karlovčec and Mladenić (Scientometrics 102:433–454, 2015) saw an opportunity in a national database that brings together information meant to be used for assessing the scientific performance of the Slovene academic community, which they used to obtain information that was then applied to measure interdisciplinarity. However, the context and purpose for which databases are produced have certain implications on their use. In their study, the authors overlooked the social and political context within which that specific database was created, is maintained and is used for (evaluation of research performance). This resulted in an incomplete interpretation of the results obtained and description of the current situation. This commentary addresses two aspects that warrant further consideration: one pertains to the limitations of the dataset itself and the measures used to debunk these, while the second pertains to the line of reasoning behind the integration and use of IDR measures in this study.
This is a preview of subscription content, log in via an institution to check access.
Notes
SICRIS was set up around 1998. It consists of data summarizing profiles of researchers registered at the SRA, their individual research results and projects that were funded by the SRA (Demšar and Boh 2008). The English version of SICRIS is accessible at this link http://www.sicris.si/public/jqm/cris.aspx?lang=eng&opdescr=home.
The article by Demšar and Boh (2008) is written in Slovene language. I have translated this extract, appearing on page 96, into English to the best of my knowledge.
This is the form to be completed for registration: http://www.arrs.gov.si/sl/evidreg/evid/gradivo/obrazci/16/podatki-raziskovalec-prva-zaposlitev-2016.asp.
References
Čadež, S., Dimovski, V., & Okorn, K. (2013). Raziskovalna produktivnost in ustvarjanje znanja v slovenskih ekonomsko-poslovnih šolah. Eonomic and Business Review, 15(2), 75–96.
Demšar, F., & Boh, T. (2008). Uvajanje načel transparentnost v delo javne uprave: Primer Javne agencije za raziskovalno dejavnost Republike Slovenije. Družboslovne Razprave, XXIV(58), 89–105.
Ferligoj, A., Kronegger, L., Mali, F., Snijders, T. B., & Doreian, P. (2015). Scientific collaboration dynamics in a national scientific system. Scientometrics, 104, 985–1012.
Good, B., Vermeulen, N., Tiefenthaler, B., & Arnold, E. (2015). Counting quality? The Czech performance-based research funding system. Research Evaluation, 24, 91–105.
Južnič, P., Pečlin, S., Žaucer, M., Mandelj, T., Pušnik, M., & Demšar, F. (2010). Scientometric indicators: Peer-review, bibliometric methods and conflict of interests. Scientometrics, 85, 429–441.
Karlovčec, M., & Mladenić, D. (2015). Interdisciplinarity of scientific fields and its evolution based on graph of project collaboration and co-authoring. Scientometrics, 102, 433–454.
Kojima, T., & Patrick Barron, J. (2016). Potentially dangerous mistakes in publication ethics: Unethical authorship. The Japanese Society of Gastroenterological Surgery, 49, 469–471.
Kronegger, L., Ferligoj, A., & Doreian, P. (2011). On the dynamics of national scientific systems. Quality and Quantity, 45, 989–1015.
Kronegger, L., Mali, F., Ferligoj, A., & Doreian, P. (2012). Collaboration structures in Slovenian scientific communities. Scientometrics, 90, 631–647.
Lužar, B., Levnajić, Z., Povh, J., & Perc, M. (2014). Community structure and the evolution of interdisciplinarity in slovenia’s scientific collaboration network. PLoS One, 9, e94429.
Mali, F. (2013). Why an unbiased external evaluation system is important for the progress of social sciences: The case of a small social science community. Social Sciences, 2, 284.
Mataković, H., Pejić Bach, M., & Radočaj Novak, I. (2013). Scientific productivity in transition countries: Trends and obstacles. Interdisciplinary Description of Complex Systems, 11(2), 174–189.
Wagner, C. S., Roessner, J. D., Bobb, K., Klein, J. T., Boyack, K. W., Keyton, J., et al. (2011). Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature. Journal of Informetrics, 5, 14–26.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Rodela, R. On the use of databases about research performance: comments on Karlovčec and Mladenić (2015) and others using the SICRIS database. Scientometrics 109, 2151–2157 (2016). https://doi.org/10.1007/s11192-016-2073-4
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-016-2073-4