Abstract
As the major concerns of the university are teaching and research, this paper describes the study of a nation-wide evaluation of research performance in management for 168 universities in Taiwan. In addition to the popular indicators of SCI/SSCI journal publications and citations, the number of projects funded by the National Science Council of Taiwan was used to account for the special characteristic of the field of management. The evaluation was based on individual professors rather than management programs, so that all types of universities, including those without management departments, could be compared. Performances of each university in those three indicators were aggregated by a set of a posteriori weights which were most favourable to all universities in calculating the aggregated score. The results show that public universities, in general, performed better than private ones. Universities with specific missions had comparable performance to general comprehensive ones. Analyses from a set of a priori weights solicited from experts showed that the results of this study are robust to the indicators selected and the weights used.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abbott, M., Doucouliagos, C. (2003), The efficiency of Australian universities: A data envelopment analysis, Economics of Education Review, 22: 89–97.
Beasley, J. E. (1990), Comparing university departments, Omega, 18: 171–183.
Bonnevie-Nebelong, E. (2006), Methods for journal evaluation: Journal citation identity, journal citation image and internationalisation, Scientometrics, 66: 411–424.
Butler, L. (2002), Identifying ‘highly-rated’ journals — An Australian case study, Scientometrics, 53: 207–227.
Diakoulaki, D., Mavrotas, G., Papayannakis, L. (1992), A multicriteria approach for evaluating the performance of industrial firms, Omega, 20: 467–474.
Gander, J. P. (1995), Academic research and teaching productivities: A case study, Technological Forecasting and Social Change, 49: 311–319.
Garcia-Aracil, A., Gracia, A. G., Perez-Marin, M. (2006), Analysis of the evaluation process of the research performance: An empirical case, Scientometrics, 67: 213–230.
Garfield, E. (1972), Citation analysis as a tool in journal evaluation, Science, 178: 471–479.
Garrett-Jones, S., Aylward, D. (2000), Some recent developments in the evaluation of university research outcomes in the United Kingdom, Research Evaluation, 9: 69–75.
Geuna, A., Martin, B. R. (2003), University research evaluation and funding: An international comparison, Minerva, 41: 277–304.
Goicoechea, A., Hansen, D. R., Duckstein, L. (1982), Multiobjective Decision Analysis with Engineering and Business Applications, Wiley, New York.
Higgins, J. C. (1989), Performance measurement in universities, European Journal of Operational Research, 38: 358–368.
Huang, M. H., Chang, H. W., Chen, D. Z. (2006), Research evaluation of research-oriented universities in Taiwan from 1993 to 2003, Scientometrics, 67: 419–435.
ISI Web of Knowledge (2004), JCR Science Edition. http://portal.isiknowledge.com/
Kao, C. (2009), The authorship and country spread of OR journals, Scientometrics, 78(3): 389–399.
Kao, C., Hung, H. T. (2003), Ranking university libraries with a posteriori weights, Libri, 53: 282–290
Kao, C., Hung, H. T. (2005), Data envelopment analysis with common weights: The compromise solution approach, Journal of the Operational Research Society, 56: 1196–1203.
Kao, C., Hung, H.T. (2008), Efficiency analysis of university departments: An empirical study, Omega, 36: 653–664.
Kao, C., Lin, Y.C. (2004), Evaluation of the university libraries in Taiwan: Total measure versus average measure, Journal of the Operational Research Society, 55: 1256–1265.
Liang, T. P., Wang, T., Lee, S. D., Lin, B. H., Chiou, J. S., Hung, S. C., Chen, S. J., Chen, J. M., Lu, J. F. R. (2004), Ranking of Management International Journals (in Chinese), NSC Research Report, Department of Information Management, National Sun Yat-Sen University, Kaohsiung, Taiwan.
Mcgrath, W. E. (1987), Ratings and rankings: Multiple comparisons of mean ratings, College and Research Libraries, 48: 169–172.
Phelan, T. J. (2000), Bibliometrics and the evaluation of Australian sociology, Journal of Sociology, 36: 345–363.
Schloegl, C., Gorraiz, J., Bart, C., Bargmann, M. (2003), Evaluating two Austrian university departments: Lessons learned, Scientometrics, 56: 287–299.
Sinuany-Stern, Z., Mehrez, A., Barboy, A. (1994), Academic departments efficiency via DEA, Computers & Operations Research, 21: 543–556.
Wallmark, J. T., Mcqueen, D. H., Sedig, K. G. (1988), Measurement of output from university research: A case study, IEEE Transactions on Engineering Management, 35: 175–180.
Zeleny, M. (1982), Multiple Criteria Decision Making, McGraw-Hill, NY.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kao, C., Pao, HL. An evaluation of research performance in management of 168 Taiwan universities. Scientometrics 78, 261–277 (2009). https://doi.org/10.1007/s11192-007-1906-6
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-007-1906-6