Abstract
This paper, employing the multicriteria method of decision support MACBETH, proposes a model for the evaluation of interdisciplinary graduate programs, based on indicators already used in the current model of evaluation of Brazilian graduate studies by Coordination for the Improvement of Higher Education Personnel (CAPES). In the present work, ten Computational Modeling Programs were considered, and six criteria were selected to verify the performance of these programs. There is presently in Brazil a steady growth of requests for accreditation of interdisciplinary programs and a quest to evaluate them differently, given their peculiarities. The main contribution of this study is to propose an alternative methodology for the evaluation of graduate programs, respecting the characteristics of the area of knowledge in which it is inserted, which is able to rank them based on qualitative judgments and to verify how much each course can progress, according to the score established for each program in a set of criteria considered. A comparison was made with the results of the evaluation methodology used by CAPES in the year 2017, being possible to verify some similarities in the evaluations of the graduate programs by the two methods. Finally, a sensitivity analysis was performed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abtahi, M. S. (2012). The effectiveness in distance education for Iranian higher education. Procedia-Social and Behavioral Sciences. https://doi.org/10.1016/j.sbspro.2012.06.818
Andrade, G. N., Alves, L. A., Andrade, F. V. S., & Soares de Mello, J. C. C. B. (2016). Evaluation of power plants technologies using multicriteria methodology Macbeth. IEEE Latin America Transactions. https://doi.org/10.1109/tla.2016.7430079
Bana e Costa, C. A., & Chagas, M. P. (2004). A career choice problem: An example of how to use MACBETH to build a quantitative value model based on qualitative value judgments. European Journal of Operational Research. https://doi.org/10.1016/s0377-2217(03)00155-3
Bana e Costa, C. A., Corte, J. M. D., & Vansnick, J. C. (2005). M-MACBETH: Guía del usuario. Retrieved October 18, 2018, from http://m-macbeth.com/wp-content/uploads/2017/10/M-MACBETH-Users-Guide.pdf.
Bana e Costa, C. A., Corte, J. M. D., & Vansnick, J. C. (2012). MACBETH. International Journal of Information Technology and Decision Making. https://doi.org/10.1142/S0219622012400068
Bana e Costa, C. A., Lourenço, J. C., & Soares, J. O. (2007). An interval weighting assignment model for credit analysis. Journal of Financial Decision Making, 3(2), 1–9.
Bana e Costa, C. A., Meza, L. A., & Oliveira, M. D. (2013). O método MACBETH e aplicação no brasil. Engevista. https://doi.org/10.22409/engevista.v15i1.484
Bana e Costa, C. A., & Oliveira, M. D. (2012). A multi-criteria decision analysis model for faculty evaluation. Omega. https://doi.org/10.1016/j.omega.2011.08.006
Bana e Costa, C. A., & Vansnick, J. C. (1994). MACBETH—An interactive path towards the construction of cardinal value functions. International Transactions in Operational Research. https://doi.org/10.1016/0969-6016(94)90010-8
Buanes, A., & Jentoft, S. (2009). Building bridges: Institutional perspectives on interdisciplinarity. Futures. https://doi.org/10.1016/j.futures.2009.01.010
Carnero, M. C., & Gómez, A. (2016). A multicriteria decision making approach applied to improving maintenance policies in healthcare organizations. BMC Medical Informatics and Decision Making. https://doi.org/10.1186/s12911-016-0282-7
Ertay, T., Kahraman, C., & Kaya, İ. (2013). Evaluation of renewable energy alternatives using MACBETH and fuzzy AHP multicriteria methods: The case of turkey. Technological and Economic Development of Economy. https://doi.org/10.3846/20294913.2012.762950
Ferreira, F. A. F., & Santos, S. P. (2018). Two decades on the MACBETH approach: A bibliometric analysis. Annals of Operations Research. https://doi.org/10.1007/s10479-018-3083-9
Furtado, A. T. (2011). Experiência do Programa de Pós-Graduação em Política Científica e Tecnológica da Unicamp. In A. Philippi Jr. & A. J. S. Silva Neto (Eds.), Interdisciplinaridade em Ciência, Tecnologia e Inovação.Barueri: Manole.
Gomes Junior, S. F., Chaves, M. C. C., Pereira, E. R., Soares de Mello, J. C. C. B., & Lima, G. B. A. (2011). Integração de métodos multicritério na busca da sustentabilidade agrícola para a produção de tomates no município de São José de Ubá-RJ. Pesquisa Operacinal. https://doi.org/10.1590/S0101-74382011000100010
Hurson, C., Mastorakis, K., & Siskos, Y. (2012). Application of a synergy of MACBETH and MAUT multicriteria methods to portfolio selection in Athens stock exchange. International Journal of Multicriteria Decision Making. https://doi.org/10.1504/ijmcdm.2012.046939
Jacobs, J. A., & Frickel, S. (2009). Interdisciplinarity: A critical assessment. Annual Review of Sociology. https://doi.org/10.1146/annurev-soc-070308-115954
Karande, P., & Chakraborty, S. (2013). Using MACBETH method for supplier selection in manufacturing environment. International Journal of Industrial Engineering Computations. https://doi.org/10.5267/j.ijiec.2013.01.002
Keček, D., Hrustek, Ž, & Vesna, N. (2016). Application of the MACBETH method in postgraduate doctoral study selection. Proceedings in Global Virtual Conference, 4, 230–234.
Luzzi, D. A., & Philipi Jr., A. (2011). Interdisciplinaridade, pedagogia e didática da complexidade na formação superior. In A. Philippi Jr. & A. J. S. Silva Neto (Eds.), Interdisciplinaridade em Ciência, Tecnologia e Inovação. Barueri: Manole.
Madeira Junior, A. G., Cardoso Junior, M. M., Belderrain, M. C. N., Correia, A. R., & Schwanz, S. H. (2012). Multicriteria and multivariate analysis for port performance evaluation. International Journal of Production Economics, 140, 450–456. https://doi.org/10.1016/j.ijpe.2012.06.028.
Martins, F. M., Henn, J. D., de Oliveira, P. A. V., & dos Santos, J. I. (2015). Potencial de transferência para o setor produtivo de um arranjo tecnológico para tratamento de dejetos suínos e produção de composto orgânico. Revista Brasileira De Agropecuária Sustentável. https://doi.org/10.21206/rbas.v5i1.315
Soares de Mello, J. C. C. B., Gomes, E. G., Gomes, L. F. A. M., Neto, L. B., & Leta, F. R. (2003). Seleção de rota aérea com o uso do apoio multicritério à decisão. Engevista. https://doi.org/10.22409/engevista.v5i10.120
Soares de Mello, J. C. C. B., Gomes, E. G., & Lins, M. P. E. (2001). Análise multicritério da presença da Universidade Federal Fluminense com o uso do método Macbeth. Production. https://doi.org/10.1590/s0103-65132001000200004
Porter, A. L., & Rafols, I. (2009). Is science becoming more interdisciplinary? Measuring and mapping six research fields over time. Scientometrics. https://doi.org/10.1007/s11192-008-2197-2
Roy, B., & Boyssou, D. (1985). Mèthodologie Multicritère d’Aide à la Dècision. Paris: Economica.
Roy, B., & Vanderpooten, D. (1996). The European school of MCDA: Emergence, basic features and current works. Journal of Multi-Criteria Decision Analysis. https://doi.org/10.1002/(SICI)1099-1360(199603)5:1%3c22::AID-MCDA93%3e3.0.CO;2-F
Steil, A. V. (2011). Trajetória Interdisciplinar formativa e profissional na sociedade do conhecimento. In A. Philippi Jr. & A. J. S. Silva Neto (Eds.), Interdisciplinaridade em Ciência, Tecnologia e Inovação.Barueri: Manole.
Torres, B. G., Andrade, G. N., & Soares de Mello, J. C. C. B. (2016). In XLVIII Simpósio Brasileiro de Pesquisa Operacional, Universidade Federal do Espírito Santo, Vitória.
Tosun, Ö. (2017). Using MACBETH method for technology selection in production environment. American Journal of Data Mining and Knowledge Discovery, 3, 4. https://doi.org/10.11648/j.ajdmkd.20170201.15
Wassem, J., Pereira, E. M. A., & Balzan, N. C. (2015). Política de avaliação em programas de pós-graduação de excelência em educação. Atos de Pesquisa em Educação, 10(1), 215–243. https://doi.org/10.7867/1809-0354.2015v10n1p215-243.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Tavares, R.S., Angulo-Meza, L., Rangel, L.A.D. et al. Interdisciplinary graduate programs: application of the MACBETH multicriteria method for assessing their performances. Ann Oper Res 316, 1383–1399 (2022). https://doi.org/10.1007/s10479-021-04108-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10479-021-04108-x