Abstract
A common way to model decision maker (DM) preferences in multiple criteria decision making problems is through the use of utility functions. The elicitation of the parameters of these functions is a major task that directly affects the validity and practical value of the decision making process. This paper proposes a novel Bayesian method that estimates the weights of criteria in linear additive utility functions by asking the DM to rank or select the best alternative in groups of decision alternatives. Our method computes the entire probability distribution of weights and utility predictions based on the DM’s answers. Therefore, it enables the DM to estimate the expected value of weights and predictions, and the uncertainty regarding these values. Additionally, the proposed method can estimate the weights by asking the DM to evaluate few groups of decision alternatives since it can incorporate various types of inputs from the DM in the form of rankings, constraints and prior distributions. Our method successfully estimates criteria weights in two case studies about financial investment and university ranking decisions. Increasing the variety of inputs, such as using both ranking of decision alternatives and constraints on the importance of criteria, enables our method to compute more accurate estimations with fewer inputs from the DM.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Agena Ltd. (2018). AgenaRisk: Bayesian network and simulation software for risk analysis and decision support. http://www.agenarisk.com/. Accessed 18 January 2018.
Ahn, B. S., & Park, K. S. (2008). Comparing methods for multiattribute decision making with ordinal weights. Computers and Operations Research, 35(5), 1660–1670. https://doi.org/10.1016/j.cor.2006.09.026.
Angilella, S., Greco, S., Lamantia, F., & Matarazzo, B. (2004). Assessing non-additive utility for multicriteria decision aid. European Journal of Operational Research, 158(3), 734–744. https://doi.org/10.1016/s0377-2217(03)00388-6.
Belton, V., & Stewart, T. J. (2002). Multiple criteria decision analysis: An integrated approach. Boston: Kluwer.
Benabbou, N., Gonzales, C., Perny, P., & Viappiani, P. (2015). Minimax regret approaches for preference elicitation with rank-dependent aggregators. European Journal on Decision Processes. https://doi.org/10.1007/s40070-015-0040-6.
Branke, J., Corrente, S., Greco, S., & Gutjahr, W. J. (2015). Using indifference information in robust ordinal regression. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9019, 205–217. https://doi.org/10.1007/978-3-319-15892-1_14.
Branke, J., Corrente, S., Greco, S., & Gutjahr, W. (2017). Efficient pairwise preference elicitation allowing for indifference. Computers and Operations Research, 88, 175–186. https://doi.org/10.1016/j.cor.2017.06.020.
Casella, G., & George, E. I. (1992). Explaining the Gibbs sampler. The American Statistician, 46(3), 167. https://doi.org/10.2307/2685208.
Chajewska, U., & Koller, D. (2000). Utilities as random variables: Density estimation and structure discovery. In Proceedings of the 16th annual conference on uncertainty in artificial intelligence (UAI-00) (pp. 63–71). Stanford, CA.
Chajewska, U., Koller, D., & Parr, R. (2000). Making rational decisions using adaptive utility elicitation. In Proceedings of the 17th national conference on artificial intelligence (AAAI-00) (pp. 363–369). Austin, TX.
Chinneck, J. W. (2008). Feasibility and infeasibility in optimization: Algorithms and computational methods. New York: Springer.
Curtis, S. M., Goldin, I., & Evangelou, E. (2017). Mcmcplots: Create plots from MCMC output. https://cran.r-project.org/web/packages/mcmcplots/. Accessed 25 January 2018.
Delcroix, V., Sedki, K., & Lepoutre, F. X. (2013). A Bayesian network for recurrent multi-criteria and multi-attribute decision problems: Choosing a manual wheelchair. Expert Systems with Applications, 40(7), 2541–2551. https://doi.org/10.1016/j.eswa.2012.10.065.
Dorner, S., Shi, J., & Swayne, D. (2007). Multi-objective modelling and decision support using a Bayesian network approximation to a non-point source pollution model. Environmental Modelling and Software, 22(2), 211–222. https://doi.org/10.1016/j.envsoft.2005.07.020.
Doumpos, M., & Zopounidis, C. (2002). Multicriteria decision aid classification methods. Dordrecht: Kluwer.
Fenton, N., & Neil, M. (2001). Making decisions: Using Bayesian nets and MCDA. Knowledge-Based Systems, 14(7), 307–325. https://doi.org/10.1016/s0950-7051(00)00071-x.
Fenton, N., & Neil, M. (2014). Decision support software for probabilistic risk assessment using Bayesian networks. IEEE Software, 31(2), 21–26. https://doi.org/10.1109/ms.2014.32.
Fishburn, P. C. (1967). Methods of estimating additive utilities. Management Science, 13(7), 435–453. https://doi.org/10.1287/mnsc.13.7.435.
French, S., Maule, J., & Papamichail, N. (2009). Decision behaviour, analysis and support. Cambridge: Cambridge University Press.
Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2013). Bayesian data analysis (3rd ed.). Boca Raton, FL: CRC Press.
Greco, S., Ehrgott, M., & Figueira, J. R. (2016). Multiple criteria decision analysis: State of the art surveys. Berlin: Springer.
Greco, S., Mousseau, V., & Słowiński, R. (2008). Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions. European Journal of Operational Research, 191(2), 415–435. https://doi.org/10.1016/j.ejor.2007.08.013.
Guo, S., & Sanner, S. (2010). Multiattribute Bayesian preference elicitation with pairwise comparison queries. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 6063 LNCS(PART 1), 396–403. https://doi.org/10.1007/978-3-642-13278-0_51.
Haimes, Y. Y., Lasdon, L. S., & Wismer, D. A. (1971). On a bicriterion formulation of the problems of integrated system identification and system optimization. IEEE Journals and Magazines, 1(3), 296–297. https://doi.org/10.1109/tsmc.1971.4308298.
Hasting, W. (1970). Monte Carlo sampling methods using Markov Chains and their applications. Biometrika, 57(1), 97–109.
Jacquet-Lagrèze, E., & Siskos, Y. (1982). Assessing a set of additive utility functions for multicriteria decision-making, the UTA method. European Journal of Operational Research, 10(2), 151–164. https://doi.org/10.1016/0377-2217(82)90155-2.
Kadziński, M., & Tervonen, T. (2013). Robust multi-criteria ranking with additive value models and holistic pair-wise preference statements. European Journal of Operational Research, 228(1), 169–180. https://doi.org/10.1016/j.ejor.2013.01.022.
Keeney, R. L., & Raiffa, H. (1993). Decisions with multiple objectives: Preferences and value tradeoffs. Cambridge: Cambridge University Press.
Keeney, R. L., See, K. E., & von Winterfeldt, D. (2006). Evaluating academic programs: With applications to US graduate decision science programs. Operations Research, 54(5), 813–828. https://doi.org/10.1287/opre.1060.0328.
Koksalan, M., & Tuncer Sakar, C. (2016). An interactive approach to stochastic programming-based portfolio optimization. Annals of Operations Research, 245, 47–66. https://doi.org/10.1007/s10479-014-1719-y.
Korb, K. B., & Nicholson, A. E. (2010). Bayesian artificial intelligence. Boca Raton, FL: CRC Press.
Marichal, J. L., & Roubens, M. (2000). Determination of weights of interacting criteria from a reference set. European Journal of Operational Research, 124(3), 641–650. https://doi.org/10.1016/s0377-2217(99)00182-4.
Mousseau, V., Figueira, J., Dias, L., Gomes da Silva, C., & Clímaco, J. (2003). Resolving inconsistencies among constraints on the parameters of an MCDA model. European Journal of Operational Research, 147(1), 72–93. https://doi.org/10.1016/s0377-2217(02)00233-3.
Pekelman, D., & Sen, S. K. (1974). Mathematical programming models for the determination of attribute weights. Management Science, 20(8), 1217–1229. https://doi.org/10.1287/mnsc.20.8.1217.
Pirlot, M., & Vincke, P. (2013). Semiorders: Properties, representations, applications. Berlin: Springer.
Plummer, M. (2018). JAGS: Just another Gibbs sampler. http://mcmc-jags.sourceforge.net/. Accessed 20 November 2018.
Pomerol, J.-C., & Barba-Romero, S. (2012). Multicriterion decision in management: Principles and practice (Vol. 25). Berlin: Springer.
Rockafellar, R. T., & Uryasev, S. (2000). Optimization of conditional value-at-risk. Journal of Risk, 2(3), 21–41. https://doi.org/10.2307/1165345.
Rockafellar, R. T., & Uryasev, S. (2002). Conditional value-at-risk for general loss distributions. Journal of Banking and Finance, 26(7), 1443–1471. https://doi.org/10.1016/s0378-4266(02)00271-6.
Saaty, T. L. (2008). Decision making with the analytic hierarchy process. International Journal of Services Sciences, 1(1), 83–98. https://doi.org/10.1504/ijssci.2008.017590.
Salo, A. A., & Hämäläinen, R. P. (2001). Preference ratios in multiattribute evaluation (PRIME)-elicitation and decision procedures under incomplete information. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans, 31(6), 533–545. https://doi.org/10.1109/3468.983411.
Sarabando, P., & Dias, L. C. (2010). Simple procedures of choice in multicriteria problems without precise information about the alternatives’ values. Computers and Operations Research, 37(12), 2239–2247. https://doi.org/10.1016/j.cor.2010.03.014.
Sedki, K., Delcroix, V., & Lepoutre, F. X. (2010). Bayesian network model for decision problems. In Intelligent information systems. new approaches (pp. 285–298). http://iis.ipipan.waw.pl/2010/proceedings/iis10-31.pdf.
Siskos, Y., Grigoroudis, E., & Matsatsinis, N. F. (2016). UTA methods. In S. Greco, M. Ehrgott, & J. Figueira (Eds.), Multiple criteria decision analysis. International series in operations research & management science (Vol. 233, pp. 315–362). New York, NY: Springer.
Siskos, Y., & Yannacopoulos, D. (1985). UTASTAR: An ordinal regression method for building additive value functions. Investigação Operacional, 5(1), 39–53.
Steuer, R. E. (1986). Multiple criteria optimization: Theory, computation, and applications. London: Wiley.
Su, U., & Yajima, M. (2015). R2jags: Using R to run “JAGS.” R packages. http://cran.r-project.org/package=R2jags.
Times Higher Education. (2015). World university rankings 2015–2016 methodology. https://www.timeshighereducation.com/news/ranking-methodology-2016. Accessed 5 August 2017.
Tuncer Sakar, C., & Koksalan, M. (2014). Effects of multiple criteria on portfolio optimization. International Journal of Information Technology and Decision Making, 13(01), 77–99. https://doi.org/10.1142/s0219622014500047.
Wakker, P. P. (1989). Additive representations of preferences: A new foundation of decision analysis. Berlin: Springer.
Watthayu, W., & Peng, Y. (2004). A Bayesian network based framework for multi-criteria decision making. In Proceedings of the 17th international conference on multiple criteria decision analysis. Whistler, BC.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Yet, B., Tuncer Şakar, C. Estimating criteria weight distributions in multiple criteria decision making: a Bayesian approach. Ann Oper Res 293, 495–519 (2020). https://doi.org/10.1007/s10479-019-03313-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10479-019-03313-z