Abstract
In real-life decision analysis, whether in human-deliberated situations or non-human (real-time semi-intelligent machine/agent) situations, there are well-documented problems regarding the elicitation of probabilities, utilities, and criteria weights. In this paper, we investigate automatic multi-criteria weight-generating methods with a detailed investigation method not seen before. The results confirm that the Sum Rank method for the ordinal case, and the corresponding Cardinal Sum Rank method for the cardinal case, outperform all other methods regarding robustness. New findings include that there is no indication that the difference in the results in the weight generation is diminished as the number of degrees of freedom grows which was previously thought to be true. Further, as expected the cardinal models outperform the ordinal models. More unexpectedly, though, the performance of the dominance intensity-based weight models is at most mediocre for some combinations and not even suitable for other combinations. Another insight from the investigation in this paper is that previous literature is not homogeneous in the modelling of the attribute values, resulting in not all methods considered in this investigation can be directly compared.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aguayo, E.A., Mateos, A., Jiménez, A.: A new dominance intensity method to deal with ordinal information about a DM’s preferences within MAVT. Knowl. Based Syst. 69, 159–169 (2014)
Park, K.S.: Mathematical programming models for characterizing dominance and potential optimality when multicriteria alternative values and weights are simultaneously incomplete. IEEE Trans. Syst. Man Cybern. - Part A: Syst. Hum. 34(5), 601–614 (2004)
Larsson, A., Riabacke, M., Danielson M., Ekenberg, L.: Cardinal and rank ordering of criteria – addressing prescription within weight elicitation. Int. J. Inf. Technol. Decis. Making 13 (2014)
Danielson, M., Ekenberg, L.: Computing upper and lower bounds in interval decision trees. Eur. J. Oper. Res. 181(2), 808–816 (2007)
Danielson, M., Ekenberg, L.: An improvement to swing techniques for elicitation in MCDM methods. Knowl.-Based Syst. 168, 70–79 (2019)
Ekenberg, L., Danielson, M., Larsson, A., Sundgren, D.: Second-order risk constraints in decision analysis. Axioms 3, 31–45 (2014)
Ahn, B.S., Park, K.S.: Comparing methods for multiattribute decision making with ordinal weights. Comput. Oper. Res. 35(5), 1660–1670 (2008)
Sarabando, P., Dias, L.: Multi-attribute choice with ordinal information: a comparison of different decision rules. IEEE Trans. Syst. Man Cybern. Part A 39, 545–554 (2009)
Bana e Costa, C.A., Correa, E.C., De Corte, J.M., Vansnick, J.C.: Facilitating bid evaluation in public call for tenders: a socio-technical approach. Omega 30, 227 – 242 (2002)
Sarabando, P., Dias, L.: Simple procedures of choice in multicriteria problems without precise information about the alternatives’ values. Comput. Oper. Res. 37, 2239–2247 (2010)
Figueira, J., Roy, B.: Determining the weights of criteria in the ELECTRE type methods with a revised Simos’ procedure. Eur. J. Oper. Res. 139, 317–326 (2002)
Arbel, A., Vargas, L.G.: Preference simulation and preference programming: robustness issues in priority derivation. Eur. J. Oper. Res. 69, 200–209 (1993)
Barron, F., Barrett, B.: The efficacy of SMARTER: simple multi-attribute rating technique extended to ranking. Acta Psychol. 93(1–3), 23–36 (1996)
Barron, F., Barrett, B.: Decision quality using ranked attribute weights. Manage. Sci. 42(11), 1515–1523 (1996)
Katsikopoulos, K., Fasolo, B.: New tools for decision analysis. IEEE Trans. Syst. Man Cybern. – Part A: Syst. Hum. 36(5), 960–967 (2006)
Stewart, T.J.: Use of piecewise linear value functions in interactive multicriteria decision support: a Monte Carlo study. Manage. Sci. 39(11), 1369–1381 (1993)
Stillwell, W., Seaver, D., Edwards, W.: A comparison of weight approximation techniques in multiattribute utility decision making. Organ. Behav. Hum. Perform. 28(1), 62–77 (1981)
Barron, F.H.: Selecting a best multiattribute alternative with partial information about attribute weights. Acta Psychol. 80(1–3), 91–103 (1992)
Danielson, M., Ekenberg, L.: Rank ordering methods for multi-criteria decisions. In: Zaraté, P., Kersten, G.E., Hernández, J.E. (eds.) GDN 2014. Lecture Notes in Business Information Processing, vol. 180, pp. 128–135. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07179-4_14
Mateos, A., Jiménez-MartÃn, A., Aguayo, E.A., Sabio, P.: Dominance intensity measuring methods in MCDM with ordinal relations regarding weights. Knowl. Based Syst. 70, 26–32 (2014)
Danielson, M., Ekenberg, L.: A robustness study of state-of-the-art surrogate weights for MCDM. Group Decis. Negot. 26(4), 677–691 (2016). https://doi.org/10.1007/s10726-016-9494-6
Jia, J., Fischer, G.W., Dyer, J.S.: Attribute weighting methods and decision quality in the presence of response error: a simulation study. J. Behav. Decis. Making 11(2), 85–105 (1998)
Acknowledgement
This paper is dedicated to the co-author, dear friend, and esteemed colleague Professor Love Ekenberg, who passed away in September 2022 during the research and writing leading up to the paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lakmayer, S., Danielson, M., Ekenberg, L. (2023). Automatically Generated Weight Methods for Human and Machine Decision-Making. In: Fujita, H., Wang, Y., Xiao, Y., Moonis, A. (eds) Advances and Trends in Artificial Intelligence. Theory and Applications. IEA/AIE 2023. Lecture Notes in Computer Science(), vol 13925. Springer, Cham. https://doi.org/10.1007/978-3-031-36819-6_17
Download citation
DOI: https://doi.org/10.1007/978-3-031-36819-6_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-36818-9
Online ISBN: 978-3-031-36819-6
eBook Packages: Computer ScienceComputer Science (R0)