Abstract
We analyze the reliability of results obtained using the Logic Scoring of Preference (LSP) method for evaluation and comparison of complex systems. For each pair of competitive systems our goal is to compute the level of confidence in system ranking. The confidence is defined as the probability that the system ranking remains unchanged regardless of the criterion function parameter errors. We propose a simulation technique for the analysis of the reliability of ranking. The simulator is based on specific models for selection of random weights and random degrees of andness/orness. The proposed method is illustrated by a real life case study that investigates the reliability of evaluation and selection of a mainframe computer system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barron, F.H., Barrett, B.E.: The efficacy of SMART – Simple Multi-Attribute Rating Technique Extended to Ranking. Acta Psychologica 93, 23–36 (1996)
Belton, V., Stewart, T.J.: Multiple Criteria Decision Analysis: an Integrated Approach. Kluwer Academic Publishers, Dordrecht (2002)
Bottomley, P.A., Doyle, J.R.: A Comparison of Three Weight Elicitation Methods: Good, Better, and Best. Omega 29, 553–560 (2001)
Butler, J., Jia, J., Dyer, J.: Simulation Techniques for the Sensitivity Analysis of Multi- Criteria Decision Models. European Journal of Operational Research 103, 531–546 (1997)
Dujmović, J.J.: Extended Continuous Logic and the Theory of Complex Criteria. Journal of the University of Belgrade, EE Dept., Series Mathematics and Physics 537, 197–216 (1975)
Dujmović, J.J., Elnicki, R.: A DMS Cost/Benefit Decision Model: Mathematical Models for Data Management System Evaluation, Comparison, and Selection. National Bureau of Standards, Washington D.C., No. GCR 82-374. NTIS No. PB 82-170150, p.150 (1982)
Dujmović, J.J.: Preferential Neural Networks. In: Antognetti, P., Milutinović, V. (eds.) Neural Networks - Concepts, Applications, and Implementations. Prentice-Hall Advanced Reference Series, vol. II,ch.7, pp. 155–206. Prentice-Hall, Englewood Cliffs (1991)
Dujmović, J.J., Fang, W.Y.: An Empirical Analysis of Assessment Errors for Weights and Andness in LSP Criteria. This Proceedings (2004)
Fang, W.Y.: Analysis of Reliability of LSP Criteria. MS Thesis. San Francisco State University (2004)
Roberts, R., Goodwin, P.: Weight Approximations in Multi-attribute Decision Models. Journal of Multi-Criteria Decision Analysis 11, 291–303 (2002)
Stewart, T.J.: Robustness of Additive Value Function Methods in MCDM. Journal of Multi-Criteria Decision Analysis 5, 301–309 (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dujmović, J.J., Fang, W.Y. (2004). Reliability of LSP Criteria. In: Torra, V., Narukawa, Y. (eds) Modeling Decisions for Artificial Intelligence. MDAI 2004. Lecture Notes in Computer Science(), vol 3131. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27774-3_15
Download citation
DOI: https://doi.org/10.1007/978-3-540-27774-3_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22555-3
Online ISBN: 978-3-540-27774-3
eBook Packages: Springer Book Archive