Abstract
We investigate the accuracy of parameters in the Logic Scoring of Preference (LSP) criterion functions for system evaluation. Main parameters are weights and conjunction/disjunction degrees (andness/orness). Weights reflect the level of relative importance of various decision variables. Andness/orness describes a desired level of simultaneity/replaceability in satisfying component criteria. These parameters are assessed by one or more professional evaluators and their values differ from (usually unknown) optimum values. In this paper we identify all potential sources of errors in LSP criterion functions. Our goal is to investigate the distribution of errors, their average values, and the quality of individual evaluators and their teams.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barron, F.H., Barrett, B.E.: The efficacy of SMART – Simple Multi- Attribute Rating Technique Extended to Ranking. Acta Psychologica 93, 23–36 (1996)
Belton, V., Stewart, T.J.: Multiple Criteria Decision Analysis: an Integrated Approach. Kluwer Academic Publishers, Dordrecht (2002)
Bottomley, P.A., Doyle, J.R.: A Comparison of Three Weight Elicitation Methods: Good, Better, and Best. Omega 29, 553–560 (2001)
Butler, J., Jia, J., Dyer, J.: Simulation Techniques for the Sensitivity Analysis of Multi- Criteria Decision Models. European Journal of Operational Research 103, 531–546 (1997)
Dujmović, J.J.: Correlational Aspects of Error Compensation in the Weighted Scoring Method for Selection of Data Processing Systems (In Serbo-Croatian). In: Proceedings of the 7th Informatica Conference (1972)
Dujmović, J.J.: A Generalization of Some Functions in Continuous Mathematical Logic (In Serbo-Croatian) .In: Proceedings of the Informatica Conference, Bled, Yugoslavia (1973)
Dujmović, J.J.: Mixed Averaging by Levels (MAL)–A System and Computer Evaluation Method (In Serbo-Croatian) .In: Proceedings of the Informatica Conference, Bled, Yugoslavia (1973)
Dujmović, J.: Weighted Conjunctive and Disjunctive Means and their Application in System Evaluation. Journal of the University of Belgrade, EE Dept., Series Mathematics and Physics 483, 147–158 (1974)
Dujmović, J.J.: Extended Continuous Logic and the Theory of Complex Criteria. Journal of the University of Belgrade, EE Dept., Series Mathematics and Physics 537, 197–216 (1975)
Dujmović, J.J.: Partial Absorption Function. Journal of the University of Belgrade, EE Dept., Series Mathematics and Physics 659, 156–163 (1980)
Dujmović, J.J., Elnicki, R.: A DMS Cost/Benefit Decision Model: Mathematical Models for Data Management System Evaluation, Comparison, and Selection. National Bureau of Standards, Washington D.C., No. GCR 82-374. NTIS No. PB 82-170150, p.150 (1982)
Dujmović, J.J.: Preferential Neural. In: Antognetti, P., Milutinović, V. (eds.) Neural Networks - Concepts, Applications, and Implementations. Prentice-Hall Advanced Reference Series, vol. . II,ch.7, pp. 155–206. Prentice-Hall, Englewood Cliffs (1991)
Filev, D.P., Yager, R.R.: On the Issue of Obtaining OWA Operator Weights. Fuzzy Sets and Systems 94, 157–169 (1998)
Gilb, T.: Software Metrics. Winthrop Publishers (1977)
Jessop, A.: Sensitivity and Robustness in Selection Problems. Computers & Operations Research 31, 607–622 (2004)
Martin, R.A., Morrison, S.A.: A Software Quality Assessment Methodology for Evaluating System Lifecycle Risks. MITRE Corporation (January 1994)
Miller, G.A.: The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. The Psychological Review 63, 81–97 (1956)
Roberts, R., Goodwin, P.: Weight Approximations in Multi-attribute Decision Models. Journal of Multi-Criteria Decision Analysis 11, 291–303 (2002)
Rouder, J.N., Morey, R.D., Cowan, N., Pfalz, M.: Learning in Unidimensional Absolute Identification (2004), http://www.missouri.edu/p~cl/papers/learnline.pdf
Scharf(Gilb), T.: Weighted Ranking by Levels. IAG Journal 2(2), 7–18 (1969)
Scharf (Gilb), T.: Weighted Ranking by Levels Computer Evaluation Method – One Year of Experience. IAG Journal 3(3), 71–91 (1970)
Stewart, T.J.: Robustness of Additive Value Function Methods in MCDM. Journal of Multi-Criteria Decision Analysis 5, 301–309 (1996)
Su, S.Y.W., Dujmovič, J.J., Batory, D.S., Navathe, S.B., Elnicki, R.: A Cost-Benefit Decision Model: Analysis, Comparison, and Selection of Data Management Systems. ACM Transactions on Database Systems 12(3), 472–520 (1987)
Torra, V.: Learning Weights for the Quasi-Weighted Mean. IEEE Trans. on Fuzzy Systems 10(5), 653–666 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dujmović, J.J., Fang, W.Y. (2004). An Empirical Analysis of Assessment Errors for Weights and Andness in LSP Criteria. In: Torra, V., Narukawa, Y. (eds) Modeling Decisions for Artificial Intelligence. MDAI 2004. Lecture Notes in Computer Science(), vol 3131. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27774-3_14
Download citation
DOI: https://doi.org/10.1007/978-3-540-27774-3_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22555-3
Online ISBN: 978-3-540-27774-3
eBook Packages: Springer Book Archive