Maurizio Morisio
ABSTRACT
Software artifacts are characterised by many attributes, each one in its turn can be measured by one or more measures. In several cases the software artifact has to be evaluated as a whole, thus raising the problem of aggregating measures to give an overall, single view on the artifact.This paper presents a method to aggregate measures, that works comparing the artifact with predefined, ideal artifacts, or profiles. Profiles are defined starting fromranges of values on measures of attributes. The method is based on two main phases, namely definition of the evaluation model and application of the evaluation model, and is presented in a simplified case study that deals with evaluating the level of quality of an asset to decide if accepting it in a reuse repository. The advantages of the method are that it allows using ordinal scales, while it deals explicitly with preferences expressed, implicitly or explicitly, by the evaluator.
- Basili V. B., Rombach H. D.(1988). The TAME Project: Towards Improvement-Oriented Software Environments, IEEE Transactions on software engineering, 14,6 (June 88 758-773.Google Scholar
- Blin M. J., Tsoukiàs A., "Evaluation of COTS using multi-criteria methodology", in Proceedings of the 6th European Conference on Software Quality (1999) 429 - 438.Google Scholar
- Blin M. J., Tsoukiàs A. Multicriteria Methodology Contribution to the SoftwareQuality Evaluation, Software Quality Journal 9,2 (June 2001) 113-132. Google ScholarDigital Library
- Bouyssou D., Marchant Th., Perny P., Pirlot M., Tsoukias A., Vincke Ph., Evaluation and Decision Models: a critical perspective, Kluwer Academic, Dordrecht (2000).Google Scholar
- ISO/IEC JTC1, International Standard 9126 Information Technology - Software Product Evaluation - Quality Characteristics and Guidelines for their Use (1991) Geneva.Google Scholar
- Karlsson, E. A. Software Reuse. John Wiley & Sons (1995).Google Scholar
- Kitchenham, B. Towards a constructive quality model. Part 1: software quality modeling,measurement and prediction. Software Engineering Journal (July 1987) 105-113. Google ScholarDigital Library
- Kontio, J. A Case Study in Applying a Systematic Method for COTS Selection, in Proceedings of the 18th Int. Conf. on Software Engineering (1996) 201-209. Google ScholarDigital Library
- Morisio, M., Tsoukiàs, A. IusWare: A methodology for the evaluation and selection of software products. IEE Proceedings Software Engineering (June 1997) 162-174.Google Scholar
- Paschetta E., Tsoukiàs A., "A real world MCDA application: evaluating software", Journal of Multi-Criteria Decision Analysis, 9 (2000) 205 - 226.Google ScholarCross Ref
- Roubens M., Vincke, Ph. Preference Modeling, LNEMS 250, Springer Verlag (1985).Google Scholar
- Saaty, T. The analytic hierarchy process. Mc Graw Hill, NY (1980).Google Scholar
- Stamelos, I., Tsoukias, A. Software Evaluation Problem Situations. Cahier du LAMSADE, No 156, Université Paris Dauphine, to appear in European Journal of Operational Research.Google Scholar
- Stamelos I., Vlahavas I.,Refanidis I., Tsoukiàs A., "Knowledge Based Evaluation of Software Systems: a case study", Information and Software Technology, 42 (2000) 333-345.Google ScholarCross Ref
- Vincke, Ph. Multicriteria Decision Aid. John Wiley (1992).Google Scholar
- Vlahavas I., Refanidis I., Stamelos I., Tsoukiàs A., "ESSE: an expert system for software evaluation", Journal of Knowledge Based Systems, 12 (1999) 183 - 197.Google ScholarDigital Library
- Yu, W. Aide multicritere a la decision dans le cadre de la problematique du tri: methodes et applications LAMSADE, Universite Paris Dauphine, Paris (1992).Google Scholar
Index Terms
- A new method to evaluate software artifacts against predefined profiles
Recommendations
Evaluating and selecting software packages: A review
Evaluating and selecting software packages that meet an organization's requirements is a difficult software engineering process. Selection of a wrong software package can turn out to be costly and adversely affect business processes. The aim of this ...
On Pairwise Comparisons Based Internal and External Measures for Software Evaluation
WETICE '13: Proceedings of the 2013 Workshops on Enabling Technologies: Infrastructure for Collaborative EnterprisesWe show how pairwise comparisons paradigm can be used to improve many current methods of software evaluation. Most of software metrics lack formal analysis of weights consistency, while inconsistency analysis is the crucial part of all decision making ...
A method for software evaluation contribution of the European project SCOPE to international standards
Special issue: German National Research Center for computer science (GMD)
Comments