Framework for evaluation and validation of software complexity measures
Framework for evaluation and validation of software complexity measures
- Author(s): S. Misra ; I. Akman ; R. Colomo-Palacios
- DOI: 10.1049/iet-sen.2011.0206
For access to this article, please select a purchase option:
Buy article PDF
Buy Knowledge Pack
IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.
Thank you
Your recommendation has been sent to your librarian.
- Author(s): S. Misra 1 ; I. Akman 1 ; R. Colomo-Palacios 2
-
-
View affiliations
-
Affiliations:
1: Department of Computer Engineering, Atilim University, Ankara, Turkey
2: Computer Science Department, Universidad Carlos III de Madrid, Madrid, Spain
-
Affiliations:
1: Department of Computer Engineering, Atilim University, Ankara, Turkey
- Source:
Volume 6, Issue 4,
August 2012,
p.
323 – 334
DOI: 10.1049/iet-sen.2011.0206 , Print ISSN 1751-8806, Online ISSN 1751-8814
This study proposes a framework for the evaluation and validation of software complexity measure. This framework is designed to analyse whether or not software metric qualifies as a measure from different perspectives. Unlike existing frameworks, it takes into account the practical usefulness of the measure and includes all the factors that are important for theoretical and empirical validation including measurement theory. The applicability of the framework is tested by using cognitive functional size measure. The testing process shows that in the same manner the proposed framework can be applied to any software measure. A comparative study with other frameworks has also been performed. The results reflect that the present framework is a better representation of most of the parameters that are required to evaluate and validate a new complexity measure.
Inspec keywords: software quality; computational complexity
Other keywords:
Subjects: Software engineering techniques; Computational complexity
References
-
-
1)
- S.S. Brilliant , J.C. Kinght . Empirical research in software engineering. ACM SIGSOFT Softw. Eng. Notes , 3 , 45 - 52
-
2)
- N.E. Fenton . When a software measure is not a measure. Softw. Eng. J. , 5 , 357 - 362
-
3)
- S. Misra , A.K. Misra . A proposed additional property to the Weyuker's existing properties. Int. J. Inf. Technol. Manage. , 1 , 66 - 76
-
4)
- N. Schneidewind . Methodology for validating software metrics. IEEE Trans. Softw. Eng. , 5 , 410 - 442
-
5)
- S. Misra . An approach for empirical validation process for software complexity measures. Acta Poly. Hung. , 2 , 141 - 160
-
6)
- S. Morasca . (2001) Software measurement, handbook of software engineering and knowledge engineering.
-
7)
- M. Mendonca , V. Basili . Validation of an approach for improving existing measurement frameworks. IEEE Trans. Softw. Eng. , 6 , 484 - 499
-
8)
- L.C. Briand , S. Morasca , V.R. Basily . Property based software engineering measurement. IEEE Trans. Softw. Eng. , 1 , 68 - 86
-
9)
- S. Misra . Evaluation criteria for object oriented metrics. Acta Poly. Hung. , 4 , 109 - 136
-
10)
- V.R. Basili , G. Caldiera , H.D. Rombach , J.J. Marciniak . (1994) The goal question metric paradigm, Encyclopedia of software engineering.
-
11)
- ISO/IEC: ISO/IEC 9126-3: ‘Software engineering – product quality-part 3: internal metrics’, 2002.
-
12)
- M.M. Awais , S. Shamail , Z.A. Rana . Nomenclature unification of software product measures. IET Softw. , 1 , 83 - 102
-
13)
- G. Poels , G. Dedene . Distance-based software measurement: necessary and sufficient properties for software measures. Inf. Softw. Tech. , 1 , 35 - 46
-
14)
- Misra, S., Misra, A.K.: `Evaluating cognitive complexity measure with Weyuker properties', Proc. IEEE ICCI (ICCI2004), 2004, p. 103–108.
-
15)
- B. Kitchenham , S.L. Pfleeger , N. Fenton . Towards a framework for software measurement validation. IEEE Trans. Softw. Eng. , 12 , 929 - 943
-
16)
- M.K. Daskalantonakis . A practical view of software measurement and implementation experiences within Motorola. IEEE Trans. Softw. Eng. , 11 , 998 - 1010
-
17)
- D. Baski , S. Misra . Metrics suite for maintainability of eXtensible Markup language web services. IET Softw. , 3 , 320 - 341
-
18)
- S. Mouchawrab , L.C. Briand , Y. Labiche . A measurement framework for object-oriented software testability. Inf. Softw. Tech. , 979 - 997
-
19)
- A. Gopal , T. Mukhopadhyay , M.S. Krishnan . The impact of institutional forces of software metrics programs. IEEE Trans. Softw. Eng. , 8 , 679 - 694
-
20)
- M. Serrano , J. Trujillo , C. Calero , M. Piattini . Metrics for data warehouse conceptual models understandability. Inf. Softw. Technol. , 8 , 851 - 870
-
21)
- M. Piattini , C. Calero , M. Genero . Table oriented metrics for relational databases. Softw. Qual. J. , 79 - 97
-
22)
- M.H. Halstead . (1977) Elements of software science.
-
23)
- V. Basili . The role of controlled experiments in software engineering research, empirical software engineering issues. Lect. Notes Comput. Sci. , 33 - 37
-
24)
- Kaner, C.: `Software engineering metrics: what do they measure and how do we know’?', Proc. Tenth Int. Software Metrics Symp. Metrics, 2004, p. 1–10.
-
25)
- ISO/IEC: ISO/IEC 9126-4: ‘Software engineering – product quality-part 4: quality in use metrics’, 2002.
-
26)
- V. Gupta , J.K. Chhabra . Package coupling measurement in object-oriented software. J. Comp. Sci. Technol. , 2 , 273 - 283
-
27)
- H.A. Zuse . (1998) Framework of software measurement.
-
28)
- D. Robertas , Š. Vytautas . Metrics for evaluation of metaprogram complexity. J. Comp. Inf. Sci. , 4 , 769 - 787
-
29)
- S.G. Stockhome , A.R. Todd , G.A. Robinson . A framework for software quality measurement. IEEE J. Sel. Areas Commun. , 2 , 224 - 233
-
30)
- R. Wiener , L.J. Pinson . (2000) Fundamentals of OOP and data structures in Java.
-
31)
- Calero, C., Piattini, M., Genero, M.: `Method for obtaining correct metrics', Proc. Third Int. Conf. Enterprise and Information Systems (ICEIS’2001), 2001, p. 779–784.
-
32)
- B.A. Kitchenham , S.L. Pfleeger , L.M. Pickard . Preliminary guidelines for empirical research in software engineering. IEEE Trans. Softw. Engng. , 8 , 721 - 734
-
33)
- L. Briand , E.K. Emam , S. Morasca . On the application of measurement theory in software engineering. J. Empirical Softw. Eng. , 1 , 61 - 88
-
34)
- ISO, IS0 15939:2002: ‘Information technology – software engineering – software measurement process’, International Organization for Standardization, Geneva, 2002.
-
35)
- ISO/IEC: ISO/IEC 9126-2: ‘Software engineering – product quality-part 2: external metrics’, 2002.
-
36)
- IEEE Computer Society: ‘Standard for software quality metrics methodology’. Revision IEEE Standard 1061–1998, 1998.
-
37)
- ISO/IEC: ISO/IEC 9126-1: ‘Software engineering – product quality-part 1: quality model’, 2001.
-
38)
- M.V. Zelkowitz , D.R. Wallace . Experimental models for validating technology. IEEE Comput. , 5 , 23 - 31
-
39)
- T. Hall , N. Fenton . Implementing effective software metrics programs. IEEE Softw. , 2 , 55 - 65
-
40)
- Bégnoche, L., Abran, A., Buglione, L.: `A measurement approach integrating ISO 15939, CMMI and ISBSG', Proc. Fourth Software Measurement European Forum (SMEF), 2007, Rome, p. 1–19.
-
41)
- N. Zazworka , V. Basili , M.V. Zelkowitz . An environment for conducting families of software engineering experiments. Adv. Comput. , 175 - 200
-
42)
- S. Misra . Cognitive complexity measures: an analysis. Modern Softw. Eng. Concepts Pract.: Adv. Appr. , 263 - 279
-
43)
- S. Misra . Measuring cognitive functional size measure. Int. J. Softw. Sci. Comp. Intell. , 2 , 91 - 100
-
44)
- T.J. McCabe . A complexity measure. IEEE Trans. Softw. Eng. , 4 , 308 - 320
-
45)
- E. Weyuker . Evaluating software complexity measures. IEEE Trans. Softw. Eng. , 1357 - 1365
-
46)
- H. Zuse . Properties of software measures. Softw. Qual. J. , 225 - 260
-
47)
- Y. Wang , J. Shao . A new measure of software complexity based on cognitive weights. Can. J. Electr. Comput. Eng. , 2 , 69 - 74
-
48)
- N.E. Fenton . Software metrics: success, failure and new directions. J. Syst. Softw. , 23 , 149 - 157
-
49)
- R. Pressman . (2001) Software engineering: a practitioner's approach.
-
50)
- S. Misra , H. Kilic . Measurement theory and validation criteria for software complexity measure. ACM SIGSOFT Softw. Eng. Notes , 6 , 1 - 3
-
51)
- N.E. Fenton , S.L. Pfleeger . (1998) Software metrics: a rigorous and practical approach.
-
52)
- A. Gopal , T. Mukhopadhyay , M.S. Krishnan , D.R. Goldenson . Measurement programs in software development: determinants of success. IEEE Trans. Softw. Eng. , 9 , 863 - 875
-
53)
- G. Cantone , P. Donzelli . Production and maintenance of software measurement models. J. Softw. Eng. Knowl. Eng. , 605 - 626
-
54)
- L. Briand , S. Morasca , V.R. Basili . An operation process for goal-driven definition of measures. IEEE Trans. Softw. Eng. , 2 , 1106 - 1125
-
55)
- Lake, A.: `Use of factor analysis to develop OOP software complexity metric', Proc. Annual Oregon Workshop on Software Metrics, 1994, p. 1–15.
-
56)
- IEEE Computer Society: ‘IEEE standard glossary of software engineering terminology’, IEEE Std. 610.12–1990, 1990.
-
1)