Abstract
Given the complexity of many contemporary software systems, it is often difficult to gauge the overall quality of their underlying software components. A potential technique to automatically evaluate such qualitative attributes is to use software metrics as quantitative predictors. In this case study, an aggregation technique based on fuzzy integration is presented that combines the predicted qualitative assessments from multiple classifiers. Multiple linear classifiers are presented with randomly selected subsets of automatically generated software metrics describing components from a sophisticated biomedical data analysis system. The external reference test is a software developer’s thorough assessment of complexity, maintainability, and usability, which is used to assign corresponding quality class labels to each system component. The aggregated qualitative predictions using fuzzy integration are shown to be superior to the predictions from the respective best single classifiers.
Similar content being viewed by others
References
Chidamber SR, Kemerer CF (1994) A metrics suite for object-oriented design. IEEE Trans Softw Eng 20(6):476–493
Kitchenham BA, Hughes RT, Kinkman SG (2001) Modeling software measurement data. IEEE Trans Softw Eng 27(9):788–804
Fenton NE, Kaposi AA (1987) Metrics and software structure. Inf Softw Technol 29:301–320
Poels G, Dedene G (2000) Distance-based software measurement: necessary and sufficient properties for software measures. Inf Softw Technol 42:35–46
Weyuker EJ (1988) Evaluating software complexity measures. IEEE Trans Softw Eng 14(9):1357–1365
Reformat M, Pedrycz W, Pizzi NJ (2003) Software quality analysis with the use of computational intelligence. Inf Softw Technol 45: 405–417
Pressman RS, Pressman R (2000) Software engineering: a practitioner’s approach. McGraw Hill, New York
Lyu MR (1996) Handbook of software reliability engineering. McGraw-Hill, Toronto
Fenton NE, Pfleeger SL (1997) Software metrics: a rigorous and practical approach. PWS Publishing, Boston
Peters JF, Pedrycz W (1999) Software engineering: an engineering approach. Wiley, Hoboken
Kan SH (2002) Metrics and models in software quality engineering. Addison-Wesley, Reading
Laird LM, Brennan MC (2006) Software measurement and estimation: a practical approach. Wiley, Hoboken
Marinescu R (2001) Detecting design flaws via metrics in object-oriented system. In: International conference and exhibition on technology of object-oriented languages and systems, Santa Barbara, USA, July 29 – August 3, pp 173–182
Fowler M (1999) Refactoring: improving the design of existing code. Addison-Wesley, Reading
Halstead MH (1977) Elements of software science. Elsevier, New York
McCabe TJ (1976) A complexity metric. IEEE Trans Softw Eng 2(4):308–320
Curtis B, Sheppard S, Milliman P (1979) Third time charm: stronger prediction of programmer performance by software complexity metrics. In: IEEE proceedings of the fourth international conference on software Engineering, Munich, Germany, September 17–19, pp 356–360
Ward J (1989) Software defect prevention using McCabe’s complexity metric. Hewlett-Packard J 2:66–69
Jones C (1994) Software metrics: good, bad, and missing. Computer 27(9):98–100
Coad P, Mayfield M, Kern J (1999) Java design: building better apps & applets. Prentice Hall, Upper Saddle River
Pizzi N, Vivanco R, Somorjai R (2001) EvIdent: a functional magnetic resonance image analysis system. Artif Intell Med 21:263–269
Bezdek J, Ehrlich R, Full W (1984) FCM: the fuzzy c-means clustering algorithm. Comput Geosci 10(2):191–203
Reformat M, Pedrycz W, Pizzi N (2004) Building a software experience factory using granular-based models. Fuzzy Sets Syst 145(1): 111–139
Jung H-W, Kim S-G, Chung C-S (2004) Measuring software product quality: a survey of ISO/IEC 9126. IEEE Softw 21(5):88–92
Card D, Glass R (1990) Measuring software design quality. Prentice-Hall, Englewood Cliffs
Canfora G, Troiano L (2002) The importance of dealing with uncertainty in the evaluation of software engineering methods and tools. In: Proceedings of the 14th international conference on software engineering and knowledge engineering, Ischia, Italy, July 15–19, pp 691–698
Büyüközkan G, Kahraman C, Ruan D (2004) A fuzzy multi-criteria decision approach for software development strategy selection. Int J General Syst 33(2–3):259–280
Oliveira KM, Cerqueira A, Xexeo G, Rocha R (1999) QUAL-CORDIS: A domain-specific tool for the identification of software quality requirements using fuzzy theory. In: Proceedings of the FESMA’99, Amsterdam, Netherlands, October 4–7, pp 487–496
Sicilia MA, Cuadrado JJ, Crespo J, García-Barriocanal E (2005) Software cost estimation with fuzzy inputs: fuzzy modeling and aggregation of cost drivers. Kybernetika 41:249–264
Canfora G, Cerulo L, Troiano L (2004) Can fuzzy mathematics enrich the assessment of software maintainability?. In: Proceeding of the first international workshop on software audit and metrics, Porto, Portugal, April 13–14, pp 85–94
Huang S-J, Lin C-Y, Chiu N-H (2006) Fuzzy decision tree approach for embedding risk assessment information into software cost estimation model. J Inf Sci Eng 22:297–313
Wang J, Lin Y-I (2003) A fuzzy multicriteria group decision making approach to select configuration items for software development. Fuzzy Sets Syst 134(3):343–363
Pedrycz W, Sosnowski ZA (2001) The design of decision trees in the framework of granular data and their application to software quality models. Fuzzy Sets Syst 123(3):271–290
Sugeno A (1972) Theory of fuzzy integral and its applications. PhD Thesis, Tokyo Institute of Technology
Pizzi NJ (2005) Classification of biomedical spectra using stochastic feature selection. Neural Network World 15(3):257–268
Choquet G (1953) Theory of capacities. Annales de l’Institut Fourier 5:131–295
Murofushi T, Sugeno M (1989) An interpretation of fuzzy measure and the Choquet integral as an integral with respect to a fuzzy measure. Fuzzy Sets Syst 29:201–227
Pizzi NJ, Pedrycz W (2006) Effective classification using feature selection and fuzzy integration. Int J Approximate Reason (submitted)
Sugeno A (1977) Fuzzy measures and fuzzy integrals: a survey. In Gupta MM, Sanchez E (eds) Fuzzy automatic and decision processes. North Holland, Amsterdam pp 90–102
Klir GJ, Folger TA (1988) Fuzzy sets, uncertainty, and information. Prentice Hall, Englewood Cliffs
Grabish M, Murofushi T, Sugeno M (1992) Fuzzy measure of fuzzy events defined by fuzzy integrals. Fuzzy Sets Syst 50:293–313
Tahani H, Keller JM (1990) Information fusion in computer vision using the fuzzy integral. IEEE Trans Syst Man Cybernet 20:733–741
Chi Z, Yan H, Pham T (1996) Fuzzy algorithms: With applications to image processing and pattern recognition. World Scientific, New Jersey
Seber GAF (1984) Multivariate observations. Wiley, Hoboken
Pizzi NJ, Somorjai RL, Pedrycz W (2004) Biomedical data classification using randomized feature selection and parallelized multi-layer perceptrons. In: Proceedings of the information processing and management of uncertainty in knowledge-based systems conference, July 4–9, Perugia, Italy, pp 1161–1166
http://scopira.org. Last accessed 2006.12.30
Demko AB, Pizzi NJ, Somorjai RL (2002) Scopira—a system for the analysis of biomedical data. In: Proceedings of the IEEE canadian conference on electrical and computer engineering, May 12–15, Winnipeg, Canada, pp 1093–1098
Demko A, Vivanco RA, Pizzi NJ (2005) Scopira: An open source C++ framework for biomedical data analysis applications—a research project report. In: Companion Proceedings of OOPSLA, 17th ACM conference on object-oriented programming, systems, languages, and applications, October 16–20, San Diego, USA, pp. 138–139
Snir M, Gropp W (1998) MPI: The complete reference, 2nd edn. MIT Press, Cambridge
Troy D, Zweben S (1981) Measuring the quality of structured designs. J Syst Softw 2(2):113–120
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pizzi, N.J. Software quality prediction using fuzzy integration: a case study. Soft Comput 12, 67–76 (2008). https://doi.org/10.1007/s00500-007-0217-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-007-0217-4