skip to main content
10.1145/1868328.1868353acmotherconferencesArticle/Chapter ViewAbstractPublication PagespromiseConference Proceedingsconference-collections
research-article

Defect cost flow model: a Bayesian network for predicting defect correction effort

Published: 12 September 2010 Publication History

Abstract

Background. Software defect prediction has been one of the central topics of software engineering. Predicted defect counts have been used mainly to assess software quality and estimate the defect correction effort (DCE). However, in many cases these defect counts are not good indicators for DCE. Therefore, in this study DCE has been modeled from a different perspective. Defects originating from various development phases have different impact on the overall DCE, especially defects shifting from one phase to another. To reduce the DCE of a software product it is important to assess every development phase along with its specific characteristics and focus on the shift of defects over phases.
Aims. The aim of this paper is to build a model for effort prediction at different development stages. Our model is mainly focused on a dynamic DCE changing from one development phase to another. It reflects the increasing cost of correcting defects which are introduced in early, but found in later development phases.
Research Method. The modeling technique used in this study is a Bayesian network which, among many others, has three important capabilities: reflecting causal relationships, combining expert knowledge with empirical data and incorporating uncertainty. The procedure of model development contains a set of iterations including the following steps: problem analysis, data analysis, model enhancement with simulation runs and model validation.
Results. The developed Defect Cost Flow Model (DCFM) reflects the widely used V-model, an international standard for developing information technology systems. It has been pre-calibrated with empirical data from past projects developed at Robert Bosch GmbH. The analysis of evaluation scenarios confirms that DCFM correctly incorporates known qualitative and quantitative relationships. Because of its causal structure it can be used intuitively by end-users.
Conclusion. Typical cost benefit optimization strategies regarding the optimal effort spent on quality measures tend to optimize locally, e.g. every development phase is optimized separately in its own domain. In contrast to that, the DCFM demonstrates that even cost intensive quality measures pay off when the overall DCE of specific features is considered.

References

[1]
}}Basili V. R. and Rombach H. D, "The TAME project: Towards improvement-oriented software environments", IEEE Transactions on Software Engineering, 14(6), 758--773, 1988.
[2]
}}Bibi S., Stamelos I., "Software Process Modeling with Bayesian Belief Networks", Proc. Int. Software Metrics Symposium, Chicago, 2004.
[3]
}}Boehm, W. and Philip, M., "Understanding and Controlling Software Costs", IEEE Transactions on Software Engineering, 14(10), 1462--1477, 1988.
[4]
}}Dabney J. B., Barber G., Ohi D., "Predicting Software Defect Function Point Ratios Using a Bayesian Belief Network", Proc. 2nd Int. Workshop on Predictor Models in Software Engineering, Philadelphia, 2006.
[5]
}}Darwiche A., "Modeling and Reasoning with Bayesian Networks", Cambridge University Press, 2009.
[6]
}}De Melo A. C. V., Sanchez A. J., "Software maintenance project delays prediction using Bayesian Networks", Expert Systems with Applications, 34, 908--919, 2008.
[7]
}}Del Salgado Martinez J., del Aguina Cano I. M., "A Bayesian Network for Predicting the Need for a Requirements Review", in: Meziane F., Vadera S. (eds.), "Artificial Intelligence Applications for Improved Software Engineering Development: New Prospects", Information Science Reference, 106--128, New York, 2008.
[8]
}}Fenton N., Hearty P., Neil M., Radliński Ł., "Software Project and Quality Modelling Using Bayesian Networks", in: Meziane F., Vadera S. (eds.), "Artificial Intelligence Applications for Improved Software Engineering Development: New Prospects", Information Science Reference, 1--25, New York, 2008.
[9]
}}Fenton N., Marsh W., Neil M., Cates P., Forey S., Tailor M., "Making Resource Decisions for Software Projects", Proc. 26th Int. Conference on Software Engineering, 397--406, Washington DC, 2004.
[10]
}}Fenton N., Neil M., Marsh W., Hearty P., Radliński Ł., Krause P., "On the effectiveness of early life cycle defect prediction with Bayesian Nets", Empir. Software Eng., 13, 499--537, 2008.
[11]
}}Fenton N. E., Neil M., Marsh W., Krause P., Mishra R., "Predicting Software Defects in Varying Development Lifecycles using Bayesian Nets", Inf. and Software Techn., 43(1), 32--43, 2007.
[12]
}}Freimut, Denger, Ketterer, "An Industrial Case Study of Implementing and Validating Defect Classification for Process Improvement and Quality Management", Proc. 11th. Int. Symposium on Software Metrics, 2005.
[13]
}}Hearty P., Fenton N., Marquez D., Neil M., "Predicting Project Velocity in XP using a Learning Dynamic Bayesian Network Model", IEEE Trans. Software Eng., 37(1), 124--137, 2009.
[14]
}}Jensen F. V., "An Introduction to Bayesian Networks", UCL Press, London, 1996.
[15]
}}Kruchten P., "The Rational Unified Process: An Introduction", Addison-Wesley, 1998.
[16]
}}Lee, I., Leung, J. Y. T., Son, S. H., "Handbook of Real-Time and Embedded Systems", Chapman & Hall/CRC, 2007.
[17]
}}Mendes and N. Mosley, "Bayesian Network Models for Web Effort Prediction: A Comparative Study", IEEE Trans. Software Eng., 34, 723--737, 2008.
[18]
}}Mendes E., "Using Bayesian Networks for Web Effort Estimation", in: Meziane F., Vadera S. (eds.), "Artificial Intelligence Applications for Improved Software Engineering Development: New Prospects", Information Science Reference, 26--44, New York, 2008.
[19]
}}Mendes E., "The Use of Bayesian Networks for Web Effort Estimation: Further Investigation", Proc. 8th Int. Conf on Web Engineering, 203--216, Yorktown Heights, 2008.
[20]
}}Musilek P., Pedrycz W., Nan Sun, Succi G., "On the Sensitivity of COCOMO II Software Cost Model", Proc 8th IEEE Symposium on Software Metrics, 13--20, 2002.
[21]
}}Pearl J., "Bayesian Networks: A Model of Self-Activated Memory for Evidential Reasoning", Proc. 7th Conf. of the Cognitive Science Society, 329--334, University of California, 1985.
[22]
}}Pearl J., "Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference", Morgan Kaufmann, San Francisco, 1988.
[23]
}}Radliński Ł., Fenton, N., Neil, M., Marquez D., "Improved Decision-Making for Software Managers Using Bayesian Networks", Proc. 11th IASTED Int. Conf. Software Engineering and Applications, 13--19, Cambridge, 2007.
[24]
}}Radlinski L., "Improved Software Project Risk Assessment Using Bayesian Nets", Ph.D. Thesis, Queen Mary University, London, unpublished, 2008.
[25]
}}Ram Chillarege, Inderpal S. Bhandari, Jarir K. Chaar, Michael J. Halliday, Diane S. Moebus, Bonnie K. Ray and Man-Yuen Wong, "Orthogonal Defect Classification-A Concept for In-Process Measurements", IEEE Transactions on Software Engineering, 18(11), 943--956, 1992.
[26]
}}Russell S., Norvig P., "Artificial Intelligence. A Modern Approach", Second Edition, Pearson Education, Inc., 2003.
[27]
}}Schulz, T., Radliński L, Gorges T. and Rosenstiel W., "Software Process Model using Dynamic Bayesian Networks" in Ramachandran M., (Ed.), "Knowledge Engineering for Software Development Life Cycles: Support Technologies and Applications", IGI Global, in press, 2010.
[28]
}}Schulz, T., Radliński L, Gorges T. and Rosenstiel W., "PROMISE Repository of empirical software engineering data", http://promisedata.org/?p=224, West Virginia University, Department of Computer Science, 2010.
[29]
}}Software Engineering Institute (SEI), "Capability Maturity Model Integrated", http://www.sei.cmu.edu/cmmi, 2010.
[30]
}}Stewart, B., "Predicting project delivery rates using the Naive--Bayes classifier", J. Software Maint. Evol.: Res. Pract., 14, 161--179, 2002.
[31]
}}Stolz W. and Wagner P., "Introduction of a quantitative Quality Management for the ECU Software development at Gasoline Systems", presented at BOCSE, 2005.
[32]
}}Van Koten C., Gray A. R., "An application of Bayesian network for predicting object-oriented software maintainability, Information and Software Technology", 48, 59--67, 2006.
[33]
}}V-Model, "Clarus Concept of Operations", FHWA-JPO-05-072, Federal Highway Administration (FHWA), 2005.
[34]
}}Wagner S., "A Bayesian network approach to assess and predict software quality using activity-based quality models", Proc. 5th Int. Conf. on Predictor Models in Software Engineering, ACM Pres, 2009.
[35]
}}Wagner S., "Global Sensitivity Analysis of Predictor Models in Software Engineering", Proc. 3rd Int. Workshop on Predictor Models in Software Engineering, Int. Conference on Software Engineering, pp. 3, Washington DC, 2007.
[36]
}}Weiss, S. M. and Kulikowsky, C. A, "A Practical Guide to Designing Expert Systems", Yourdon Press, 1984.
[37]
}}Wooff D. A., Goldstein M., Coolen F. P. A., "Bayesian Graphical Models for Software Testing", IEEE Trans. Software Eng., 28(5), 510--525, 2002.
[38]
}}Z. K. W. and H.-M. Hauser, "The growing importance of embedded software: Managing hybrid hardware-software business", The Boston Consulting Group Inc., Tech. Rep., 2004.
[39]
}}Zhou Y., Würsch M., Giger E., Gall H. C., Lü J., "A Bayesian Network Based Approach for Change Coupling Prediction", Proc. 15th Working Conference on Reverse Engineering, 27--36, Washington DC, 2008.

Cited By

View all
  • (2018)Optimal Expert Knowledge Elicitation for Bayesian Network Structure IdentificationIEEE Transactions on Automation Science and Engineering10.1109/TASE.2017.274713015:3(1163-1177)Online publication date: Jul-2018
  • (2017)Bayesian network model for task effort estimation in agile software developmentJournal of Systems and Software10.1016/j.jss.2017.01.027127:C(109-119)Online publication date: 1-May-2017
  • (2016)Industrial Software Developments Effort Estimation Model2016 International Conference on Computational Science and Computational Intelligence (CSCI)10.1109/CSCI.2016.0235(1248-1252)Online publication date: Dec-2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
PROMISE '10: Proceedings of the 6th International Conference on Predictive Models in Software Engineering
September 2010
195 pages
ISBN:9781450304047
DOI:10.1145/1868328
  • General Chair:
  • Tim Menzies,
  • Program Chair:
  • Gunes Koru
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 September 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Bayesian network
  2. correction effort
  3. decision support
  4. defect flow
  5. process modeling
  6. software process

Qualifiers

  • Research-article

Conference

Promise '10

Acceptance Rates

PROMISE '10 Paper Acceptance Rate 19 of 53 submissions, 36%;
Overall Acceptance Rate 98 of 213 submissions, 46%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)1
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2018)Optimal Expert Knowledge Elicitation for Bayesian Network Structure IdentificationIEEE Transactions on Automation Science and Engineering10.1109/TASE.2017.274713015:3(1163-1177)Online publication date: Jul-2018
  • (2017)Bayesian network model for task effort estimation in agile software developmentJournal of Systems and Software10.1016/j.jss.2017.01.027127:C(109-119)Online publication date: 1-May-2017
  • (2016)Industrial Software Developments Effort Estimation Model2016 International Conference on Computational Science and Computational Intelligence (CSCI)10.1109/CSCI.2016.0235(1248-1252)Online publication date: Dec-2016
  • (2015)Bayesian concepts in software testing: an initial reviewProceedings of the 6th International Workshop on Automating Test Case Design, Selection and Evaluation10.1145/2804322.2804329(41-46)Online publication date: 30-Aug-2015
  • (2014)Bayesian Networks For Evidence-Based Decision-Making in Software EngineeringIEEE Transactions on Software Engineering10.1109/TSE.2014.232117940:6(533-554)Online publication date: 1-Jun-2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media