skip to main content
10.1145/2652524.2652590acmconferencesArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
research-article

Empirical and face validity of software maintenance defect models used at the jet propulsion laboratory

Published:18 September 2014Publication History

ABSTRACT

Context: At the Mission Design and Navigation Software Group at the Jet Propulsion Laboratory we make use of finite exponential based defect models to aid in maintenance planning and management for our widely used critical systems. However a number of pragmatic issues arise when applying defect models for a post-release system in continuous use. These include: how to utilize information from problem reports rather than testing to drive defect discovery and removal effort, practical model calibration, and alignment of model assumptions with our environment.

Goal: To show how we can develop confidence in the practical applicability of our models for obtaining stable maintenance funding.

Method: We describe the strong empirical and face validity we have investigated for our maintenance defect discovery and introduction models. We discuss the practical details of calibration and application within a functioning maintenance environment.

Results: We find that our models, despite their simplicity, appear quite valid.

Conclusions: The models are useful in justifying and obtaining stable maintenance funding.

References

  1. Casella G, Berger R. Statistical Inference 2nd Edition. Duxbury Press. 511 Forest Lodge Road, Pacific Grove, CA 93950, USAGoogle ScholarGoogle Scholar
  2. Garrison Q. Kenny. "Estimating defects in commercial software during operational use." IEEE 1993.Google ScholarGoogle Scholar
  3. J. D. Musa. "Validity of Execution-Time Theory of Software Reliability." IEEE Transactions of Reliability, Vol R-28, 1979. pp181--191. J. D. Musa, K. OkumotoGoogle ScholarGoogle ScholarCross RefCross Ref
  4. Jelinski, Z., and Moranda, P. "Software Reliability Research," Statistical Computer Performance Evaluation, Freiberger, W. Ed. Academic Press, New York, NYGoogle ScholarGoogle Scholar
  5. Kan S. Metrics and Models in Software Quality Engineering 2nd Edition. Addison-Wesley, Boston MA, USA Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Li, P., Mary Shaw, and Jim Herbsleb. "Selecting a defect prediction model for maintenance resource planning and software insurance." EDSER-5 affiliated with ICSE (2003): p32--37.Google ScholarGoogle Scholar
  7. Li, Paul Luo, et al. Empirical evaluation of defect projection models for widely-deployed production software systems. Vol. 29. No. 6. ACM, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Neufelder, A M. Ensuring Software Reliability. Marcel Decker, Inc. 270 Madison Avenue, New York, NY 10016, USA Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Savage, L. J. The Foundations of Statistics. Dover Publications, Inc. 180 Varick Street, New York, NY 10014, USAGoogle ScholarGoogle Scholar

Index Terms

  1. Empirical and face validity of software maintenance defect models used at the jet propulsion laboratory

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              ESEM '14: Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement
              September 2014
              461 pages
              ISBN:9781450327749
              DOI:10.1145/2652524

              Copyright © 2014 Owner/Author

              Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 18 September 2014

              Check for updates

              Qualifiers

              • research-article

              Acceptance Rates

              ESEM '14 Paper Acceptance Rate23of123submissions,19%Overall Acceptance Rate130of594submissions,22%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader