skip to main content
10.1145/1985793.1985994acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
research-article

Impact of software resource estimation research on practice: a preliminary report on achievements, synergies, and challenges

Authors Info & Claims
Published:21 May 2011Publication History

ABSTRACT

This paper is a contribution to the Impact Project in the area of software resource estimation. The objective of the Impact Project has been to analyze the impact of software engineering research investments on software engineering practice. The paper begins by summarizing the motivation and context for analyzing software resource estimation; and by summarizing the study's purpose, scope, and approach. The approach includes analyses of the literature; interviews of leading software resource estimation researchers, practitioners, and users; and value/impact surveys of estimators and users. The study concludes that research in software resource estimation has had a significant impact on the practice of software engineering, but also faces significant challenges in addressing likely future software trends.

References

  1. Albrecht, A. J., & Gaffney, J., "Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation," IEEE Transactions on Software Engineering, Vol. SE-9, pp. 639--648, 1983. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Aron, J. "Estimating Resources for Large Programming Systems," in Buxton, J., and Randell, B. (eds), Software Engineering Techniques, NATO Science Committee, April 1970. pp. 68--79.Google ScholarGoogle Scholar
  3. Bailey, J. W. and Basili, V. R., "A Meta-Model for Software Development Resource Expenditures," 5th International Conference on Software Engineering, San Diego, CA, pp. 107--116, 1981. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Beck, K., and Fowler, M., Planning Extreme Programming, Addison Wesley, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Biffl, S., Aurum, A., Boehm, B., Erdogmus, H., and Gruenbacher, P. (eds.): Value-Based Software Engineering. Springer Verlag, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Black, R. et al., BCS Software Production Data, RADC-TR-77-116, Boeing Computer Services, March 1977.Google ScholarGoogle Scholar
  7. Boehm, B. W., Software Engineering Economics, Prentice Hall, 1981. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Boehm, B. W., "Anchoring the Software Process," IEEE Software, July 1996, pp. 73--82. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Boehm, B., Egyed, A., Kwan, J., Port, D., Shah, A., and Madachy, R.: Using the WinWin Spiral Model: A Case Study, IEEE Computer, July 1998, pp. 33--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Boehm, B. W., Abts, C., Brown, A. W., Chulani, S., Clark, B., Horowitz, E., Madachy, R., Reifer, D., Steece, B., Software Cost Estimation with COCOMO II, Prentice Hall, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Boehm, B., Valerdi, R., and Honour, E., "The ROI of Systems Engineering: Some Quantitative Results for Software-Intensive Systems," Systems Engineering, Volume 11, Issue 3, April 2008, pp. 221--234. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Bozoki, G. J., 1993, An Expert Judgment Based Software Sizing Model, Journal of Parametrics, Volume XIII, No. 1, May 1993.Google ScholarGoogle ScholarCross RefCross Ref
  13. Cohn, M., Agile Estimating and Planning, Prentice Hall, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. DeMarco, T., Controlling Software Projects, Yourdon Press, 1982.Google ScholarGoogle Scholar
  15. Denne, M. and Cleland-Huang, J., Software by Numbers, Prentice Hall, 2004.Google ScholarGoogle Scholar
  16. Doty Associates, Inc., Software Cost Estimates Study, Vol. 1, RADC TR 77-220, June 1977.Google ScholarGoogle Scholar
  17. Galorath, D., and Evans, M., Software Sizing, Estimation, and Risk Management, Auerbach, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Gerlich, R., and Denskat, U., "A cost estimation model for maintenance and high reuse," presented at Proceedings, ESCOM, Ivrea, Italy, 1994.Google ScholarGoogle Scholar
  19. Halstead, M., Elements of Software Science, Elsevier, 1977. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Hayes, W., and Zubrow, D., "Moving on Up: Data and experience doing CMM-based process improvement," Carnegie Mellon University/SEI-95-TR-008 1995.Google ScholarGoogle ScholarCross RefCross Ref
  21. Huang, L. and Boehm, B., "How Much Software Quality Investment is Enough: A Value-Based Approach," IEEE Software, Volume 23, Number 5, September/October 2006, pp. 88--95 Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. International Software Benchmark & Standards Group, "Data R8," 2005.Google ScholarGoogle Scholar
  23. Jacobson, I., Booch, G. and Rumbaugh, J., Unified Software Development Process, Addison-Wesley, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Jensen, R., "An Improved Macrolevel Software Development Resource Estimation Model," Proceedings, 5th ISPA Conference, April 1983, pp. 88--92.Google ScholarGoogle Scholar
  25. Jones, C., Programming Productivity, McGraw Hill, 1985.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Jorgensen, M., "A Review of Studies on Expert Estimation of Software Development Effort," J. Systems & Software, 70 (1-2) 2004, pp. 37--60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Jorgensen, M., and Shepperd, M., "A Systematic Review of Software Development Cost Estimation Studies," IEEE Trans. on SW Engr., Vol. 33, No. 1, pp. 33--53, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Jorgensen, M., Boehm, B., and Rifkin, S., "Software Development Effort Estimation: Formal Models or Expert Judgment," IEEE Software, March/April 2009, pp. 14--19. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Kruchten, P. B., The Rational Unified Process (An Introduction). Addison Wesley 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Maranzano, J. F., Rozsypal, S. A., Zimmerman, G. H., Warnken, G. W., Wirth, P. E., Weiss, D. M., Architecture Reviews: Practice and Experience, IEEE Software, Vol. 22, No. 2, pp. 34--43, Mar/Apr, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Menzies, T., Chen, Z., Port, D., and Boehm, B., "Reduced-Parameter Estimation Models," presented at Proceedings, PROMISE Workshop, ICSE, 2005.Google ScholarGoogle Scholar
  32. Morin, L., "Estimation of Resources for Computer Programming Projects," MS Thesis, U. North Carolina, 1973. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Mukhopadhyay, T., Vincinanza, S., Prietula, M., "Examining the Feasibility of a Case-Based Reasoning Model for Software Effort Estimation," MIS Quarterly, Vol. 16, pp. 155--171, 1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Osterweil, L. J., Ghezzi, C., Kramer, J. and Wolf, A. L., "Determining the Impact of Software Engineering Research on Practice," Computer, Vol. 41, No. 3, pp. 39--49, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Parikh, G., Zvegintzov, N., "The World of Software Maintenance," in Tutorial on Software Maintenance, IEEE CS Press, pp. 1--3, 1993.Google ScholarGoogle Scholar
  36. Pew., R. and Mavor, A., Human-System Integration in the System Development Process, National Academies Press, 2007.Google ScholarGoogle Scholar
  37. Poulin, J. S., Measuring Software Reuse, Addison Wesley, 1997.Google ScholarGoogle Scholar
  38. PROMISE datasets, http://promisedata.org/, 2010.Google ScholarGoogle Scholar
  39. Putnam, L., "A General Empirical Solution to the Macro Software Sizing and Estimating Problem," IEEE Trans. on SW Engr., pp. 345--361, 1978. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Redwine, S. and Riddle, W. "Software Technology Maturation," Proc. 8th Int'l Conf. Software Eng., IEEE CS Press, 1985, pp. 189--200. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Reifer, D. J., Practical Software Reuse, Wiley, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Reifer, D. J., Making the Software Business Case, Addison Wesley, 2002.Google ScholarGoogle Scholar
  43. Royce, W., Software Project Management, Addison, Wesley, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Rubin, H. A., "Macroestimation of software development parameters: The ESTIMACS system," SOFTFAIR Conference on Software Development Tools, Techniques and Alternatives, Arlington, VA, IEEE Press, pp. 109--118, 1983.Google ScholarGoogle Scholar
  45. Selby, R., "Empirically analyzing software reuse in a production environment," in Software Reuse: Emerging Technology, W. Tracz (Ed.), IEEE-CS Press, pp. 176--189, 1988. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Shepperd, M. and Schofield, C., "Estimating Software Project Effort Using Analogies," IEEE Trans. on SW Engr., Vol. 23, pp. 736--743, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Sullivan, K., Cai, Y., Hallen, B., and Griswold, W., "The Structure and Value of Modularity in Software Design," Proceedings, ESEC/FSE, 2001, ACM Press, pp. 99--108. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Walston, C. and Felix, C., "A Method of Programming Measurement and Estimation," IBM Systems Journal, Vol. 16, No. 1, 1977. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Wittig, G., "Estimating Software Development Effort with Connectionist Models," Monash University Paper 33/95, 1995.Google ScholarGoogle Scholar
  50. Wolverton, R., "The Cost of Developing Large Scale Software," IEEE Transactions on Computers, Vol. 23, No. 6, 1974. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Yang, Y., Bhuta, J., Port, D., and Boehm, B.: Value-Based Processes for COTS-Based Applications. IEEE Software, July/August 2005, pp. 54--62. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Abran, A., and Robillard, P., "Function Points: A Study of Their Measurement Processes and Scale Transformations," J. Systems Software, 25, 2: 1994, pp. 171--184. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. ISO/IEC 14143:1998 'Software Engineering - Software Measurement - Functional Size Measurement, Part 1: Definition of Concepts, International Organization for Standardization, Geneva, Switzerland, 1998.Google ScholarGoogle Scholar
  54. Jeffery, D. R., Low, G., and Barnes, M., "A Comparison of Function Point Counting Techniques," IEEE Trans, SW Engr. 19, 5: 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Symons, C., "Function Point Analysis: Difficulties and Improvements," IEEE Trans, SW Engr. 14.1: 1988, pp. 2--11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. ISO/IEC 19761:2003, 'Software Engineering - COSMIC-FFP - A functional size measurement method', International Organization for Standardization, Geneva, Switzerland, 2003.Google ScholarGoogle Scholar

Index Terms

  1. Impact of software resource estimation research on practice: a preliminary report on achievements, synergies, and challenges

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ICSE '11: Proceedings of the 33rd International Conference on Software Engineering
      May 2011
      1258 pages
      ISBN:9781450304450
      DOI:10.1145/1985793

      Copyright © 2011 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 21 May 2011

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate276of1,856submissions,15%

      Upcoming Conference

      ICSE 2025

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader