Skip to main content
SpringerLink
Log in

Empirical Evaluation of Software Maintenance Technologies

  • Published:
Empirical Software Engineering Aims and scope Submit manuscript

Abstract

Technology evaluation is part of the decision-making process of any software organization. Unlike conventional wisdom, empirical evaluation strives to avoid biased conclusions by relying on observation and looking for pitfalls in the evaluation process. In this paper, we provide a summary of the maintenance studies presented in the session ‘Study and assessment of (new) technologies’ of the International Workshop on Empirical Studies of Software Maintenance (WESS '96), and also report on the working group discussion which focused on common problems and open issues in the field of technology evaluation. These empirical studies are then classified according to a multi-dimensional framework to synthesize the state of the research in technology evaluation and ultimately discover interesting patterns.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Basili, V. R., Caldiera, G., Lanubile, F., and Shull, F. 1996. Investigating focused techniques for understanding frameworks. WESS '96, Proc. Int. Workshop on Empirical Studies of Software Maintenance.

  • Basili, V. R., Green, S., Laitenberger, O., Lanubile, F., Shull, F., Sorumgard, S., and Zelkowitz, M. 1996. Packaging researcher experience to assist replication of experiments. Proc. ISERN Meeting, 3–6.

  • Briand, L., Bunse, C., Daly, J., and Differding, C. 1996. An experimental comparison of the maintainability of object-oriented and structured design documents. Technical Report ISERN-96-13, International Software Engineering Research Network.

  • Brooks, R. E. 1980. Studying programmer behavior experimentally: the problems of proper methodology. Communications of the ACM 23(4): 207–213.

    Article  MathSciNet  Google Scholar 

  • Campbell, D. T., and Stanley, J. C. 1963. Experimental and Quasi-Experimental Designs for Research. Boston: Houghton Mifflin Co.

    Google Scholar 

  • Glass, R. L. 1995. A structure-based critique of contemporary computing research. The Journal of Systems and Software 28: 3–7.

    Article  Google Scholar 

  • Harrison, R., and Smith, A. 1996. An assessment of object-oriented design in the maintenance of a large-scale system. WESS '96, Proc. Int. Workshop on Empirical Studies of Software Maintenance.

  • Kitchenham, B. A. 1996. Evaluating software engineering methods and tool—Part 1: The evaluation context and evaluation methods. ACM SIGSOFT Software Engineering Notes 21(1): 11–15.

    Article  Google Scholar 

  • Judd, C. M., Smith, E. R., and Kidder, L. H. 1991. Research Methods in Social Relations, 6th edition. Orlando: Holt Rinehart and Winston, Inc.

    Google Scholar 

  • Kiper, J., Auernheimer, B., and Ames, C. 1996. Improving the maintenance process: making software more accessible. WESS '96, Proc. Int. Workshop on Empirical Studies of Software Maintenance.

  • Lee, A. S. 1989. A scientific methodology for MIS case studies. MIS Quarterly, March: 33–49.

  • Lindvall, M. 1996. Evaluating impact analysis—A case study. WESS '96, Proc. Int. Workshop on Empirical Studies of Software Maintenance.

  • Porter, A. A., Votta, L. G., and Basili, V. R. 1995. Comparing detection methods for software requirements inspections: a replicated experiment. IEEE Transactions on Software Engineering 21(6): 563–575.

    Article  Google Scholar 

  • Rosenblum, D., and Weyuker, E. 1996. Lessons learned from a regression testing case study. WESS '96, Proc. Int. Workshop on Empirical Studies of Software Maintenance.

  • Rothermel, G., and Harrold, M. J. 1996. Experience with regression test selection. WESS '96, Proc. Int. Workshop on Empirical Studies of Software Maintenance.

  • Sadler, C., and Kitchenham, B. A. 1996. Evaluating software engineering methods and tool—Part 4: The influence of human factors. ACM SIGSOFT Software Engineering Notes 21(5): 11–13.

    Article  Google Scholar 

  • Sheil, B. A. 1981. The psychological study of programming. ACM Computing Surveys 13(1): 101–120.

    Article  Google Scholar 

  • Tichy, W. F., Lukowicz, P., Prechelt, L., and Heinz, E. A. 1995. Experimental evaluation in computer science: a quantitative study. The Journal of Systems and Software 28: 9–18.

    Article  Google Scholar 

  • Yin, R. K. 1994. Case Study Research: Design and Methods, 2nd ed., Thousand Oaks: SAGE Publications.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Maryland, College Park, MD, 20742

    Filippo Lanubile

Authors
  1. Filippo Lanubile
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lanubile, F. Empirical Evaluation of Software Maintenance Technologies. Empirical Software Engineering 2, 97–108 (1997). https://doi.org/10.1023/A:1009788914777

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1009788914777

Search

Navigation