skip to main content
article

Software engineering practice versus evidence-based software engineering research

Authors Info & Claims
Published:17 May 2005Publication History
Skip Abstract Section

Abstract

In this paper, we review four examples in software engineering practice of the lack of use of empirical evidence. We use these examples to support our claims that practitioners and researchers appear to have different values with regards to empirical evidence, and appear to use different criteria when evaluating the credibility of evidence. From our examples, it seems that practitioners need to be persuaded to adopt evidence-based software engineering practices. Consequently, the research community needs to consider strategies for persuading practitioners. Paradoxically for software engineering research, the more effective persuasion strategies may be ones that, initially at least, do not rely on empirical evidence.

References

  1. Basili, V. R. and Rombach, H. D. The TAME Project: Towards Improvement-Oriented Software Environments. IEEE Transactions on Software Engineering, 14 (6). 758--773, 1988.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bhattacherjee, A. and Sanford, C. Persuasion strategies for information technology usage: an elaboration likelihood model. MIS Quarterly, In review. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. DTI, DTI's Office of Science and Technology's Public Engagement with Science and Technology, Department of Trade and Industry (DTI), http://www.dti.gov.uk/ost/ostbusiness/puset/puset.htm, 18th February 2005, 2005Google ScholarGoogle Scholar
  4. Dybå, T., Kitchenham, B. and Jorgensen Evidence-Based Software Engineering for Practitioners. IEEE Software, 22 (1). 58--65, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Fenton, N. and Ohlsson, N. Quantitative Analysis of Faults and Failures in a Complex Software System. IEEE Transactions on Software Engineering, 26 (8). 797--814, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Fisher, A. The Logic of Real Arguments. Cambridge University Press, 1988.Google ScholarGoogle Scholar
  7. Kitchenham, B., Pfleeger, S. L., Pickard, L., Jones, P., Hoaglin, D. C. and Rosenberg, J. Preliminary guidelines for empirical research in software engineering. IEEE Transactions on Software Engineering, 28 (8). 721--734, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. McCroskey, J. C. An introduction to rhetorical communication. Allyn and Bacon, Boston, 1997.Google ScholarGoogle Scholar
  9. Paulk, M. C., Curtis, B., Chrissis, M. B. and Weber, C. V. Capability Maturity Model, Version 1.1. IEEE Software, 10 (4). 18--27, 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Paulk, M. C., Goldenson, D. and White, D. M. The 1999 Survey of High Maturity Organizations, Software Engineering Institute, Carnegie Mellon University, 2000.Google ScholarGoogle ScholarCross RefCross Ref
  11. Perloff The dynamics of persuasion: Communication and attitudes in the 21st Century. Lawrence Erlbaum Associates, Mahwah, N.J., 2003.Google ScholarGoogle Scholar
  12. Petty, R. E. and Cacioppo, J. T. The elaboration liklehood model of persuasion. Advances in experimental social psychology, 19, 1986.Google ScholarGoogle Scholar
  13. Petty, R. E., Cacioppo, J. T., Strathman, A. J. and Priester, J. R. To think or not to think: exploring two routes to persuasion. In Shavitt, S. and Brock, T. C. eds. Persuasion: psychological insight and perspectives, 1994.Google ScholarGoogle Scholar
  14. Petty, R. E. and Wegener, D. T. The elaboration liklihood model: current status and controversies. In Chaiken, S. and Trope, Y. eds. Dua-process theories in social psychology, The Guildford Press, New York, 1999, 41--72.Google ScholarGoogle Scholar
  15. Rainer, A. and Hall, T., Identifying the causes of poor progress in software projects. In 10th International Symposium on Software Metrics (METRICS'04), (2004). Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Rainer, A. W. An Empirical Investigation of Software Schedule Behaviour. PhD Thesis, Department of Computing, Bournemouth UniversityGoogle ScholarGoogle Scholar
  17. Rainer, A. W., Hall, T. and Baddoo, N., Persuading developers to 'buy into' software process improvement: an exploratory analysis. In ACM-IEEE International Symposium on Empirical Software Engineering (ISESE), (University of Rome 'Tor Vergata', Italy, September 30th - October 1st 2003, 2003). Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Rogers, E. M. Diffusion of innovations. Free Press, New York, 1995.Google ScholarGoogle Scholar
  19. Williams, L. On the need for a process for making reliable quality comparisons with industrial data. ACM SIGSOFT Software Engineering Notes, 29 (5), 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Software engineering practice versus evidence-based software engineering research

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM SIGSOFT Software Engineering Notes
      ACM SIGSOFT Software Engineering Notes  Volume 30, Issue 4
      July 2005
      1514 pages
      ISSN:0163-5948
      DOI:10.1145/1082983
      Issue’s Table of Contents
      • cover image ACM Other conferences
        REBSE '05: Proceedings of the 2005 workshop on Realising evidence-based software engineering
        May 2005
        39 pages
        ISBN:159593121X
        DOI:10.1145/1083174

      Copyright © 2005 Copyright is held by the owner/author(s)

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 17 May 2005

      Check for updates

      Qualifiers

      • article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader