skip to main content
10.1145/3195546.3195550acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
short-paper

Watching the detectives: an initial report on an industrial experiment to collaborate with the empirical software engineering research community

Published: 29 May 2018 Publication History

Abstract

Context: Evidence-based practice within healthcare benefits from the Cochrane Collaboration providing trustworthy evidence that can be used to inform clinical decisions. Currently no equivalent resource exists for the practice of software engineering. With the ever increasing dependence of society upon software an analogue of the collaboration for the discipline of software engineering would appear to be of potentially significant societal benefit.
Objectives: This study investigated attitudes of the empirical software engineering community, as exemplified by attendees at an research focused conference, to the hypothesis that an analogue of the Cochrane Collaboration would be beneficial.
Method: An online survey was employed to capture opinions of participants in the EASE'16 conference on the hypothesis. During a presentation at the industrial track of the conference attendees (27) were invited to complete the survey. Subsequently all conference attendees (90) were provided with details of the survey, irrespective of whether they had attended the presentation or not. No closing date for the survey was specified.
Results: In total 9 conference attendees completed the survey: of whom 7 had attended the industrial track presentation. These figures approximate to a response rate of 26% for those attending the presentation and exactly 10% for conference participants overall. This response rate is insufficient to enable statistical analysis of the data obtained through the survey. Trends are, however, evident in the rankings of the responses provided. These trends are consistent with opinions and observations volunteered by a diverse range of individuals active in software engineering and allied fields dating from 2014 to the present.
Conclusions: At this time there is insufficient data to validate the hypothesis. Nevertheless experience, informal observation and opinion continues to accumulate to provide evidence in support of the validity of the hypothesis, albeit principally in anecdotal form.

References

[1]
Steve Anderson, Paul Sagar, Beth Smith, and Ken Wallace. 2016. What We Have Learnt Adopting Evidence-based Software Engineering for Industrial Practice. In Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering (EASE '16). ACM, New York, NY, USA, Article 30, 1 pages.
[2]
Sarah Beecham, David Bowes, and Klaas-Jan Stol. 2017. Introduction to the EASE 2016 special section: Evidence-based software engineering: Past, present, and future. Information and Software Technology 89 (2017), 14 -- 18.
[3]
S. Beecham, P. O'Leary, S. Baker, I Richardson, and J. Noll. 2014. Making Software Engineering Research Relevant. Computer 47, 4 (Apr 2014), 80--83.
[4]
L. Briand. 2012. Embracing the Engineering Side of Software Engineering. Software, IEEE 29, 4 (July 2012), 96.
[5]
Jeffrey C. Carver, Oscar Dieste, Nicholas A. Kraft, David Lo, and Thomas Zimmermann. 2016. How Practitioners Perceive the Relevance of ESEM Research. In Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM '16). ACM, New York, NY, USA, Article 56, 10 pages.
[6]
J. Cleland-Huang. 2015. Toward Meaningful Industrial-Academic Partnerships. IEEE Software 32, 1 (Jan 2015), 18--21.
[7]
T. Dyba, B.A Kitchenham, and M. Jorgensen. 2005. Evidence-based software engineering for practitioners. Software, IEEE 22, 1 (Jan 2005), 58--65.
[8]
Vahid Garousi, Kai Petersen, and Baris Ozkan. 2016. Challenges and best practices in industry-academia collaborations in software engineering: A systematic literature review. Information and Software Technology 79 (2016), 106 -- 127.
[9]
John Hatcliff, Alan Wassyng, Tim Kelly, Cyrille Comar, and Paul Jones. 2014. Certifiably Safe Software-dependent Systems: Challenges and Directions. In Proceedings of the Future of Software Engineering (FOSE 2014). ACM, New York, NY, USA, 182--200.
[10]
Barbara Ann Kitchenham, David Budgen, and Pearl Brereton. 2016. Evidence-Based Software Engineering and Systematic Reviews. CRC Press.
[11]
Barbara A. Kitchenham, Tore Dybå, and Magne Jørgensen. 2004. Evidence-Based Software Engineering. In Proceedings of the 26th International Conference on Software Engineering (ICSE '04). IEEE Computer Society, Washington, DC, USA, 273--281. http://dl.acm.org/citation.cfm?id=998675.999432
[12]
David Lo, Nachiappan Nagappan, and Thomas Zimmermann. 2015. How practitioners perceive the relevance of software engineering research. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering. ACM, 415--425.
[13]
Art Pyster, Rick Adcock, Mark Ardis, Rob Cloutier, Devanandham Henry, Linda Laird, Harold Lawson, Michael Pennotti, Kevin Sullivan, and Jon Wade. 2015. Exploring the Relationship between Systems Engineering and Software Engineering. Procedia Computer Science 44 (2015), 708 -- 717. 2015 Conference on Systems Engineering Research.
[14]
(UK) Government - guidance. 2015. What Works Network. https://www.gov.uk/guidance/what-works-network. (January 2015).
[15]
K. R. Wallace. 2014. I'm A Practitioner Help Me Out Here: Can Evidence Based Software Engineering Really Help Navigate The Iron Triangle Successfully ?. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering (EASE '14). ACM, New York, NY, USA, 453.
[16]
K. R. Wallace. 2016. Safe Software: A Suitable Case For An Evidence-Based Treatment?. In ESREL 2016. Taylor & Francis, 2403 -- 2410.
[17]
G. P. Zachary. 2016. The invisible technology. IEEE Spectrum 53, 11 (November 2016), 10.

Cited By

View all
  • (2019)Good Practices in Aligning Software Engineering Research and Industry PracticeACM SIGSOFT Software Engineering Notes10.1145/3356773.335681244:3(65-67)Online publication date: 14-Nov-2019

Index Terms

  1. Watching the detectives: an initial report on an industrial experiment to collaborate with the empirical software engineering research community

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        SER&IP '18: Proceedings of the 5th International Workshop on Software Engineering Research and Industrial Practice
        May 2018
        38 pages
        ISBN:9781450357449
        DOI:10.1145/3195546
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 29 May 2018

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. cochrane collaboration
        2. evidence
        3. principles
        4. software engineering
        5. survey

        Qualifiers

        • Short-paper

        Conference

        ICSE '18
        Sponsor:

        Upcoming Conference

        ICSE 2025

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 20 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2019)Good Practices in Aligning Software Engineering Research and Industry PracticeACM SIGSOFT Software Engineering Notes10.1145/3356773.335681244:3(65-67)Online publication date: 14-Nov-2019

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media