Skip to main content

A Hands-On Approach for Teaching Systematic Review

  • Conference paper
Product-Focused Software Process Improvement (PROFES 2008)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 5089))

Abstract

An essential part of a software engineering education is technology innovation. Indeed software engineers, as future practitioners, must be able to identify the most appropriate technologies to adopt in projects. As so, it is important to develop the skills that will allow them to evaluate and make decisions on tools, technologies, techniques and methods according to the available empirical evidence reported in literature. In this sense, a rigorous manner for analyzing and critically addressing literature is Systematic Review. It requires formalizing an answerable research question according to the problem or issues to face; search the literature for available evidence according to a systematic protocol and retrieve data from the identified sources; analyze the collected evidence and use it to support decision making and conclusions. In this paper we report on how Systematic Review has been integrated in the “Empirical Software Engineering Methods” course that is taught at the Department of Informatics at the University of Bari, and how students have been introduced to this type of literature review through a hands-on approach. As far as we know, it is the first attempt of including a complex topic like systematic review in a university course on empirical software engineering. We have no empirical evidence on the effectiveness of the approach adopted, other than practice-based experience that we have acquired. Nonetheless, we have collected qualitative data through a questionnaire submitted to the students of the course. Their positive answers and impressions are a first informal confirmation of the successful application of our strategy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Australian National Health and Medical Research Council.: How to review the evidence: systematic identification and review of the scientific literature (2000) ISBN 186-4960329

    Google Scholar 

  2. Australian National Health and Medical Research Council.: How to use the evidence: assessment and application of scientific evidence (February 2000) ISBN 0642432952

    Google Scholar 

  3. Bagert, D.J., Jilburn, T.B., Jislop, G., Lutz, M, McCracken, M., Mengel, S.: Guidelines for Software Engineering Education Version 1.0. Technical report, CMU/SEI CMU/SEI-99-TR-032, (1999)

    Google Scholar 

  4. Baldassarre, M.T., Caivano, D., Visaggio, G.: Systematic Review of Statistical Process Control: An Experience Report. In: 11th Evaluation and Assessment in Software Engineering Conference, BCS UK, pp.94-102 (April 2007) ISBN:978-1-902505-86-2

    Google Scholar 

  5. Bloom, B.S.: Taxonomy of educational objectives: The classification of educational goals: Handbook I, cognitive domain. Longmans Green, New York (1956)

    Google Scholar 

  6. Brereton, P., Kitchenham, B., Budgen, D., Turner, M., Khalil, M.: Employing Systematic Literature Review: An Experience Report. Technical Report TR 05/01, School of Computing & Mathematics, Keele University (2005)

    Google Scholar 

  7. Cochrane-Collaboration, Cochrane reviews’ handbook. Version 4.2.1 (2003)

    Google Scholar 

  8. Dyba, T., Kampenes, V.B., Sjoberg, D.: A systematic review of statistical power in software engineering experiments. Information and Software Technology 48, 745–755 (2006)

    Article  Google Scholar 

  9. Florac, W.A., Carleton, A.D.: Measuring the Software Process: Statistical Process Control for Software Process Improvement. Addison-Wesley, Reading (1999)

    Google Scholar 

  10. Glass, R., Vessey, I., Ramesh, V.: Research in software engineering: An analysis of the literature. Information & Software Technology 44, 491–506 (2002)

    Article  Google Scholar 

  11. Glass, R., Vessey, I., Ramesh, V.: An Analysis of Research in Computing Disciplines. Communications of the ACM 47, 89–94 (2004)

    Article  Google Scholar 

  12. Hart, C.: Doing a Literature Review: releasing the social science research imagination. SAGE Publications, London (1998)

    Google Scholar 

  13. Jacob, A., Pillai, S.K.: Statistical Process Control to Improve Coding and Code Review. IEEE Software 50–55 (May/June 2003)

    Google Scholar 

  14. Jorgensen, M., Dyba, T., Kitchenham, B.: Teaching Evidence-Based Software Engineering to University Students. In: 11th IEEE International Software Metrics Symposium. IEEE Computer Society Press, Los Alamitos (2005)

    Google Scholar 

  15. Jorgensen, M., Shepperd, M.: A Systematic Review of Software Development Cost Estimation Studies. IEEE Transactions on Software Engineering 33(1), 33–53 (2007)

    Article  Google Scholar 

  16. Kahan, K.S., ter Riet, G., Glanville, J., Sowden, A.J., Kleijnen, J.: Undertaking Systematic Review of Research on Effectiveness. In: CRD’s Guidance for those Carrying Out or Commissioning Reviews. CRD’s Report Number 4 (2nd edn.), NHS Centre for Reviews and Dissemination, University of York. ISBN 1900640201 (March 2001)

    Google Scholar 

  17. Kitchenham, B.: Procedures for Performing Systematic Reviews. Technical Report TR/SE0401, Keele University, and Technical Report 0400011T.1, National ICT Australia (2004)

    Google Scholar 

  18. Kitchenham, B., Mendes, E., Travassos, G.: A systematic review of Cross vs. Within company cost estimation studies. In: 10th International Conference on Evaluation and Assessment in Software Engineering, Keele University Staffordshire, UK, April 2006, vol. 3, pp. 79–88 (2006) ISBN 1-902505-74-3

    Google Scholar 

  19. Meyer, B.: Software Engineering in the Academy. IEEE Computer 34(5), 28–35 (2001)

    Google Scholar 

  20. Staples, M., Mahmood, N.: Experiences Using Systematic Review Guidelines. In: 10th International Conference on Evaluation and Assessment in Software Engineering, Keele University, pp.79-88, BCS UK (2006) ISBN 1-902505-74-3

    Google Scholar 

  21. Weller, E.: Practical Applications of Statistical Process Control. IEEE Software, 48–55 (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Andreas Jedlitschka Outi Salo

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Baldassarre, M.T., Boffoli, N., Caivano, D., Visaggio, G. (2008). A Hands-On Approach for Teaching Systematic Review. In: Jedlitschka, A., Salo, O. (eds) Product-Focused Software Process Improvement. PROFES 2008. Lecture Notes in Computer Science, vol 5089. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69566-0_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-69566-0_33

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-69564-6

  • Online ISBN: 978-3-540-69566-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics