Skip to main content
Log in

Perspective-Based Reading: A Replicated Experiment Focused on Individual Reviewer Effectiveness

  • Regular Paper
  • Published:
Empirical Software Engineering Aims and scope Submit manuscript

Abstract

This paper describes a replication conducted to compare the effectiveness of inspectors using Perspective Based Reading (PBR) to the effectiveness of inspectors using a checklist. The goal of this replication was to better understand the complementary aspects of the PBR perspectives. To this end, a brief discussion of the original study is provided as well as a more detailed description of the replication. A detailed statistical analysis is then provided along with analysis of the PBR perspectives.

For the individual PBR perspectives, we saw an interesting dichotomy: In the original study there was little overlap among the sets of defects found by each of the three perspectives, while in the replication two of the three perspectives found similar sets of defects on one of the two documents used in the study. Interestingly this document was the only case where the users of PBR were not more effective than the users of a checklist. This result leads to a new hypothesis that the complementary aspect of the PBR perspectives is the characteristic that provides the benefit over other defect detection techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Basili V, Green S, Laitenberger O, Shull F, Sorumgaard S Zelkowitz M (1996) The empirical investigation of perspective based reading. Empir Softw Eng-Int J 1:133–164

    Google Scholar 

  • Ciolkowski M, Differding C, Laitenberger O, Munch J (1997) Empirical investigation of perspective-based reading: a replicated experiment. ISERN 97–13

  • Conradi R, Mahagheghi P, Arif T, Hegde LC, Bunde GA, Pedersen A (2003) Object-oriented reading techniques for inspection of uml models—an industrial experiment. Proc of Eur Conf on Object Oriented Program (ECOOP'03). Darmstadt, Germany, pp. 483–500. Darmstadt, Germany, 483–500

  • Laitenberger O, Atkinson C, Schlich M, El Emam K (2000) An experimental comparison of reading techniques for defect detection in uml design documents. J Syst Softw 53: 183–204

    Google Scholar 

  • Laitenberger O, El Emam K, Harbich TG (2001) An internally replicated quasi-experimental comparison of checklist and perspective based reading of code documents. IEEE Trans Softw Eng 27:387–421

    Article  Google Scholar 

  • Mendonca M, Sunderhaft NL (1999) A state of the Art Report: Mining Software Engineering Data. Department of Defense (DoD) Data & Analysis Center for Software Engineering Data

  • Porter A, Votta L (1998) Comparing detection methods for software requirements inspections: a replication using professional subjects. Empir Softw Eng-Int Journal 3:355–379

    Google Scholar 

  • Regnell B, Runeson P, Thelin T (2000) Are the perspectives really different? Further experimentation on scenario-based reading of requirements. Empir Softw Eng 5:331–356

    Google Scholar 

  • Robson C (2002) Real World Research. Blackwell Publishing, Malden: MA

    Google Scholar 

  • Shull F (1998) Developing Techniques for Using Software Documents: A Series of Empirical Studies. Ph.D. Thesis. Department of Computer Science, University of Maryland, College Park

  • Shull F, Basili V, Boehm B, Brown AW, Costa P, Lindvall M, Port D, Rus I, Tesoriero R, Zelkowitz M (2002a). What we have learned about fighting defects. Proc IEEE Symp on Softw Metr 249–258

  • Shull F, Basili V, Carver J, Maldonado J, Travassos G, Mendonca M, Fabbri S (2002b) Replicating Software Engineering Experiments: Addressing the Tacit Knowledge Problem. Proc of Int Symp Empir Softw Eng (ISESE'02). Nara, Japan, pp. 7–16

  • Zhang Z, Basili V, Shneiderman B (1999) Perspective-based usability inspection: an empirical validation of efficacy. Empirical Software Engineering—An International Journal 4:43–70

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jeffrey Carver.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Maldonado, J.C., Carver, J., Shull, F. et al. Perspective-Based Reading: A Replicated Experiment Focused on Individual Reviewer Effectiveness. Empir Software Eng 11, 119–142 (2006). https://doi.org/10.1007/s10664-006-5967-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10664-006-5967-6

Keywords

Navigation