Abstract
Web and software engineering are not only about technical solutions. They are to a large extent also concerned with organisational issues, project management and human behaviour. For disciplines like Web and software engineering, empirical methods are crucial, since they allow for incorporating human behaviour into the research approach taken. Empirical methods are common practice in many other disciplines. This chapter provides a motivation for the use of empirical methods in Web and software engineering research. The main motivation is that it is needed from an engineering perspective to allow for informed and well-grounded decisions. The chapter continues with a brief introduction to four research methods: controlled experiments, case studies, surveys and post-mortem analyses. These methods are then put into an improvement context. The four methods are presented with the objective to introduce the reader to the methods to a level where it is possible to select the most suitable method at a specific instance. The methods have in common that they all are concerned with quantitative data. However, several of them are also suitable for qualitative data. Finally, it is concluded that the methods are not competing. On the contrary, the different research methods can preferably be used together to obtain more sources of information that hopefully lead to more informed engineering decisions in Web and software engineering.
A previous version of this chapter has been published in Empirical Methods and Studies in Software Engineering: Experiences from ESERNET, pp 7–23, editors Reidar Conradi and Alf Inge Wang, Lecture Notes in Computer Science Springer-Verlag, Germany, 2765, 2003. This chapter has been adapted by Emilia Mendes.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Garvin DA (1998) Building a Learning Organization. Harvard Business Review on Knowledge Management, 47–80, Harvard Business School Press, Boston, USA
Basili VR, Caldiera G, Rombach HD (2002) Experience Factory. In: Marciniak JJ (ed.) Encyclopaedia of Software Engineering, John Wiley & Sons, Hoboken, NJ, USA
Creswell JW (1994) Research Design, Qualitative and Quantitative Approaches, Sage Publications, London, UK
Denzin NK, Lincoln YS (1994) Handbook of Qualitative Research, Sage Publications, London, UK
Fenton N, Pfleeger SL (1996) Software Metrics: A Rigorous & Practical Approach, 2nd edition, International Thomson Computer Press, London, UK
Kitchenham B, Pickard L, Pfleeger SL (1995) Case Studies for Method and Tool Evaluation. IEEE Software, July, 52–62
Montgomery DC (1997) Design and Analysis of Experiments, 4th edition, John Wiley & Sons, New York, USA
Siegel S, Castellan J (1998) Nonparametric Statistics for the Behavioral Sciences, 2nd edition, McGraw-Hill International, New York, USA
Robson C (2002) Real World Research, 2nd edition, Blackwell, Oxford, UK
Zelkowitz MV, Wallace DR (1998) Experimental Models for Validating Technology. IEEE Computer, 31(5):23–31
Manly BFJ (1994) Multivariate Statistical Methods-A Primer, 2nd edition, Chapman & Hall, London
Stake RE (1995) The Art of Case Study Research, SAGE Publications, London, UK
Pfleeger S (1994–1995) Experimental Design and Analysis in Software Engineering Parts 1–5. ACM Sigsoft, Software Engineering Notes, 19(4):16–20; 20(1):22–26; 20(2):14–16; 20(3):13–15; 20(4):14–17
Yin RK (1994) Case Study Research Design and Methods, Sage Publications, Beverly Hills, CA, USA
Babbie E (1990) Survey Research Methods, Wadsworth, Monterey, CA, USA
Tukey JW (1977) Exploratory Data Analysis, Addison-Wesley, Reading, MA, USA
Robson C (1994) Design and Statistics in Psychology, 3rd edition, Penguin Books, London, UK
Wohlin C, Runeson P, Höst M, Ohlsson MC, Regnell B, Wesslén A (1999) Experimentation in Software Engineering — An Introduction, Kluwer Academic Publishers, Boston, MA, USA
Judd CM, Smith ER, Kidder LH (1991) Research Methods in Social Relations, Harcourt Brace Jovanovich College Publishers, Forth Worth, TX, USA, 6th edition
Juristo N, Moreno A (2001) Basics of Software Engineering Experimentation, Kluwer Academic Publishers, Boston, MA, USA
Birk A, Dingsøyr T, Stålhane T (2002) Postmortem: Never Leave a Project without It. IEEE Software, May/June, 43–45
Collier B, DeMarco T, Fearey P (1996) A Defined Process for Project Postmortem Review. IEEE Software, July, 65–72
Whitten N (1995) Managing Software Development Projects — Formula for Success, John Wiley & Sons, NY, USA
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Wohlin, C., Höst, M., Henningsson, K. (2006). Empirical Research Methods in Web and Software Engineering. In: Mendes, E., Mosley, N. (eds) Web Engineering. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-28218-1_13
Download citation
DOI: https://doi.org/10.1007/3-540-28218-1_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28196-2
Online ISBN: 978-3-540-28218-1
eBook Packages: Computer ScienceComputer Science (R0)