Abstract
A number of empirical studies using students as subjects has been carried out in the last few years. These studies are usually conducted as pilot experiments that allow researchers to fine-tune an experiment before deploying it in an industrial environment. Though one of the issues usually taken into account with these experiments is their external validity, other issues need to be considered, such as the usefulness of these experiments in the context of a software engineering course. This chapter concisely reports on three empirical studies performed at the Università degli Studi dell’Insubria during the ESERNET project and two other empirical studies that we carried out previously, all with students as subjects, so as to provide the context for a discussion on the research and the educational goals that should be taken into account when carrying out an experiment with students to make it successful from both an empirical and an educational viewpoint. Finally, we provide some advice on how to carry out empirical studies with students based on our experiences.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Denning, P.: Educating a New Engineer. Communication of the ACM 35, 83–97 (1992)
Meyer, B.: Software Engineering in the Academy. IEEE Computer 34, 28–35 (2001)
Hilburn, T.B., Humphrey, W.S.: The Impending Changes in Software Engineering Education. IEEE Software 19, 22–24 (2002)
Lethbridge, C.T.: On the Relevance of software education: A survey and some Recommendations. Annals of Software Engineering 6, 91–110 (1998)
Cannon, R., Diaz-Herrera, J., Hilburn, T.B.: Teaching a Software Project Course Using the Team Software Process. In: ACM SIGCSE Bulletin, 33rd SIGCSE Technical Symposium on Computer Science Education, vol. 34, pp. 369–370 (2002)
Melody, M., Moore, C.P.: Learning by Doing: Goals & Experience of Two Software Engineering Project Courses. In: Proc. Software Engineering Education, 7th SEI CSEE Conference, pp. 151–164 (1994)
Andersen, R., Krogstie, R.C.J., Sindre, G., Sølvberg, A.: Project Courses at the NTH: 20 Years of Experience. In: Proc. Software Engineering Education, 7th SEI CSEE Conference, pp. 177–188 (1994)
Bagert, D.J., Hilburn, T.B., Hislop, G., Lutz, M., McCracken, M., Mengel, S.: Guidelines for Software Engineering Education Version 1.0. CMU/SEI, CMU/SEI–99–TR–032 (1999)
Morasca, S.: A Bayesian Approach to Software Testing Evaluation. Università degli Studi dell’Insubria Dipartimento di Scienze Chimiche, Fisiche e Matematiche, Como, Italy (2003) (submitted to pubblication)
Baresi, L., Morasca, S., Paolini, P.: An Empirical Study on the Design Effort of Web Applications. In: Proc. WISE 2002, pp. 345–354 (2002)
Jaccheri, L., Stålhane, T.: Evaluation of the E3 Process modelling language and tool for the purpose of model creation. In: Proc. 3rd International Conference on Product Focused Software Process Improvement, Profes (2001)
Runeson, P.: Using Students as Experiment Subjects – An Analysis on Graduate and Freshmen PSP Student Data. In: Proc. 7th International Conference on Evaluation and Assessment in Software Engineering, EASE 2003 (2003)
Höst, M., Regnell, B., Wohlin, C.: Using Students as Subjects – A Comparative Study of Students and Professionals in Lead-Time Impact Assessment. Empirical Software Engineering 5, 201–214 (2000)
Höst, M.: Introducing Empirical Software Engineering Methods in Education. In: Proc. Conference on Software Engineering Education and Training CSEE&T (2002)
Porter, A., Votta, L., Basili, V.R.: Comparing Detection Methods for Software Requirements Inspection: A Replicated Experiment. IEEE Transactions on Software Engineering 21, 563–575 (1995)
Shull, F., Carver, J., Travassos, G.H.: An Empirical Methodology for Introducing Software Processes. In: Proc. European Software Engineering Conference, pp. 288–296 (2001)
Melo, W., Shull, F., Travassos, G.H.: Software Review Guidelines. Systems Engineering and Computer Science Program, COPPE, Federal University, ES–556/01 Rio de Janeiro (2001)
Jørgensen, M., Teigen, K.H., Mølloken, K.: Better Sure than Safe? Overconfidence in Judgment Based Software Development Effort Prediction Intervals. Journal of Systems and Software (2003)
Reidar Conradi, P.M., Arif, T., Hegde, L.C., Bunde, G.A., Pedersen, A.: Object-Oriented Reading Techniques for Inspection of UML Models – An Industrial Experiment. In: Proc. European Conf. on Object-Oriented Programming (ECOOP’03) (2003) 13 p
Basili, V.R., Shull, F., Lanubile, F.: Building Knowledge through Families of Software Studies: An Experience Report. University of Maryland, CS–TR–3983 (1999)
Conradi, R., Basili, V.R., Carver, J., Shull, F., Travassos, G.H.: A Pragmatic Documents Standard for an Experience Library: Roles, Documents, Contents, and Structure. University of Maryland, CS–TR–4235 and UMIACS–TR–2001–24 (2001)
Shull, F., Basili, V.R., Carver, J., Maldonado, J.C., Travassos, G.H., Mendonca, M., Fabbri, S.: Replicating Software Engineering Experiments: Addressing the Tacit Knowledge Problem. In: Proc. International Symposium on Empirical Software Engineering, pp. 7–16 (October 2002)
Prechelt, L., Tichy, W.F.: A controlled experiment to assess the benefits of procedure argument type checking. IEEE Transactions on Software Engineering 24, 302–312 (1998)
Schank, R.C.: Revolutionizing the Traditional Classroom Course. COMMUNICATIONS OF THE ACM 44 (2001)
Robbins, K.A., Key, C.S., Dickinson, K.: Integrating a Simulation Case Study into CS2: Developing Design, Empirical and Analysis Skills. In: Proc. SIGCSE (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Carver, J., Jaccheri, L., Morasca, S., Shull, F. (2003). Using Empirical Studies during Software Courses. In: Conradi, R., Wang, A.I. (eds) Empirical Methods and Studies in Software Engineering. Lecture Notes in Computer Science, vol 2765. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45143-3_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-45143-3_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40672-3
Online ISBN: 978-3-540-45143-3
eBook Packages: Springer Book Archive