Abstract
One of the main goals of an applied research field such as requirements engineering is the transfer of research results to industrial use. To promote industrial adoption of technologies developed in academia, researchers need to provide tangible evidence of the advantages of using them. This can be done through industry validation, enabling researchers to test and validate technologies in a real setting with real users and applications. The evidence obtained, together with detailed information on how the validation was conducted, offers rich decision support material for industrial practitioners seeking to adopt new technologies. This paper presents a comprehensive systematic literature review of all papers published in the Requirements Engineering journal containing any type of technology evaluation. The aim is to gauge the support for technology transfer, i.e., to what degree industrial practitioners can use the reporting of technology evaluations in the journal as decision support for adopting the technologies in industrial practice. Findings show that very few evaluations offer full technology transfer support, i.e., have a realistic scale, application or subjects. The major improvement potential concerning support for technology transfer is found to be the subjects used in the evaluations. Attaining company support, including support for using practitioners as subjects, is vital for technology transfer and for researchers seeking to validate technologies.



Similar content being viewed by others
Notes
The search was carried out on June 23 2008 and two of the articles were published as online first articles. Inspec indexed articles from issue 1:1 up until issue 12:2. The rest of the issues were searched manually.
References
Pfleeger SL (1999) Understanding and improving technology transfer in software engineering. J Syst Softw 47(2–3):111–124. doi:10.1016/S0164-1212(99)00031-X
Pfleeger SL, Menezes W (2000) Marketing technology to software practitioners. IEEE Softw 17(1):27–33. doi:10.1109/52.819965
Sjoberg DIK, Anda B, Arisholm E et al (2002) Conducting realistic experiments in software engineering. In: Proceedings of the 18th international symposium on empirical software engineering, pp 17–26
Hsia P, Davis AM, Kung DC (1993) Status report: requirements engineering. IEEE Softw 10(6):75–79. doi:10.1109/52.241974
Neill CJ, Laplante PA (2003) Requirements engineering: the state of the practice. IEEE Softw 20(6):40–45. doi:10.1109/MS.2003.1241365
Potts C (1993) Software-engineering research revisited. IEEE Softw 10(5):19–28. doi:10.1109/52.232392
Glass RL (1994) The software-research crisis. IEEE Softw 11(6):42–47. doi:10.1109/52.329400
Zelkowitz MV, Wallace D (1997) Experimental validation in software engineering. Inf Softw Technol 39(11):735–743. doi:10.1016/S0950-5849(97)00025-6
Tichy WF, Lukowicz P, Prechelt L et al (1995) Experimental evaluation in computer science: a quantitative study. J Syst Softw 28(1):9–18. doi:10.1016/0164-1212(94)00111-Y
Maiden N (2005) What has requirements research ever done for us? IEEE Softw 22(4):104–105. doi:10.1109/MS.2005.113
Kitchenham B, Charters S (2007) Guidelines for performing systematic literature reviews in software engineering. Technical report EBSE 2007-001, Keele University and Durham University Joint Report
Guba EG, Lincoln YS (1989) Fourth generation evaluation. Sage, Newbury Park
Zelkowitz MV, Wallace DR, Binkley DW (1998) Culture Conflicts in Software Engineering Technology Transfer. Tech. report, University of Maryland, College Park
Gorschek T, Garre P, Larsson S et al (2006) A model for technology transfer in practice. IEEE Softw 23(6):88–95. doi:10.1109/MS.2006.147
Kaindl H, Brinkkemper S, Bubenko JA et al (2002) Requirements engineering and technology transfer: obstacles, incentives and improvement agenda. Requir Eng 7(3):113–123. doi:10.1007/s007660200008
Redwine ST, Riddle WE (1985) Software technology maturation. In: Proceedings of the 8th international conference on Software engineering, IEEE Computer Society Press, London, England, pp 189–200
Raghavan SA, Chand DR (1989) Diffusing software-engineering methods. IEEE Softw 6(4):81–90. doi:10.1109/52.31655
Zelkowitz MV (1996) Software engineering technology infusion within NASA. IEEE Trans Eng Manage 43(3):250–261. doi:10.1109/17.511836
Rogers EM (1995) Diffusion of Innovations. Free Press, New York
Wohlin C, Höst M, Mattsson C (1996) A framework for technology introduction in software organizations. In: Proceedings of the software process improvement conference, Brighton, UK, pp 167–176
Linkman S, Rombach HD (1997) Experimentation as a vehicle for software technology transfer—a family of software reading techniques. Inf Softw Technol 39(11):777–780. doi:10.1016/S0950-5849(97)00029-3
Kitchenham B, Pearl Brereton O, Budgen D et al (2009) Systematic literature reviews in software engineering—a systematic literature review. Inf Softw Technol 51(1):7–15. doi:10.1016/j.infsof.2008.09.009
Glass RL, Vessey I, Ramesh V (2002) Research in software engineering: an analysis of the literature. Inf Softw Technol 44(8):491–506. doi:10.1016/S0950-5849(02)00049-6
Jørgensen M (2007) Estimation of software development work effort: evidence on expert judgment and formal models. Int J Forecast 23(3):449–462. doi:10.1016/j.ijforecast.2007.05.008
Wieringa R, Maiden N, Mead N et al (2006) Requirements engineering paper classification and evaluation criteria: a proposal and a discussion. Requir Eng 11(1):102–107. doi:10.1007/s00766-005-0021-6
Wieringa R, Heerkens J (2006) The methodological soundness of requirements engineering papers: a conceptual framework and two case studies. Requir Eng 11(4):295–307. doi:10.1007/s00766-006-0037-6
Davis A, Dieste O, Hickey A, et al (2006) Effectiveness of requirements elicitation techniques: empirical results derived from a systematic review. In: Proceedings of the 14th IEEE international requirements engineering conference (RE’06), IEEE Computer Society, pp 176-185
Parviainen P, Tihinen M (2007) A survey of existing requirements engineering technologies and their coverage. Int J Softw Eng Knowl Eng 17(6):827–850. doi:10.1142/S0218194007003513
Dyba T, Dingsoyr T, Hanssen GK (2007) Applying systematic reviews to diverse study types: an experience report. In: Proceedings of the first international symposium on empirical software engineering and measurement (ESEM), pp 225–234
IEEE Computer Society (2004) SWEBOK. IEEE, Los Alamitos
Wohlin C, Runeson P, Höst M et al (2000) Experimentation in software engineering. Kluwer, Boston
Maiden N, Manning S, Jones S et al (2005) Generating requirements from systems models using patterns: a case study. Requir Eng 10(4):276–288. doi:10.1007/s00766-005-0010-9
Robson C (2002) Real world research. Blackwell, Cornwall
Leite J, Rossi G, Balaguer F et al (1997) Enhancing a requirements baseline with scenarios. Requir Eng 2(4):184–198. doi:10.1007/BF02745371
Leite J, Hadad GDS, Doorn JH et al (2000) A scenario construction process. Requir Eng 5(1):38–61. doi:10.1007/PL00010342
Cysneiros LM, Leite J, t Neto J (2001) A framework for integrating non-functional requirements into conceptual models. Requir Eng 6(2):97–115. doi:10.1007/s007660170008
Leite J, Doorn JH, Hadad GDS et al (2005) Scenario inspections. Requir Eng 10(1):1–21. doi:10.1007/s00766-003-0186-9
Juric R, Kuljis J (1999) Engineering requirements through use cases in complex business environment. Requir Eng 4(2):65–76. doi:10.1007/s007660050013
Dutoit AH, Paech B (2002) Rationale-based use case specification. Requir Eng 7(1):3–19. doi:10.1007/s007660200001
Richards D (2003) Merging individual conceptual models of requirements. Requir Eng 8(4):195–205. doi:10.1007/s00766-002-0158-5
Siau K, Lee L (2004) Are use case and class diagrams complementary in requirements analysis? An experimental study on use case and class diagrams in UML. Requir Eng 9(4):229–237. doi:10.1007/s00766-004-0203-7
Saiedian H, Kumarakulasingam P, Anan M (2005) Scenario-based requirements analysis techniques for real-time software systems: a comparative evaluation. Requir Eng 10(1):22–33. doi:10.1007/s00766-004-0192-6
Gorschek T, Garre P, Larsson S et al (2007) Industry evaluation of the requirements abstraction model. Requir Eng 12(3):163–190. doi:10.1007/s00766-007-0047-z
Regnell B, Höst M, och Dag JN et al (2001) An industrial case study on distributed prioritisation in market-driven requirements engineering for packaged software. Requir Eng 6(1):51–62. doi:10.1007/s007660170015
Gorschek T, Wohlin C (2006) Requirements abstraction model. Requir Eng 11(1):79–101
Aurum A, Wohlin C (2005) Engineering and managing software requirements. Springer, Heidelberg
Brinkkemper S (2004) Requirements engineering research the industry is (and is not) waiting for. In: Proceedings of the 10th anniversary international workshop on requirements engineering: foundation for software quality (REFSQ’04), Riga, Latvia, pp 41–54
Karlsson L, Dahlstedt AG, Regnell B et al (2007) Requirements engineering challenges in market-driven software development—An interview study with practitioners. Inf Softw Technol 49(6):588–604. doi:10.1016/j.infsof.2007.02.008
Parnas DL (2007) Stop the numbers game. Commun ACM 50(11):19–21. doi:10.1145/1297797.1297815
Lauesen S, Vinter O (2001) Preventing requirement defects: an experiment in process improvement. Requir Eng 6(1):37–50. doi:10.1007/PL00010355
Breen M (2005) Experience of using a lightweight formal specification method for a commercial embedded system product line. Requir Eng 10(2):161–172. doi:10.1007/s00766-004-0209-1
Cherry C, Macredie RD (1999) The importance of context in information system design: an assessment of participatory design. Requir Eng 4(2):103–114. doi:10.1007/s007660050017
Lang M, Duggan J (2001) A tool to support collaborative software requirements management. Requir Eng 6(3):161–172. doi:10.1007/s007660170002
Toval A, Nicolás J, Moros B et al (2002) Requirements reuse for improving information systems security: a practitioner’s approach. Requir Eng 6(4):205–219. doi:10.1007/PL00010360
Herrmann A, Paech B (2008) MOQARE: misuse-oriented quality requirements engineering. Requir Eng 13(1):73–86. doi:10.1007/s00766-007-0058-9
Jiang L, Eberlein A, Far B (2008) A case study validation of a knowledge-based approach for the selection of requirements engineering techniques. Requir Eng 13(2):117–146. doi:10.1007/s00766-007-0060-2
Kitchenham BA, Pfleeger SL, Pickard LM et al (2002) Preliminary guidelines for empirical research in software engineering. IEEE Trans Softw Eng 28(8):721–734. doi:10.1109/TSE.2002.1027796
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Ivarsson, M., Gorschek, T. Technology transfer decision support in requirements engineering research: a systematic review of REj. Requirements Eng 14, 155–175 (2009). https://doi.org/10.1007/s00766-009-0080-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00766-009-0080-1