Abstract
Context and motivation: Requirements of todays industry specifications need to be categorized for multiple reasons, including analysis of certain requirement types (like non-functional requirements) and identification of dependencies among requirements.This is a pre-requisite for effective communication and prioritization of requirements in industry-size specifications. Question/problem: Because of the size and complexity of these specifications, categorization tasks must be specifically supported in order to minimize manual efforts and to ensure a high classification accuracy. Approaches that make use of (supervised) automatic classification algorithms have to deal with the problem to provide enough training data with excellent quality. Principal ideas/results: In this paper, we discuss the requirements engineering team and their requirements management tool as a socio-technical system that allows consistent classification of requirements with a focus on organizational learning. We compare a manual, a semi-automatic, and a fully-automatic approach for the classification of requirements in this environment. We evaluate performance of these approaches by measuring effort and accuracy of automatic classification recommendations and combined performance of user and tool, and capturing the opinion of the expert-participants in a questionnaire. Our results show that a semiautomatic approach is most promising, as it offers the best ratio of quality and effort and the best learning performance. Contribution: Our contribution is the definition of a socio-technical system for requirements classification and its evaluation in an industrial setting at Mercedes-Benz with a team of ten practitioners.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Regnell, B., Svensson, R.B., Wnuk, K.: Can we beat the complexity of very large-scale requirements engineering? In: Rolland, C. (ed.) REFSQ 2008. LNCS, vol. 5025, pp. 123–128. Springer, Heidelberg (2008)
Song, X., Hwong, B.: Categorizing requirements for a contract-based system integration project. In: Requirements Engineering Conference (RE), pp. 279–284. IEEE (2012)
Knauss, E., Houmb, S., Schneider, K., Islam, S., Jürjens, J.: Supporting requirements engineers in recognising security issues. In: Berry, D. (ed.) REFSQ 2011. LNCS, vol. 6606, pp. 4–18. Springer, Heidelberg (2011)
Neumann, P.G.: Requirements-related risks in critical systems. In: Proceedings of the 4th International Conference on Requirements Engineering (ICRE 2000), Schaumburg, IL, USA, p. 3 (2000)
Chung, L.: Dealing with Security Requirements During the Development of Information Systems. In: Rolland, C., Cauvet, C., Bodart, F. (eds.) CAiSE 1993. LNCS, vol. 685, pp. 234–251. Springer, Heidelberg (1993)
Dubois, E., Wu, S.: A framework for dealing with and specifying security requirements in information systems. In: Katsikas, S., Gritzalis, D. (eds.) SEC. IFIP Conference Proceedings, vol. 54, pp. 88–99. Chapman & Hall, Boca Raton (1996)
Ott, D.: Automatic requirement categorization of large natural language specifications at mercedes-benz for review improvements. In: Doerr, J., Opdahl, A.L. (eds.) REFSQ 2013. LNCS, vol. 7830, pp. 50–64. Springer, Heidelberg (2013)
Houdek, F.: Challenges in Automotive Requirements Engineering. In: Industrial Presentations at REFSQ 2010, Essen (2010)
Gnesi, S., Lami, G., Trentanni, G., Fabbrini, F., Fusani, M.: An automatic tool for the analysis of natural language requirements. International Journal of Computer Systems Science & Engineering 20(1), 53–62 (2005)
Ko, Y., Park, S., Seo, J., Choi, S.: Using classification techniques for informal requirements in the requirements analysis-supporting system. Information and Software Technology 49, 1128–1140 (2007)
Hussain, I., Ormandjieva, O., Kosseim, L.: Lasr: A tool for large scale annotation of software requirements. In: Second IEEE International Workshop on Empirical Requirements Engineering (EmpiRE), pp. 57–60. IEEE (2012)
Witten, I., Frank, E., Hall, M.: Data Mining: Practical Machine Learning Tools and Techniques: Practical Machine Learning Tools and Techniques. Morgan Kaufmann (2011)
Hollink, V., Kamps, J., Monz, C., De Rijke, M.: Monolingual document retrieval for european languages. Information Retrieval 7(1), 33–52 (2004)
Carletta, J.: Squibs and discussions assessing agreement on classification tasks: The kappa statistic. Computational Linguistics 22(2), 249–254 (1996)
Ott, D., Raschke, A.: Review improvement by requirements classification at mercedes-benz: Limits of empirical studies in educational environments. In: IEEE Second International Workshop on Empirical Requirements Engineering (EmpiRE), pp. 1–8. IEEE (2012)
Runeson, P., Höst, M.: Guidelines for conducting and reporting case study research in software engineering. Empirical Software Eng. 14(2), 131–164 (2009)
Brooke, J.: SUS: A quick and dirty usability scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland, A.L. (eds.) Usability Evaluation in Industry. Taylor and Francis, London (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Knauss, E., Ott, D. (2014). (Semi-) automatic Categorization of Natural Language Requirements. In: Salinesi, C., van de Weerd, I. (eds) Requirements Engineering: Foundation for Software Quality. REFSQ 2014. Lecture Notes in Computer Science, vol 8396. Springer, Cham. https://doi.org/10.1007/978-3-319-05843-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-05843-6_4
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-05842-9
Online ISBN: 978-3-319-05843-6
eBook Packages: Computer ScienceComputer Science (R0)