Abstract
Software process improvement efforts often seek to shorten development lead-time. A potential means is to facilitate architectural changes by providing a design rationale, i.e. a documentation of why the architecture is built as it is. The hypothesis is that changes will be faster and more correct if such information is available during change impact analysis. This paper presents a controlled experiment where the value of having access to a retrospective design rationale is evaluated both quantitatively and qualitatively. Realistic change tasks are applied by 17 subjects from both industry and academia on two complex systems from the domain of embedded real-time systems. The results from the quantitative analysis show that, for one of the systems, there is a significant improvement in correctness and speed when subjects have access to a design rationale document. In the qualitative analysis, design rationale was considered helpful for speeding up changes and improving correctness. For the other system the results were inconclusive, and further studies are recommended in order to increase the understanding of the role of a design rationale in architectural evolution of software systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bass, L., Clements, P., Kazman, R.: Software Architecture in Practise. Addison Wesley, Reading (1998)
Bauer, N., Olsson, T., Runeson, P., Bratthall, L.: Lead-time Impact of Distributed Testing on Distributed Real-time Systems. In: Under submission. Lund University, Sweden (1999)
Bohner, S., Arnold, R. (eds.): Software Change Impact Analysis. IEEE Computer Society Press, Los Alamitos (1996)
Bratthall, L., Adelswärd, K., Eriksson, W., Runeson, P.: A Survey of Lead-Time Challenges in the Development and Evolution of Distributed Real-Time Systems (October 1999) (submitted)
Bratthall, L., Runeson, P.: Architecture Design Recovery of a Family of Embedded Software Systems - An Experience Report. In: Proc. First IFIP Working Conf. on Software Architecture, San Antonio, Texas (February 1999)
Bratthall, L., Runeson, P.: A Taxonomy of Orthogonal Properties of Software Architectures. In: Proc. 2nd Nordic Software Architecture Workshop, Ronneby (August 1999)
Brooks, F.: The Mythical Man-Month: Essays on Software Engineering. In: Ingram Int’l., USA (1995)
Conklin, J.: Hypertext: An Introduction and Survey. IEEE Computer 20(9), 17–41 (1987)
Cook, T.D., Campbell, D.T.: Quasi-Experimentation - Design and Analysis Issues for Field Settings. Houghton Mifflin Company (1979)
Cross, N.: The Nature and Nurture of Design Ability. Design Studies 11(3), 127–140 (1990)
Datar, S., Jordan, C., Kekre, S., Rajiv, S., Srinivasan, K.: New Product Development Structures and Time To Market. Management Science 43(4) (April 1997)
Fisher, G., Lemke, A.C., McCall, R., Morch, A.I.: Making Argumentation Serve Design. Human-Computer Interaction 6(3&4) (1991)
Grundy, J.: Software Architecture Modelling, Analysis and Implementation with SoftArch (January 2000) (submitted)
Halasz, F.G.: Reflections on NoteCards: Seven Issues for the Next Generation of Hypermedia Systems. Comm. of the ACM 31, 836–852 (1988)
Hamilton, F., Johnson, H.: An Empricial Study in Using Linked Documentation to Assist Software Maintenance. In: Human-Computer Interaction (Interact 1995), pp. 219–224. Chapman & Hall, London (1995)
Hendricks, K.B., Singhal, V.R.: Delays in New Product Introduction and the Market Value of the Firm: The Consequences of Being Late to the Market. Management Science 43(4) (April 1997)
Jarczyk, A.P.J., Løffler, P., Shipman III, F.M.: Design Rationale for Software Engineering: A Survey. In: Proc. 25th Annual Hawaii Int’l Conf. on System Sciences, pp. 577–586 (1992)
Jørgensen, A.H., Aboulafia, A.: Perceptions of Design Rationale. In: Human-Computer Interaction (Interact 1995), pp. 61–66. Chapman & Hall, London (1995)
Kruchten, P.: The 4+1 View Model. IEEE Software 12(6) (1995)
Lee, J., Lai, K.: What’s in Design Rationale? Human-Computer Interaction 6(3,4) (1991)
Lee, J.: Design Rationale Systems: Understanding the Issues. IEEE Expert, 78–85 (May/June 1997)
Message Sequence Charts (MSC), ITU-T Standard Z.120. International Telecommunication Union (1996)
Frankfort-Nachmias, C., Nachmias, D.: Research Methods in the Social Sciences, 4th edn. St. Martin’s Press, United Kingdom (1992)
Nelson, T.H.: A File Structure for the Complex, the Changing, and the Indeterminate. In: Proc. ACM National Conference, pp. 84–100 (1965)
Perry, D.E., Wolf, A.L.: Foundations for the Study of Software Architecture. Software Engineering Notes 17(4), 40–52 (1992)
Porter, M.E.: Competitive Strategy - Techniques for Analyzing Industries and Competitors. The Free Press, New York (1980)
Rein, G.L., Ellis, C.A.: rIBIS: A Real-time Group Hypertext System. Int’l. Journal of Man-Machine Studies 24, 349–367 (1991)
Shilling, M.A.: Technological Lockout: An Integrative Model of the Economic and Strategic Factors Driving Technology Success and Failure. Academy of Management Review 23(2) (1998)
Shum, S.J.: A Cognitive Analysis of Design Rationale Representation. Ph.D. Thesis, York University, Great Brittain (December 1991)
Specification and Description Language (SDL), ITU-T Standard Z.100. International Telecommunication Union (1992)
Stalk, G.: Time - the Next Source of Competitive Advatage. Harward Business Review 66(4) (1998)
Stefik, M., Foster, G., Bobrow, D.G., Kahn, K., Lanning, S., Suchman, L.: Beyond the chalkboard: Computer Support for collaboration and problem solving in meetings. Comm. of the ACM 30(1), 32–47 (1987)
Toulmin, S.: The Uses of Argument. Cambridge University Press, Cambridge (1958)
Urban, G.L., Carter, T., Gaskin, S., Mucha, S.: Market Share Rewards to Pioneering Brands: An Empirical Analysis and Strategic Implications. Management Science 32(6) (June 1986)
Wheelwrigt, S.C., Clark, K.B.: Leading Product Development - The Senior Manager’s Guide to Creating and Shaping the Enterprise. The Free Press, New York (1995)
Wohlin, C.: The Challenge of Large Scale Software Development in an Educational Environment. In: Proc. Conf. on Software Engineering Education & Training, pp. 40–52. Virginia Beach, Virginia (1997)
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesslén, A.: Experimentation in Software Engineering: An Introduction. Kluwer Academic Publishers, Boston (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bratthall, L., Johansson, E., Regnell, B. (2000). Is a Design Rationale Vital when Predicting Change Impact? – A Controlled Experiment on Software Architecture Evolution. In: Bomarius, F., Oivo, M. (eds) Product Focused Software Process Improvement. PROFES 2000. Lecture Notes in Computer Science, vol 1840. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45051-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-540-45051-1_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67688-1
Online ISBN: 978-3-540-45051-1
eBook Packages: Springer Book Archive