Abstract
Background: Large software development organizations require effective means of quantifying excellence of products and improvement areas. A good quantification of excellence supports organizations in retaining market leadership. In addition, a good quantification of improvement areas is needed to continuously increase performance of products and processes.
Objective: In this chapter we present a method for developing product and organizational performance profiles. The profiles are a means of quantifying prerelease properties of products and quantifying performance of software development processes.
Method: We conducted two case studies at three companies—Ericsson, Volvo Group Truck Technology, and Volvo Car Corporation. The goal of first case study is to identify risky areas of source code. We used a focus group to elicit and evaluate measures and indicators at Ericsson. Volvo Group Truck Technology was used to validate our profiling method.
Results: The results of the first case study showed that profiling of product performance can be done by identifying risky areas of source code using combination of two measures—McCabe complexity and number of revisions of files. The results of second case study show that profiling change frequencies of models can help developers identify implicit architectural dependencies.
Conclusions: We conclude that profiling is an effective tool for supporting improvements of product and organizational performance. The key for creating useful profiles is the close collaboration between research and development organizations.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Glass, R.L.: Sorting out software complexity. Commun. ACM 45, 19–21 (2002)
Kahn, B.K., Strong, D.M., Wang, R.Y.: Information quality benchmarks: product and service performance. Commun. ACM 45, 184–192 (2002)
Issaverdis, J.: The pursuit of excellence: Benchmarking, accreditation, best practice and auditing. In: The Encyclopedia of Ecotourism, pp. 579–594. CAB International, Oxon (2001)
Staron, M., Meding, W., Karlsson, G., Nilsson, C.: Developing measurement systems: an industrial case study. J. Softw. Maint. Evol. Res. Pract. 23, 89–107 (2010)
Staron, M.: Critical role of measures in decision processes: managerial and technical measures in the context of large software development organizations. Inf. Softw. Technol. 54, 887–899 (2012)
Sandberg, A., Pareto, L., Arts, T.: Agile collaborative research: action principles for industry–academia collaboration. IEEE Softw. 28, 74–83 (2011)
Feldt, R., Staron, M., Hult, E., Liljegren, T.: Supporting software decision meetings: Heatmaps for visualising test and code measurements. Presented at the 39th Euromicro conference on software engineering and advanced applications, Santander, 2013
Robillard, P.N., Coupal, D., Coallier, F.: Profiling software through the use of metrics. Softw. Pract. Exp. 21, 507–518 (1991)
Kitson, D.H., Masters, S.M.: An analysis of SEI software process assessment. In: Proceedings of the 15th International Conference on Software Engineering, pp. 68–77 (1993)
Petersen, K., Wohlin, C.: Software process improvement through the Lean Measurement (SPI-LEAM) method. J. Syst. Softw. 83, 1275–1287 (2010)
Staron, M., Meding, W., Söderqvist, B.: A method for forecasting defect backlog in large streamline software development projects and its industrial evaluation. Inf. Softw. Technol. 52, 1069–1079 (2010)
Wettel, R., Lanza, M.: Visual exploration of large-scale system evolution. In: 15th Working Conference on Reverse Engineering, pp. 219–228 (2008)
Voinea, L., Lukkien, J., Telea, A.: Visual assessment of software evolution. Sci. Comput. Program. 65, 222–248 (2007)
Boehm, B.W.: Software engineering economics. IEEE Trans. Softw. Eng. SE-10, 4–21 (1984)
Ruhe, G.: Software engineering decision support – A new paradigm for learning software organizations. In: Henninger, S., Maurer, F. (eds.) Advances in Learning Software Organizations, vol. 2640, pp. 104–113. Springer, Berlin (2003)
Lawler, J., Kitchenham, B.: Measurement modeling technology. IEEE Softw. 20, 68–75 (2003)
International Standard Organization and International Electrotechnical Commission. ISO/IEC 15939 Software Engineering – Software Measurement Process. International Standard Organization/International Electrotechnical Commission, Geneva (2007)
Elbashir, M.Z., Collier, P.A., Davern, M.J.: Measuring the effects of business intelligence systems: the relationship between business process and organizational performance. Int. J. Account. Inf. Syst. 9, 135–153 (2008)
Milis, K., Mercken, R.: The use of the balanced scorecard for the evaluation of information and communication technology projects. Int. J. Proj. Manag. 22, 87–97 (2004)
Visser, J.K., Sluiter, E.: Performance measures for a telecommunications company. In: AFRICON Conference, pp. 1–8 (2007)
Bourne, M., Franco-Santos, M., Cranfield School of Management. Centre for Business Performance: Corporate Performance Management. SAS Institute, Cary (2004)
Wade, D., Recardo, R.J.: Corporate Performance Management: How to Build a Better Organization Through Measurement-Driven Strategic Alignment. Butterworth–Heinemann, Boston (2001)
Staron, M.: Critical role of measures in decision processes: managerial and technical measures in the context of large software development organizations. Inf. Softw. Technol. 54(8), 887–899 (2012)
Lee, Y.W., Strong, D.M., Kahn, B.K., Wang, R.Y.: AIMQ: a methodology for information quality assessment. Inf. Manag. 40, 133–146 (2002)
Staron, M., Meding, W.: Ensuring reliability of information provided by measurement systems. In: Software Process and Product Measurement, pp. 1–16. Springer, Berlin (2009)
Kahn, B.K., Strong, D.M., Wang, R.Y.: Information quality benchmarks: product and service performance. Commun. ACM 45, 184–192 (2002)
Mayer, D.M., Willshire, M.J.: A data quality engineering framework. In: International Conference on Information Quality, pp. 1–8 (1997)
Goodhue, D.L., Thompson, R.L.: Task-technology fit and individual performance. MIS Q. 19, 213–237 (1995)
Serrano, M., Calero, C., Trujillo, J., Lujan-Mora, S., Piattini, M.: Empirical validation of metrics for conceptual models of data warehouses. In: International Conference on Information Systems Engineering CAiSE, pp. 506–520 (2004)
Burkhard, R., Spescha, G., Meier, M.: “A-ha!”: how to visualize strategies with complementary visualizations. In: Conference on Visualising and Presenting Indicator Systems, pp. 1–9 (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Antinyan, V., Staron, M., Meding, W. (2014). Profiling Prerelease Software Product and Organizational Performance. In: Bosch, J. (eds) Continuous Software Engineering. Springer, Cham. https://doi.org/10.1007/978-3-319-11283-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-11283-1_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11282-4
Online ISBN: 978-3-319-11283-1
eBook Packages: Computer ScienceComputer Science (R0)