Abstract
Base measures such as the number of lines-of-code are often used to make predictions about such phenomena as project effort, product quality or maintenance effort. However, quite often we rely on the measurement instruments where the exact algorithm for calculating the value of the measure is not known. The objective of our research is to explore how we can increase the certainty of base measures in software engineering. We conduct a benchmarking study where we use four measurement instruments for lines-of-code measurement with unknown certainty to measure five code bases. Our results show that we can adjust the measurement values by as much as 20 % knowing the systematic error of the tool. We conclude that calibrating the measurement instruments can significantly contribute to increased accuracy in measurement processes in software engineering. This will impact the accuracy of predictions (e.g. of effort in software projects) and therefore increase the cost-efficiency of software engineering processes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abran, A.: Software Metrics and Software Metrology. Wiley (2010)
Albrecht, A.J., Gaffney, J.E.: Software function, source lines of code, and development effort prediction: a software science validation. IEEE Trans. Softw. Eng. 6, 639–648 (1983)
Boehm, B.: Managing software productivity and reuse. Computer 32(9), 111–113 (1999)
Boehm, B., Clark, B., Horowitz, E., Westland, C., Madachy, R., Selby, R.: Cost models for future software life cycle processes: Cocomo 2.0. Ann. Softw. Eng. 1(1), 57–94 (1995)
Briand, L., El Emam, K., Morasca, S.: On the application of measurement theory in software engineering. Empir. Softw. Eng. 1(1), 61–88 (1996)
Briand, L.C., Morasca, S., Basili, V.R.: Property-based software engineering measurement. IEEE Tran. Softw. Eng. 22(1), 68–86 (1996)
Davis, J.S., LeBlanc, R.J.: A study of the applicability of complexity measures. IEEE Trans. Softw. Eng. 14(9), 1366–1372 (1988)
Khoshgoftaar, T.M., Munson, J.C.: The lines of code metric as a predictor of program faults: a critical analysis. In: Fourteenth Annual International on Computer Software and Applications Conference, 1990. COMPSAC90. Proceedings, pp. 408–413. IEEE (1990)
Kuzniarz, L., Staron, M.: Inconsistencies in student designs. In: The Proceedings of The 2nd Workshop on Consistency Problems in UML-based Software Development, San Francisco, CA, pp. 9–18. Citeseer (2003)
Lincke, R., Lundberg, J., Löwe, W.: Comparing software metrics tools. In: Proceedings of the 2008 International Symposium on Software Testing and Analysis, pp. 131–142. ACM (2008)
Nagappan, N., Ball, T.: Use of relative code churn measures to predict system defect density. In: 27th International Conference on Software Engineering, 2005. ICSE 2005. Proceedings, pp. 284–292. IEEE (2005)
Organization, I.S., Commission, I.E.: Software and systems engineering, software measurement process. Technical report. ISO/IEC (2007)
Rana, R., Staron, M., Berger, C., Hansson, J., Nilsson, M., Torner, F.: Evaluating long-term predictive power of standard reliability growth models on automotive systems. In: 2013 IEEE 24th International Symposium on Software Reliability Engineering (ISSRE), pp. 228–237. IEEE (2013)
Staron, M.: Critical role of measures in decision processes: managerial and technical measures in the context of large software development organizations. Inf. Softw. Technol. 54(8), 887–899 (2012)
Tian, J., Zelkowitz, M.V.: A formal program complexity model and its application. J. Syst. Softw. 17(3), 253–266 (1992)
International Bureau of Weights and Measures: International Vocabulary of Basic and General Terms in Metrology, 2nd edn. International Organization for Standardization, Genve, Switzerland (1993)
International Bureau of Weights and Measures: General requirements for the Competence of Testing and Calibration Laboratories, 1st edn. International Organization for Standardization, Genve, Switzerland (2005)
International Bureau of Weights and Measures: Systems and software engineering—Systems and software Quality Requirements and Evaluation (SQuaRE)—Guide to SQuaRE, 2nd edn. International Organization for Standardization, Genve, Switzerland (2014)
Weyuker, E.J.: Evaluating software complexity measures. IEEE Trans. Softw. Eng. 14(9), 1357–1365 (1988)
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesslén, A.: Experimentation in Software Engineering. Springer (2012)
Zuse, H.: A Framework of Software Measurement. Walter de Gruyter, Berlin (1998)
Acknowledgments
The authors would like to thank the doctoral students in the “Measurement in Software Engineering” course at the University of Gothenburg for the discussions on the topic of measurement error and measurement theory.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this paper
Cite this paper
Staron, M., Durisic, D., Rana, R. (2017). Improving Measurement Certainty by Using Calibration to Find Systematic Measurement Error—A Case of Lines-of-Code Measure. In: Madeyski, L., Śmiałek, M., Hnatkowska, B., Huzar, Z. (eds) Software Engineering: Challenges and Solutions. Advances in Intelligent Systems and Computing, vol 504. Springer, Cham. https://doi.org/10.1007/978-3-319-43606-7_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-43606-7_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-43605-0
Online ISBN: 978-3-319-43606-7
eBook Packages: EngineeringEngineering (R0)