skip to main content
10.1145/3592813.3592922acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbsiConference Proceedingsconference-collections
research-article

Survey of Software Maintenance Metrics: A Systematic Literature Review

Published: 26 June 2023 Publication History

Abstract

The software maintenance area is one of the oldest in software engineering, which is a fundamental role in all development, ensuring the final product quality and stability in the market. However, the control of software maintenance metrics becomes a difficult task, as there are no consistent applicability normalization for these metrics, and it is up to the software maintenance teams to decide which metrics to apply. In order to identify the main metrics used in the software maintenance area, we carried out a systematic review of the literature on the relevant studies published in the period between 1990-2020 into the main search engines in the area of software engineering. According to the keywords and inclusion and exclusion criteria, 44 out of 2145 articles were selected on the IEEE, ACM Digital Library, ScienceDirect, SCOPUS and Wiley Interscience. Thus, the software maintenance metrics were identified in the product, process and resource perspectives more widely directed towards the product, as well as the application validation of these metrics are made through technical experimentation of the measurement, that is, validations in a controlled environment that often do not match the reality of the software maintenance environment. Therefore, it is highlighted that the analysis of software maintenance metrics is a promising area for new researches targeting distinct perspectives, including in a real software maintenance environment.

References

[1]
Alain April. 2008. Software Maintenance Management : Evaluation and Continuous Improvement. https://doi.org/10.1002/9780470258033
[2]
Diego Buchinger, Gustavo Cavalcanti, and Marcelo Hounsell. 2014. Mecanismos de busca acadêmica: uma análise quantitativa. Revista Brasileira de Computação Aplicada 6, 1 (abr. 2014), 108–120. https://doi.org/10.5335/rbca.2014.3452
[3]
Coral Calero, Manuel Bertoa, and Maria Moraga. 2013. A systematic literature review for software sustainability measures, In 2013 2nd International Workshop on Green and Sustainable Software (GREENS). 2013 2nd International Workshop on Green and Sustainable Software, GREENS 2013 - Proceedings, 46–53. https://doi.org/10.1109/GREENS.2013.6606421
[4]
Anuradha Chug and R. Malhotra. 2016. Benchmarking framework for maintainability prediction of open source software using object oriented metrics. International Journal of Innovative Computing, Information and Control - ICIC International 2016 12 (01 2016), 615–634.
[5]
W.E. Deming. 2000. Out of the Crisis. Massachusetts Institute of Technology, Center for Advanced Engineering Study. https://books.google.com.br/books?id=LA15eDlOPgoC
[6]
T. Dyba, T. Dingsoyr, and G. K. Hanssen. 2007. Applying Systematic Reviews to Diverse Study Types: An Experience Report. In First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007). 225–234.
[7]
Lem O. Ejiogu. 1993. Five Principles for the Formal Validation of Models of Software Metrics. SIGPLAN Not. 28, 8 (Aug. 1993), 67–76. https://doi.org/10.1145/163114.163123
[8]
Norman E. Fenton and Shari Lawrence Pfleeger. 2004. Software Metrics: A Rigorous and Practical Approach (2nd ed. Revisited Printing). International Thomson Computer Press., London.
[9]
Félix García, Manuel F. Bertoa, Coral Calero, Antonio Vallecillo, Francisco Ruíz, Mario Piattini, and Marcela Genero. 2006. Towards a consistent terminology for software measurement. Information and Software Technology 48, 8 (2006), 631 – 644. https://doi.org/10.1016/j.infsof.2005.07.001
[10]
Xin Huang, He Zhang, Xin Zhou, Muhammad Ali Babar, and Song Yang. 2018. Synthesizing Qualitative Research in Software Engineering: A Critical Review. In Proceedings of the 40th International Conference on Software Engineering (Gothenburg, Sweden) (ICSE ’18). Association for Computing Machinery, New York, NY, USA, 1207–1218. https://doi.org/10.1145/3180155.3180235
[11]
ISO/IEC. 2017. 15939:2017, Software Engineering-Software Measurement Process. Technical Report 15939. ISO/IEC.
[12]
Barbara Kitchenham. 2010. What’s up with Software Metrics? - A Preliminary Mapping Study. J. Syst. Softw. 83, 1 (Jan. 2010), 37–51. https://doi.org/10.1016/j.jss.2009.06.041
[13]
Barbara; Kitchenham and Stuart Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. 2 (01 2007).
[14]
A. Klock. 2018. Mapeamentos e Revisões Sistemáticos da Literatura: um Guia Teórico e Prático.
[15]
Ayman Meidan, Julián A. García-García, Isabel Ramos, and María José Escalona. 2018. Measuring Software Process: A Systematic Mapping Study. ACM Comput. Surv. 51, 3, Article 58 (June 2018), 32 pages. https://doi.org/10.1145/3186888
[16]
M. M. Paduelli. 2007. Manutenção de Software: problemas típicos e diretrizes para uma disciplina específica. Master’s thesis. USP, SP.
[17]
Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008. Systematic Mapping Studies in Software Engineering. Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering 17 (06 2008).
[18]
Kai Petersen and Claes Wohlin. 2009. Context in industrial software engineering research. 2009 3rd International Symposium on Empirical Software Engineering and Measurement, ESEM 2009 (10 2009). https://doi.org/10.1145/1671248.1671293
[19]
Roger S. Pressman. 2011. Engenharia de software: uma abordagem profissional. AMGH, Porto Alegre.
[20]
I. Sommerville. 2011. Engenharia de software. Pearson. https://books.google.com.br/books?id=H4u5ygAACAAJ
[21]
Ervin Varga. 2018. Unraveling Software Maintenance and Evolution: Thinking Outside the Box (1st ed.). Springer Publishing Company, Incorporated.
[22]
Hong Wu, Lin Shi, Celia Chen, Qing Wang, and Barry Boehm. 2016. Maintenance Effort Estimation for Open Source Software: A Systematic Literature Review. In 2016 IEEE International Conference on Software Maintenance and Evolution (ICSME). 32–43. https://doi.org/10.1109/ICSME.2016.87

Cited By

View all
  • (2024)"Slipping through the cracks": A Duoethnography of Web AccessibilityProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688543(1-6)Online publication date: 27-Oct-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
SBSI '23: Proceedings of the XIX Brazilian Symposium on Information Systems
May 2023
490 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 June 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. metrics
  2. software maintenance
  3. survey
  4. systematic literature review

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

SBSI '23

Acceptance Rates

Overall Acceptance Rate 181 of 557 submissions, 32%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)58
  • Downloads (Last 6 weeks)4
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)"Slipping through the cracks": A Duoethnography of Web AccessibilityProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688543(1-6)Online publication date: 27-Oct-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media