skip to main content
10.1145/3474624.3474648acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbesConference Proceedingsconference-collections
research-article

On the relation between technical debt indicators and quality criteria in Stack Overflow discussions

Published: 05 October 2021 Publication History

Abstract

Context: Technical debt (TD) can compromise the quality of software systems in the long term. However, depending on the needs and properties of the specific product, different quality characteristics may be considered in the assessment with different levels of relevance. In this way, quality characteristics can guide teams in managing the TD, from identifying to paying for the TD items relevant to each situation. Although a set of TD item indicators has been identified in the literature, there is no clear guidance on how these indicators can be efficiently used to identify TD items. Aims: To investigate, from the point of view of software professionals using the SO platform, the relationship between the TD item indicators and the quality characteristics of the system, in order to guide the use of indicators for greater efficiency and effectiveness in identifying and managing DT items from a quality perspective. Method: We extracted empirical evidence using data mining from discussions related to TD on the SO. From the execution of an analysis process, the quality characteristics related to the occurrence of DT items identified in the discussions, the respective indicators and types of debt were identified. Results: The main results reveal that maintainability is the characteristic most related to TD through its sub-characteristics: modifiability, testability and modularity. Code debt items can be related to all quality characteristics, while Infrastructure debt can resonate up to 6 characteristics. All quality characteristics have at least one associated indicator, with an emphasis on Maintainability with 13 high-level and 28 low-level indicators. The indicator related to version problems is the one with the highest number of quality features. Conclusion: The relationship between indicators, TD types and quality characteristics was organized in a conceptual diagram in order to assist software teams in identifying which TD items are related to the quality characteristics that are critical to the project context, contributing to decision making regarding the best strategy for debt management.

References

[1]
2013. ISO / IEC 25010 : 2011 Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — System and software quality models.
[2]
Nicolli S.R. Alves, Thiago S. Mendes, Manoel G. de Mendonça, Rodrigo O. Spínola, Forrest Shull, and Carolyn Seaman. 2016. Identification and Management of Technical Debt. Inf. Softw. Technol. 70, C (Feb. 2016), 100–121. https://doi.org/10.1016/j.infsof.2015.10.008
[3]
Paris Avgeriou, Philippe Kruchten, Ipek Ozkaya, and Carolyn Seaman. 2016. Managing Technical Debt in Software Engineering (Dagstuhl Seminar 16162). Dagstuhl Reports 6 (01 2016). https://doi.org/10.4230/DagRep.6.4.110
[4]
Sebastian Baltes, Christoph Treude, and Stephan Diehl. 2019. Sotorrent: Studying the origin, evolution, and usage of stack overflow code snippets. In Proceedings of the 16th International Conference on Mining Software Repositories. IEEE Press.
[5]
Alan Bandeira, Carlos Alberto Medeiros, Matheus Paixao, and Paulo Henrique Maia. 2019. We Need to Talk About Microservices: an Analysis from the Discussions on StackOverflow. In 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR). 255–259. https://doi.org/10.1109/MSR.2019.00051
[6]
Terese Besker, Antonio Martini, and Jan Bosch. 2017. Time to Pay Up Technical Debt from a Software Quality Perspective.
[7]
Nanette Brown, Yuanfang Cai, Yuepu Guo, Rick Kazman, Miryung Kim, Philippe Kruchten, Erin Lim, Alan MacCormack, Robert Nord, Ipek Ozkaya, Raghvinder Sangwan, Carolyn Seaman, Kevin Sullivan, and Nico Zazworka. 2010. Managing Technical Debt in Software-Reliant Systems. In Proceedings of the FSE/SDP Workshop on Future of Software Engineering Research (Santa Fe, New Mexico, USA) (FoSER ’10). Association for Computing Machinery, New York, NY, USA, 47–52. https://doi.org/10.1145/1882362.1882373
[8]
Ward Cunningham. 1992. The WyCash Portfolio Management System. In Addendum to the Proceedings on Object-Oriented Programming Systems, Languages, and Applications (Addendum) (Vancouver, British Columbia, Canada) (OOPSLA ’92). Association for Computing Machinery, New York, NY, USA, 29–30. https://doi.org/10.1145/157709.157715
[9]
Morgan Ericsson and Anna Wingkvist. 2019. TDMentions: A Dataset of Technical Debt Mentions in Online Posts. Proceedings of the Second International Conference on Technical Debt (2019), 123–124.
[10]
D. Falessi, M. A. Shaw, F. Shull, K. Mullen, and M. S. Keymind. 2013. Practical considerations, challenges, and requirements of tool-support for managing technical debt. In 2013 4th International Workshop on Managing Technical Debt (MTD). 16–19. https://doi.org/10.1109/MTD.2013.6608673
[11]
Diego Ivo C. Costa; Mariela I. Cortés; Eliakim Gama. 2021. Pacote de replicação para o artigo: “On the relation between technical debt indicators and quality criteria in Stack Overflow discussions”. https://zenodo.org/record/5113476#.YPV7XphKjIU
[12]
Eliakim Gama, Sávio Freire, Manoel Mendonça, Rodrigo O. Spínola, Matheus Paixao, and Mariela I. Cortés. 2020. Using Stack Overflow to Assess Technical Debt Identification on Software Projects. In Proceedings of the 34th Brazilian Symposium on Software Engineering (Natal, Brazil) (SBES ’20). Association for Computing Machinery, New York, NY, USA, 730–739. https://doi.org/10.1145/3422392.3422429
[13]
Eliakim Gama, Matheus Paixao, Emmanuel Sávio Silva Freire, and Mariela Inés Cortés. 2019. Technical Debt’s State of Practice on Stack Overflow: A Preliminary Study. In Proceedings of the XVIII Brazilian Symposium on Software Quality (Fortaleza, Brazil) (SBQS’19). Association for Computing Machinery, New York, NY, USA, 228–233. https://doi.org/10.1145/3364641.3364668
[14]
Yuepu Guo, Rodrigo Oliveira Spínola, and Carolyn Seaman. 2016. Exploring the Costs of Technical Debt Management — a Case Study. Empirical Softw. Engg. 21, 1 (Feb. 2016), 159–182. https://doi.org/10.1007/s10664-014-9351-7
[15]
P. Kruchten, R. L. Nord, and I. Ozkaya. 2012. Technical Debt: From Metaphor to Theory and Practice. IEEE Software 29, 6 (2012), 18–21. https://doi.org/10.1109/MS.2012.167
[16]
Zengyang Li, Paris Avgeriou, and Peng Liang. 2014. A Systematic Mapping Study on Technical Debt and Its Management. Journal of Systems and Software (12 2014). https://doi.org/10.1016/j.jss.2014.12.027
[17]
Zengyang Li, Paris Avgeriou, and Peng Liang. 2015. A systematic mapping study on technical debt and its management. Journal of Systems and Software 101 (2015), 193–220. https://doi.org/10.1016/j.jss.2014.12.027
[18]
R.C. Lupton and J.M. Allwood. 2017. Hybrid Sankey diagrams: Visual analysis of multidimensional data for understanding resource use. Resources, Conservation and Recycling 124 (2017), 141–151. https://doi.org/10.1016/j.resconrec.2017.05.002
[19]
Carlos Alberto Medeiros, Alan Bandeira, Paulo Henrique M. Maia, and Matheus Paixao. 2020. MDE in the Wild: An Exploratory Analysis on What Developers Are Discussing from Q&A Platforms. In Proceedings of the 34th Brazilian Symposium on Software Engineering (Natal, Brazil) (SBES ’20). Association for Computing Machinery, New York, NY, USA, 157–166. https://doi.org/10.1145/3422392.3422447
[20]
Nicolli Rios, Manoel Gomes de Mendonça Neto, and Rodrigo Oliveira Spínola. 2018. A tertiary study on technical debt: Types, management strategies, research trends, and base information for practitioners. Information and Software Technology 102 (2018), 117–145. https://doi.org/10.1016/j.infsof.2018.05.010
[21]
Forrest Shull. 2011. Perfectionists in a World of Finite Resources. IEEE Software 28, 2 (2011), 4–6. https://doi.org/10.1109/MS.2011.38

Cited By

View all
  • (2024)A Catalog of Prevention Strategies for Test Technical DebtProceedings of the XXIII Brazilian Symposium on Software Quality10.1145/3701625.3701692(706-717)Online publication date: 5-Nov-2024
  • (2023)Technical debt (TD) through the lens of TwitterJournal of Software: Evolution and Process10.1002/smr.254736:4Online publication date: 4-Mar-2023
  • (2022)Asking about Technical Debt: Characteristics and Automatic Identification of Technical Debt Questions on Stack OverflowProceedings of the 16th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3544902.3546245(45-56)Online publication date: 19-Sep-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
SBES '21: Proceedings of the XXXV Brazilian Symposium on Software Engineering
September 2021
473 pages
ISBN:9781450390613
DOI:10.1145/3474624
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 October 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Indicators
  2. Mining Software Repositories
  3. Quality Characteristics
  4. Stack Overflow
  5. Technical Debt

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

SBES '21
SBES '21: Brazilian Symposium on Software Engineering
September 27 - October 1, 2021
Joinville, Brazil

Acceptance Rates

Overall Acceptance Rate 147 of 427 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)A Catalog of Prevention Strategies for Test Technical DebtProceedings of the XXIII Brazilian Symposium on Software Quality10.1145/3701625.3701692(706-717)Online publication date: 5-Nov-2024
  • (2023)Technical debt (TD) through the lens of TwitterJournal of Software: Evolution and Process10.1002/smr.254736:4Online publication date: 4-Mar-2023
  • (2022)Asking about Technical Debt: Characteristics and Automatic Identification of Technical Debt Questions on Stack OverflowProceedings of the 16th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3544902.3546245(45-56)Online publication date: 19-Sep-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media