Abstract
Technical debt occurs when development teams take actions to expedite the delivery of a project at the cost of poor code quality and additional work of later refactoring. The accumulation of technical debt will make the software fixes prohibitively expensive. As a typical type of technical debt, Self-Admitted Technical Debt (SATD) is acknowledged by developers in code comments. Identifying SATD in code comments can improve code quality. However, manually discerning whether code comments contain SATD would be expensive and time-consuming. To solve this problem, we propose a method to apply the Ladder Network with the pre-training model to identify SATD based on the labeled data from 10 open source projects and the unlabeled data from another ten projects. By comparing with the original model of Ladder Network, and other semi-supervised learning models, the results show that the proposed method performs better in technical debt identification. In addition, the proposed method also achieves better results compared with supervised learning methods. This shows that our approach can make better use of unlabeled data to improve classification performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cunningham, W.: The WyCash portfolio management system. ACM SIGPLAN OOPS Messenger 4(2), 29–30 (1992)
Zazworka, N., Shaw, M.A., Shull, F., Seaman, C.: Investigating the impact of design debt on software quality. In: Proceedings of the 2nd Workshop on Managing Technical Debt, pp. 17–23. Association for Computing Machinery, USA (2011)
Potdar, A., Shihab, E.: An exploratory study on self-admitted technical debt. In: Proceedings of the 2014 IEEE International Conference on Software Maintenance and Evolution, pp. 91–100. IEEE Computer Society (2014)
Ren, X., Xing, Z., Xia, X., Lo, D., Wang, X., Grundy, J.: Neural network-based detection of self-admitted technical debt: from performance to explainability. ACM Trans. Softw. Eng. Methodol. (TOSEM) 4(2), 1–45 (2019)
Santos, R.M., Junior, M.C.R., de Mendonça Neto, M.G.: Self-admitted technical debt classification using LSTM neural network. In: Latifi, S. (ed.) 17th International Conference on Information Technology–New Generations (ITNG 2020). AISC, vol. 1134, pp. 679–685. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-43020-7_93
Santos, R., Santos, I., Júnior, M.C., et al.: Long term-short memory neural networks and Word2Vec for self-admitted technical debt detection. In: ICEIS, vol. 2, pp. 157–165 (2020)
Yu, D., Wang, L., Chen, X., Chen, J.: Using BiLSTM with attention mechanism to automatically detect self-admitted technical debt. Front. Comp. Sci. 15(4), 1–12 (2021). https://doi.org/10.1007/s11704-020-9281-z
Li, H., Qu, Y., Liu, Y., Chen, R., Ai, J., Guo, S.: Self-admitted technical debt detection by learning its comprehensive semantics via graph neural networks. Softw. Pract. Exp. 52(10), 2152–2176(2022)
de Freitsa Farias, M.A., de Mendonça Neto, M.G., da Silva, A.B., Spínola, R.O.: A contextualized vocabulary model for identifying technical debt on code comments. In: 2015 IEEE 7th International Workshop on Managing Technical Debt, pp. 25–32(2015)
Guo, Z., Liu, S., Liu, J., et al.: MAT: a simple yet strong baseline for identifying self-admitted technical debt. arXiv preprint arXiv:1910.13238 (2019)
Rasmus, A., Berglund, M., Honkala, M., et al.: Semi-supervised learning with ladder networks. In: Proceedings of the 28th International Conference on Neural Information Processing Systems, pp. 3546–3554. MIT Press, Montreal, Canada (2015)
Muangkammuen, P., Fukumoto, F., Li, J., et al.: Exploiting labeled and unlabeled data via transformer fine-tuning for peer-review score prediction. In: Findings of the Association for Computational Linguistics: EMNLP 2022, pp. 2233–2240. Association for Computational Linguistics (2022)
Devlin, J., Chang, M.W., Lee, K., et al.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics (2018)
da Silva, M., Shihab, E., Tsantalis, N.: Using natural language processing to automatically detect self-admitted technical debt. IEEE Trans. Softw. Eng., 1044–1062(2017)
Guo, Z., Liu, S., Liu, J., et al.: How far have we progressed in identifying self-admitted technical debts? A comprehensive empirical study. ACM Trans. Softw. Eng. Methodol. (TOSEM) 30(4), 1–56 (2021)
Miyato, T., Dai, A.M., Goodfellow, I.J.: Adversarial training methods for semi-supervised text classification. In: Proceedings of the 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, pp. 24–26 (2017)
Chen, J., Yang, Z., Yang, D.: MixText: linguistically-Informed interpolation of hidden space for semi-supervised text classification. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 2147–2157. Association for Computational Linguistics (2020)
Rizve, M.N., Duarte, K., Rawat, Y.S., Shah, M.: In defense of pseudo-labeling: an uncertainty-aware pseudo-label selection framework for semi-supervised learning. arXiv preprint arXiv:2101.06329 (2021)
Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30, pp. 5998–6008 (2017)
Kim, Y.: Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pp. 1746–1751. Association for Computational Linguistics (2014)
Liu, P., Qiu, X., Huang, X.: Recurrent neural network for text classification with multi-task learning. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence, pp. 2873–2879 (2016)
Yao, L., Mao, C., Luo, Y.: Graph convolutional networks for text classification. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 1, pp. 7370–7377 (2019)
Acknowledgements
We would like to thank anonymous reviewers for their helpful comments and suggestions. This work is supported by Support Center for Advanced Telecommunications Technology Research (SCAT), JKA, Kajima Foundation’s Support Program, JSPS KAKENHI (No. 21K12026, 22K12146 and 23H03402), and National Natural Science Foundation of China (No. 62372145).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Gong, A., Fukumoto, F., Muangkammuen, P., Li, J., Yu, D. (2024). Identifying Self-admitted Technical Debt with Context-Based Ladder Network. In: Luo, B., Cheng, L., Wu, ZG., Li, H., Li, C. (eds) Neural Information Processing. ICONIP 2023. Communications in Computer and Information Science, vol 1969. Springer, Singapore. https://doi.org/10.1007/978-981-99-8184-7_7
Download citation
DOI: https://doi.org/10.1007/978-981-99-8184-7_7
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8183-0
Online ISBN: 978-981-99-8184-7
eBook Packages: Computer ScienceComputer Science (R0)