Skip to main content
SpringerLink
Log in
Book cover

International Conference on Computational Science and Its Applications

ICCSA 2022: Computational Science and Its Applications – ICCSA 2022 Workshops pp 62–78Cite as

Comparing Univariate and Multivariate Time Series Models for Technical Debt Forecasting

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13380))

Abstract

Technical debt (TD) is a successful and widely used metaphor that expresses the quality compromises that can yield short-term benefits but may negatively affect the overall quality of a software product in the long run. There is a vast variety of techniques and methodologies that have been proposed over the past years to enable the identification and estimation of TD during the software development cycle. However, it is only until recently that researchers have turned towards the investigation of methods that focus on forecasting its future evolution. Getting insights on the future evolution of TD can enable on-time decision-making and allow stakeholders to plan preventive strategies regarding TD repayment. In our previous studies, we have investigated time series analysis and Machine Learning techniques in order to produce reliable TD forecasts. In our current attempt, we aim to explore the capabilities of a statistical ARIMA model both in a univariate and a multivariate fashion. More specifically, the present paper investigates whether the adoption of an ARIMA model that takes into account, in addition to the TD value itself, various TD-related indicators may lead to more accurate TD predictions than its univariate alternative. For this purpose, dedicated models are constructed, evaluated, and compared on a dataset of five long-lived, open-source software applications.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://github.com/clowee/The-Technical-Debt-Dataset.

  2. 2.

    https://www.sonarqube.org/.

References

  1. Cunningham, W.: The WyCash portfolio management system. ACM SIGPLAN OOPS Messenger 4(2), 29–30 (1993)

    Article  Google Scholar 

  2. Besker, T., Martini, A., Bosch, J.: Software developer productivity loss due to technical debt-A replication and extension study examining developers’ development work. J. Syst. Softw. 156, 41–61 (2019)

    Article  Google Scholar 

  3. Suryanarayana, G., Samarthyam, G., Sharma, T.: Refactoring for Software Design Smells: Managing Technical Debt. Morgan Kaufmann (2014)

    Google Scholar 

  4. Li, Z., Avgeriou, P., Liang, P.: A systematic mapping study on technical debt and its management. J. Syst. Soft. 101, 193–220 (2015)

    Article  Google Scholar 

  5. Tsoukalas, D., Siavvas, M., Jankovic, M., Kehagias, D., Chatzigeorgiou, A., Tzovaras, D.: Methods and tools for td estimation and forecasting: a state-of-the-art survey. In: International Conference on Intelligent Systems (IS 2018) (2018)

    Google Scholar 

  6. Tsoukalas, D., et al.: Machine learning for technical debt identification. IEEE Trans. Soft. Eng. (2021)

    Google Scholar 

  7. Tsoukalas, D., Jankovic, M., Siavvas, M., Kehagias, D., Chatzigeorgiou, A., Tzovaras, D.: On the applicability of time series models for technical debt forecasting. In: 15th China-Europe International Symposium on Software Engineering Education (CEISEE 2019) (2019) (in press)

    Google Scholar 

  8. Tsoukalas, D., Kehagias, D., Siavvas, M., Chatzigeorgiou, A.: Technical Debt Forecasting: an empirical study on open-source repositories. J. Syst. Soft. 170, 110777 (2020)

    Google Scholar 

  9. Tsoukalas, D., Mathioudaki, M., Siavvas, M., Kehagias, D., Chatzigeorgiou, A.: A clustering approach towards cross-project technical debt forecasting. SN Comput. Sci. 2(1), 1–30 (2021)

    Article  Google Scholar 

  10. Mathioudaki, M., Tsoukalas, D., Siavvas, M., Kehagias, D.: Technical debt forecasting based on deep learning techniques. In: Gervasi, O., et al. (eds.) ICCSA 2021. LNCS, vol. 12955, pp. 306–322. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87007-2_22

    Chapter  Google Scholar 

  11. Gall, H.C., Lanza, M.: Software evolution: analysis and visualization. In: 28th International Conference On Software Engineering, pp. 1055–1056. ACM (2006)

    Google Scholar 

  12. Arcelli Fontana, F., Mäntylä, M.V., Zanoni, M., Marino, A.: Comparing and experimenting machine learning techniques for code smell detection. Empir. Softw. Eng. 21(3), 1143–1191 (2015). https://doi.org/10.1007/s10664-015-9378-4

    Article  Google Scholar 

  13. Shariat Yazdi, H., Mirbolouki, M., Pietsch, P., Kehrer, T., Kelter, U.: Analysis and prediction of design model evolution using time series. In: Iliadis, L., Papazoglou, M., Pohl, K. (eds.) CAiSE 2014. LNBIP, vol. 178, pp. 1–15. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07869-4_1

    Chapter  Google Scholar 

  14. Siavvas, M., Tsoukalas, D., Jankovic, M., Kehagias, D., Tzovaras, D.: Technical debt as an indicator of software security risk: a machine learning approach for software development enterprises. Enterprise Information Systems (2020)

    Google Scholar 

  15. Raja, U., Hale, D.P., Hale, J.E.: Modeling software evolution defects: a time series approach. J. Softw. Maint. Evol. Res. Pract. 21(1), 49–71 (2009)

    Article  Google Scholar 

  16. Kenmei, B., Antoniol, G., Di Penta, M.: Trend analysis and issue prediction in large-scale open source systems. In: 2008 12th European Conference on Software Maintenance and Reengineering, pp. 73–82. IEEE (2008)

    Google Scholar 

  17. Goulão, M., Fonte, N., Wermelinger, M., Abreu, F.B.: Software evolution prediction using seasonal time analysis: a comparative study. In: 2012 16th European Conference on Software Maintenance and Reengineering, pp. 213–222. IEEE (2012)

    Google Scholar 

  18. Antoniol, G., Di Penta, M., Gradara, S.: Predicting Software Evolution: An Approach and a Case Study

    Google Scholar 

  19. Lenarduzzi, V., Saarimäki, N., Taibi, D.: The technical debt dataset. In: 15th International Conference on Predictive Models and Data Analytics, pp. 2–11 (2019)

    Google Scholar 

  20. Box, G.E.P., Jenkins, G.M.: Time Series Analysis: Forecasting and Control, pp. 161–215. Palgrave Macmillan, UK (2013)

    Google Scholar 

  21. Dickey, D.A., Fuller, W.A.: Distribution of the estimators for autoregressive time series with a unit root. J. Am. Stat. Assoc. 74(366), 427–431 (1979)

    Article  MathSciNet  Google Scholar 

  22. McCleary, R., Hay, R.: Applied Time Series Analysis For The Social Sciences. Sage Publications, Beverly Hills (1980)

    Google Scholar 

  23. Ljung, G.M., Box, G.E.P.: On a measure of lack of fit in time series models. Biometrika 65(2), 297–303 (1978)

    Article  Google Scholar 

  24. Stone, M.: Cross-validatory choice and assessment of statistical predictions. J. Royal Stat. Soc. Ser. B (Methodol.) 36(2), 111–147 (1974)

    MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

This work is partially funded by the European Union’s Horizon 2020 Research and Innovation Programme through SmartCLIDE project under Grant Agreement No. 871177.

Author information

Authors and Affiliations

  1. Centre for Research and Technology Hellas, Thessaloniki, Greece

    Maria Mathioudaki, Dimitrios Tsoukalas, Miltiadis Siavvas & Dionysios Kehagias

Authors
  1. Maria Mathioudaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dimitrios Tsoukalas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Miltiadis Siavvas
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dionysios Kehagias
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dimitrios Tsoukalas .

Editor information

Editors and Affiliations

  1. University of Perugia, Perugia, Italy

    Osvaldo Gervasi

  2. University of Basilicata, Potenza, Potenza, Italy

    Beniamino Murgante

  3. Østfold University College, Halden, Norway

    Sanjay Misra

  4. University of Minho, Braga, Portugal

    Ana Maria A. C. Rocha

  5. University of Cagliari, Cagliari, Italy

    Chiara Garau

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mathioudaki, M., Tsoukalas, D., Siavvas, M., Kehagias, D. (2022). Comparing Univariate and Multivariate Time Series Models for Technical Debt Forecasting. In: Gervasi, O., Murgante, B., Misra, S., Rocha, A.M.A.C., Garau, C. (eds) Computational Science and Its Applications – ICCSA 2022 Workshops. ICCSA 2022. Lecture Notes in Computer Science, vol 13380. Springer, Cham. https://doi.org/10.1007/978-3-031-10542-5_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-10542-5_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-10541-8

  • Online ISBN: 978-3-031-10542-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation