Skip to main content
SpringerLink
Log in

Review of Open Software Bug Datasets

  • Conference paper
  • First Online:
Information Systems and Technologies (WorldCIST 2023)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 801))

Included in the following conference series:

  • 80 Accesses

Abstract

The localisation of the bug position in a source code and the prediction of which specific parts of a source code might be the cause of defects play an important role in maintaining software quality. Both approaches are based on applying information retrieval techniques and machine learning or deep learning methods. The prerequisite for using these approaches is the availability of a consistent bug dataset of sufficient size. This paper presents an overview of available public bug datasets and analyses their specific application areas. The paper also suggests possible future research directions in this field.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Weka ARFF, https://www.cs.waikato.ac.nz/ml/weka/arff.html.

References

  1. D’Ambros, M., Lanza, M., Robbes, R.: An extensive comparison of bug prediction approaches. In: 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010), pp. 31–41 (2010)

    Google Scholar 

  2. Ferenc, R., Gyimesi, P., Gyimesi, G., Tóth, Z., Gyimóthy, T.: An automatically created novel bug dataset and its validation in bug prediction. J. Syst. Softw. 169, 110691 (2020)

    Article  Google Scholar 

  3. Ferenc, R., Tóth, Z., Ladányi, G., Siket, I., Gyimóthy, T.: A public unified bug dataset for java and its assessment regarding metrics and bug prediction, March 2020

    Google Scholar 

  4. Goues, C., Forrest, S., Weimer, W.: Current challenges in automatic software repair. Software Qual. J. 21, 421–443 (2013)

    Article  Google Scholar 

  5. Gray, D., Bowes, D., Davey, N., Sun, Y., Christianson, B.: Reflections on the NASA MDP data sets. IET Softw. 6, 549–558 (2012)

    Article  Google Scholar 

  6. Kitchenham, B., Charters, S.: Guidelines for performing systematic literature reviews in software engineering (2017)

    Google Scholar 

  7. Madeiral, F., Urli, S., Maia, M., Monperrus, M.: Bears: an extensible java bug benchmark for automatic program repair studies. In: 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER), February 2019

    Google Scholar 

  8. Martinez, M., Durieux, T., Sommerard, R., Xuan, J., Monperrus, M.: Automatic repair of real bugs in java: a large-scale experiment on the Defects4J dataset. Empir. Softw. Eng. 22(4), 1936–1964 (2017)

    Article  Google Scholar 

  9. Matias, M., Thomas, D., Romain, S., Jifeng, X., Martin, M.: Proceedings of the 15th International Conference on Mining Software Repositories, MSR 2018, pp. 10–13 (2018)

    Google Scholar 

  10. Murillo-Morera, J., Quesada-López, C., Castro-Herrera, C., Jenkins, M.: An empirical evaluation of nasa-mdp data sets using a genetic defect-proneness prediction framework. In: 2016 IEEE 36th Central American and Panama Convention (CONCAPAN XXXVI), pp. 1–6 (2016)

    Google Scholar 

  11. Muvva, S., Rao, A.E., Chimalakonda, S.: BuGL–a cross-language dataset for bug localization. arXiv preprint arXiv:2004.08846 (2020)

  12. Muvva, S., Sangle, S., Chimalakonda, S.: BuGC: C dataset for bug localization. Zenodo, October 2020

    Google Scholar 

  13. Radu, A., Nadi, S.: A dataset of non-functional bugs. In: 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR), pp. 399–403 (2019)

    Google Scholar 

  14. Ramadhina, S., Bahaweres, R., Hermadi, I., Suroso, A., Rodoni, A., Arkeman, Y.: Software defect prediction using process metrics systematic literature review: dataset and granularity level, pp. 1–7, September 2021

    Google Scholar 

  15. Rudolf, F., Péter, G., Gábor, G., Zoltán, T., Tibor, G.: An automatically created novel bug dataset and its validation in bug prediction. J. Syst. Softw. 169, 110691 (2020)

    Article  Google Scholar 

  16. Sayyad Shirabad, J., Menzies, T.: The PROMISE Repository of Software Engineering Databases. University of Ottawa, Canada, School of Information Technology and Engineering (2005)

    Google Scholar 

  17. Schröter, A., Zimmermann, T., Premraj, R., Zeller, A.: If your bug database could talk. In: Proceedings of the 5th International Symposium on Empirical Software Engineering, pp. 18–20 (2006)

    Google Scholar 

  18. Shepperd, M., Song, Q., Sun, Z., Mair, C.: NASA MDP software defects data sets (2018)

    Google Scholar 

  19. Thapaliyal, D., Verma, G.: Software defects and object oriented metrics - an empirical analysis. Int. J. Comput. Appl. 9, 41–44 (2010)

    Google Scholar 

  20. Thomas, D., Martin, M.: IntroClassJava: a benchmark of 297 small and buggy Java programs, pp. 10–13. Universite Lille 1 (2016)

    Google Scholar 

  21. Tóth, Z., Gyimesi, P., Ferenc, R.: A public bug database of github projects and its application in bug prediction. In: Gervasi, O., et al. (eds.) ICCSA 2016. LNCS, vol. 9789, pp. 625–638. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42089-9_44

    Chapter  Google Scholar 

  22. Zhou, J., Zhang, H., Lo, D.: Where should the bugs be fixed? More accurate information retrieval-based bug localization based on bug reports. In: Proceedings - International Conference on Software Engineering, pp. 14–24, June 2012

    Google Scholar 

  23. Zimmermann, T., Premraj, R., Zeller, A.: Predicting defects for eclipse. In: Third International Workshop on Predictor Models in Software Engineering (PROMISE 2007: ICSE Workshops 2007), p. 9 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Faculty of Electrical Engineering, Czech Technical University in Prague, Karlovo namesti 13, 121 35, Prague, Czechia

    Tomas Holek, Miroslav Bures & Tomas Cerny

  2. Systems and Industrial Engineering, University of Arizona, 1127 East James E Rogers Way, Tucson, AZ, 85721, USA

    Tomas Cerny

Authors
  1. Tomas Holek
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Miroslav Bures
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tomas Cerny
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Miroslav Bures .

Editor information

Editors and Affiliations

  1. ISEG, Universidade de Lisboa, Lisbon, Cávado, Portugal

    Alvaro Rocha

  2. College of Engineering, The Ohio State University, Columbus, OH, USA

    Hojjat Adeli

  3. Institute of Data Science and Digital Technologies, Vilnius University, Vilnius, Lithuania

    Gintautas Dzemyda

  4. DCT, Universidade Portucalense, Porto, Portugal

    Fernando Moreira

  5. TeCIP Institute, Scuola Superiore Sant’Anna, Pisa, Italy

    Valentina Colla

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Holek, T., Bures, M., Cerny, T. (2024). Review of Open Software Bug Datasets. In: Rocha, A., Adeli, H., Dzemyda, G., Moreira, F., Colla, V. (eds) Information Systems and Technologies. WorldCIST 2023. Lecture Notes in Networks and Systems, vol 801. Springer, Cham. https://doi.org/10.1007/978-3-031-45648-0_1

Download citation

Publish with us

Policies and ethics

Search

Navigation