skip to main content
10.1145/3629479.3629487acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbqsConference Proceedingsconference-collections
research-article

Vocabulary of Flaky Tests in Javascript

Published:06 December 2023Publication History
First page image

References

  1. 2018. International Conference on Software Engineering (Gothenburg, Suécia).Google ScholarGoogle Scholar
  2. 2018. International Working Conference on Source Code Analysis and Manipulation (Madrid, Espanha).Google ScholarGoogle Scholar
  3. 2021. International Conference on Software Engineering (Madrid, Espanha).Google ScholarGoogle Scholar
  4. Abdulrahman Alshammari, Christopher Morris, Michael Hilton, and Jonathan Bell. 2021. FlakeFlagger: Predicting Flakiness Without Rerunning Tests, See pro [3], 1572–1584.Google ScholarGoogle Scholar
  5. Gabriele Bavota, Abdallah Qusef, Rocco Oliveto, Andrea De Lucia, and David Binkley. 2012. An empirical analysis of the distribution of unit test smells and their impact on software maintenance. In 28th IEEE International Conference on Software Maintenance (Trento,Italy). 56–65.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Jonathan Bell, Owolabi Legunsen, Michael Hilton, Lamyaa Eloussi, Tifany Yung, and Darko Marinov. 2018. DeFlaker: Automatically Detecting Flaky Tests, See pro [1], 433–444.Google ScholarGoogle Scholar
  7. Jonathan Bell, Owolabi Legunsen, Michael Hilton, Lamyaa Eloussi, Tifany Yung, and Darko Marinov. 2018. DeFlaker: Automatically Detecting Flaky Tests, See pro [1], 433–444.Google ScholarGoogle Scholar
  8. Antonia Bertolino, Emilio Cruciani, Breno Alexandro Ferreira de Miranda, and Roberto Verdecchia. 2020. Know your neighbor: fast static prediction of test flakiness. techreport ISTI-2020-TR/001. Istituto di Scienza e Tecnologie dell’Informazione “A. Faedo”, Pisa, Itália.Google ScholarGoogle Scholar
  9. Bruno Camara, Marco Silva, Andre Endo, and Silvia Vergilio. 2021. On the Use of Test Smells for Prediction of Flaky Tests. In VI Brazilian Symposium on Systematic and Automated Software Testing (SAST’21) (6 ed.) (Joinville, SC, Brasil). 46–54.Google ScholarGoogle Scholar
  10. Bruno Henrique Pachulski Camara, Marco Aurélio Graciotto Silva, Andre Takeshi Endo, and Silvia Regina Vergilio. 2021. What is the Vocabulary of Flaky Tests? An Extended Replication. In 29th IEEE/ACM International Conference on Program Comprehension (ICPC 2021) (Madrid, Espanha). 444–454.Google ScholarGoogle Scholar
  11. David Cournapeau 2007. scikit-learn. Programa de computador. https://scikit-learn.org/Google ScholarGoogle Scholar
  12. Cypress. 2017. Cypress. Programa de computador. https://www.cypress.io/Google ScholarGoogle Scholar
  13. Arie Van Deursen, Leon Moonen, Alex Bergh, and Gerard Kok. 2001. Refactoring Test Code. In 2nd International Conference on Extreme Programming and Flexible Processes in Software Engineering (XP 2001) (Villasimius, Sardinia, Itália). 92–95.Google ScholarGoogle Scholar
  14. Moritz Eck, Fabio Palomba, Marco Castelluccio, and Alberto Bacchelli. 2019. Understanding Flaky Tests: The Developer’s Perspective. In 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (Tallinn, Estônia). 830–840.Google ScholarGoogle Scholar
  15. Lamyaa Eloussi. 2015. Determining Flaky Tests from Test Failures. mathesis. University of Illinois at Urbana-Champaign, Urbana, Illinois,. Advisor(s) Darko Marinov. http://hdl.handle.net/2142/78543Google ScholarGoogle Scholar
  16. Facebook. 2014. Jest. Programa de computador. https://jestjs.io/Google ScholarGoogle Scholar
  17. Usama Fayyad, Gregory Piatetsky-Shapiro, and Padhraic Smyth. 1996. From Data Mining to Knowledge Discovery in Databases. AI Magazine 17, 3 (Sept.–Nov. 1996), 37–54.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Martin Gruber, Stephan Lukasczyk, Florian Kroiß, and Gordon Fraser. 2021. An Empirical Study of Flaky Tests in Python. In 2021 14th IEEE International Conference on Software Testing, Verification and Validation (Porto de Galinhas, PE, EUA). 148–158.Google ScholarGoogle Scholar
  19. Guillaume Haben, Sarra Habchi, Mike Papadakis, Maxime Cordy, and Yves Le Traon. 2021. A Replication Study on the Usability of Code Vocabulary in Predicting Flaky Tests. In 2021 Mining Software Repositories Conference (18 ed.) (Madrid, Espanha). 219–229.Google ScholarGoogle ScholarCross RefCross Ref
  20. Mark Harman and Peter O’Hearn. 2018. From Start-ups to Scale-ups: Opportunities and Open Problems for Static and Dynamic Program Analysis, See pro [2], 1–23.Google ScholarGoogle Scholar
  21. Mark Harman and Peter O’Hearn. 2018. From Start-ups to Scale-ups: Opportunities and Open Problems for Static and Dynamic Program Analysis, See pro [2], 1–23.Google ScholarGoogle Scholar
  22. Negar Hashemi, Amjed Tahir†, and Shawn Rasheed. 2022. An empirical study of flaky tests in Javascript. In 38th IEEE International Conference on Software Maintenance and Evolution (38 ed.) (Limassol, Chipre). 24–34.Google ScholarGoogle ScholarCross RefCross Ref
  23. James Henry 2019. TypeScript-ESLint. Programa de computador. https://github.com/typescript-eslint/typescript-eslintGoogle ScholarGoogle Scholar
  24. Kim Herzig and Nachiappan Nagappan. 2015. Empirically Detecting False Test Alarms Using Association Rules. In 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering (37 ed.) (Florence, Itália). 39–48.Google ScholarGoogle Scholar
  25. Vojtech Jina 2012. Karma. Programa de computador. https://karma-runner.github.ioGoogle ScholarGoogle Scholar
  26. Tariq M. King, Dionny Santiago, Justin Phillips, and Peter J. Clarke. 2018. Towards a Bayesian Network Model for Predicting Flaky Automated Tests. In 2018 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) (Lisbon, Portugal). 100–107.Google ScholarGoogle ScholarCross RefCross Ref
  27. Wing Lam, Patrice Godefroid, Suman Nath, Anirudh Santhiar, and Suresh Thummalapenta. 2019. Root causing flaky tests in a large-scale industrial setting. In 28th ACM SIGSOFT International Symposium on Software Testing and Analysis. 101–111.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Wing Lam, Patrice Godefroid, Suman Nath, Anirudh Santhiar, and Suresh Thummalapenta. 2019. Root Causing Flaky Tests in a Large-Scale Industrial Setting. In 28th ACM SIGSOFT International Symposium on Software Testing and Analysis (Beijing, China). 101–111.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Wing Lam, Kıvanç Muşlu, Hitesh Sajnani, and Suresh Thummalapenta. 2020. A Study on the Lifecycle of Flaky Tests. In 42nd International Conference on Software Engineering (Seoul, Coréia do Sul). 1471–1482.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Wing Lam, Reed Oei, August Shi, Darko Marinov, and Tao Xie. 2019. iDFlakies: A Framework for Detecting and Partially Classifying Flaky Tests. In 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST) (Xi’an, China). 312–322.Google ScholarGoogle ScholarCross RefCross Ref
  31. Jeff Listfield. 2017. Where do our flaky tests come from?Página Web. https://testing.googleblog.com/2017/04/where-do-our-flaky-tests-come-from.htmlGoogle ScholarGoogle Scholar
  32. Qingzhou Luo, Farah Hariri, Lamyaa Eloussi, and Darko Marinov. 2014. An Empirical Analysis of Flaky Tests. In 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering (Hong Kong, China). 643–653.Google ScholarGoogle Scholar
  33. Meta. 2016. Yarn. Programa de computador. https://yarnpkg.com/Google ScholarGoogle Scholar
  34. John Micco. 2016. Flaky tests at Google and how we mitigate them. Online] https://testing. googleblog. com/2016/05/flaky-tests-at-google-and-how-w e. html (2016).Google ScholarGoogle Scholar
  35. John Micco. 2017. The State of Continuous Integration Testing@ Google.(2017).Google ScholarGoogle Scholar
  36. Charles Miranda, Guilherme Avelino, Pedro Santos Neto, and Victor da Silva. 2021. Uma Análise da Co-Evolução de Teste em Projetos de Software no GitHub. In IX Workshop de Visualização, Evolução e Manutenção de Software (VEM 2021) (12 ed.) (Joinville, SC, Brasil). 36–40.Google ScholarGoogle Scholar
  37. Jesús Morán, Cristian Augusto, Antonia Bertolino, Claudio De La Riva, and Javier Tuya. 2020. FlakyLoc: Flakiness Localization for Reliable Test Suites in Web Applications. Journal of Web Engineering 19, 2 (June 2020), 267–296.Google ScholarGoogle Scholar
  38. NPM. 2010. npm. Programa de computador. https://www.npmjs.com/Google ScholarGoogle Scholar
  39. Jason Palmer. 2019. Test Flakiness – Methods for identifying and dealing with flaky tests. https://engineering.atspotify.com/2019/11/18/test-flakiness-methods-for-identifying-and-dealing-with-flaky-tests/Google ScholarGoogle Scholar
  40. Gustavo Pinto, Breno Miranda, Supun Dissanayake, Marcelo d’Amorim, Christoph Treude, and Antonia Bertolino. 2020. What is the Vocabulary of Flaky Tests?. In 17th International Conference on Mining Software Repositories (MSR) (17 ed.) (Seoul, Coréia do Sul). 492–502.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Tom Preston-Werner, Chris Wanstrath, P. J. Hyett, and Scott Chacon. 2008. GitHub. Programa de computador. https://github.comGoogle ScholarGoogle Scholar
  42. Solange Oliveira Rezende. 2005. Sistemas inteligentes: fundamentos e aplicações (1 ed.). Barueri, SP, Brasil. 550 pages.Google ScholarGoogle Scholar
  43. Alan Romano, Zihe Song, Sampath Grandhi, Wei Yang, and Weihang Wang. 2021. An Empirical Analysis of UI-based Flaky Tests, See pro [3], 1585–1597.Google ScholarGoogle Scholar
  44. Swapna Thorve, Chandani Sreshtha, and Na Meng. 2018. An Empirical Study of Flaky Tests in Android Apps. In 2018 IEEE International Conference on Software Maintenance and Evolution (ICSME) (Madrid, Espanha). 534–538.Google ScholarGoogle Scholar
  45. Michele Tufano, Fabio Palomba, Gabriele Bavota, Massimiliano Di Penta, Rocco Oliveto, Andrea De Lucia, and Denys Poshyvanyk. 2016. An Empirical Investigation into the Nature of Test Smells. In 31st IEEE/ACM International Conference on Automated Software Engineering (Singapura). 4–15.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Roberto Verdecchia, Emilio Cruciani, Breno Miranda, and Antonia Bertolino. 2021. Know You Neighbor: Fast Static Prediction of Test Flakiness. IEEE Access (2021).Google ScholarGoogle Scholar

Index Terms

  1. Vocabulary of Flaky Tests in Javascript
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          SBQS '23: Proceedings of the XXII Brazilian Symposium on Software Quality
          November 2023
          391 pages
          ISBN:9798400707865
          DOI:10.1145/3629479

          Copyright © 2023 ACM

          Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 6 December 2023

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited

          Acceptance Rates

          Overall Acceptance Rate35of99submissions,35%
        • Article Metrics

          • Downloads (Last 12 months)26
          • Downloads (Last 6 weeks)3

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format