skip to main content
research-article

Report from the 14th International Workshop on Automating Test Case Design, Selection, and Evaluation (A-TEST 2023)

Published:03 April 2024Publication History
Skip Abstract Section

Abstract

For the past fourteen years, the Workshop on Automating Test Case Design, Selection and Evaluation (A-TEST)1 has provided a venue for researchers and industry members alike to exchange and discuss trending views, ideas, state-of-the-art, work-in-progress, and scientific results on automated testing. The previous thirteen editions of A-TEST were co-located with several conferences over time: CISTI2 (first two editions), FEDCSIS 3 (three editions), and ESEC/FSE4 (seven editions). The 14th edition took place on September 15, 2023, in Kirchberg, Luxembourg, co-located with ASE 2023 (38th IEEE/ACM International Conference on Automated Software Engineering5). The A-TEST 2023 program featured an enlightening keynote on quantum software testing, followed by three technical sessions in which the authors of 6 full papers and 4 short papers dived into various aspects of automated testing, from neuroevolution and fuzzing techniques to GUI-based software testing and test case recommendations. This short report summarizes the keynote and paper presentations at A-TEST 2023.

References

  1. Shaukat Ali, Paolo Arcaini, Xinyi Wang, and Tao Yue. Assessing the effectiveness of input and output coverage criteria for testing quantum programs. In 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST), pages 13--23. IEEE, 2021.Google ScholarGoogle ScholarCross RefCross Ref
  2. Michael Auer and Gordon Fraser. Exploring android apps using motif actions. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW), pages 135--142. IEEE, 2023.Google ScholarGoogle ScholarCross RefCross Ref
  3. Ruizhen Gu and Jos´e Miguel Rojas. An empirical study on the adoption of scripted gui testing for android apps. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW), pages 179--182. IEEE, 2023.Google ScholarGoogle ScholarCross RefCross Ref
  4. Fabian Jezuita. Improving aflgo's directed fuzzing by considering indirect function calls. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW), pages 143--150. IEEE, 2023.Google ScholarGoogle ScholarCross RefCross Ref
  5. Yavuz Koroglu and Franz Wotawa. Continuous domain input abstraction and fault detection capability in combinatorial testing. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW), pages 167--170. IEEE, 2023.Google ScholarGoogle ScholarCross RefCross Ref
  6. Shaukat Ali, Paolo Arcaini, and Tao Yue. Muskit: A mutation analysis tool for quantum software testing. In 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE), pages 1266--1270. IEEE, 2021.Google ScholarGoogle Scholar
  7. Andriy Miranskyy and Lei Zhang. On testing quantum programs. In 2019 IEEE/ACM 41st International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER), pages 57--60. IEEE, 2019.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Matteo Paltenghi and Michael Pradel. Morphq: Metamorphic testing of the qiskit quantum computing platform. In 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE), pages 2413--2424. IEEE, 2023.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Moeketsi Raselimo, Lars Grunske, and Bernd Fischer. Static test case prioritization strategies for grammar-based testing. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW), pages 151--158. IEEE, 2023.Google ScholarGoogle ScholarCross RefCross Ref
  10. Mosab Rezaei, Hamed Alhoori, and Mona Rahimi. Test case recommendations with distributed representation of code syntactic features. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW), pages 159--166. IEEE, 2023.Google ScholarGoogle ScholarCross RefCross Ref
  11. S´ebastien Salva and Jarod Sue. Automated test case generation for service composition from event logs. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW), pages 127--134. IEEE, 2023.Google ScholarGoogle ScholarCross RefCross Ref
  12. Xinyi Wang, Paolo Arcaini, Tao Yue, and Shaukat Ali. Generating failing test suites for quantum programs with search. In International Symposium on Search Based Software Engineering, pages 9--25. Springer, 2021.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Xinyi Wang, Tongxuan Yu, Paolo Arcaini, Tao Yue, and Shaukat Ali. Mutation-based test generation for quantum programs with multi-objective search. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 1345--1353, 2022.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Terrence Wong. Chouette: An automated cross-platform ui crawler for improving app quality. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW), pages 175--178. IEEE, 2023.Google ScholarGoogle ScholarCross RefCross Ref
  15. Daniel Zimmermann, Patrick Deubel, and Anne Koziolek. Evaluating the effectiveness of neuroevolution for automated gui-based software testing. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW), pages 119--126. IEEE, 2023.Google ScholarGoogle ScholarCross RefCross Ref
  16. Daniel Zimmermann and Anne Koziolek. Gui-based software testing: An automated approach using gpt-4 and selenium webdriver. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW), pages 171--174. IEEE, 2023.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Report from the 14th International Workshop on Automating Test Case Design, Selection, and Evaluation (A-TEST 2023)
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM SIGSOFT Software Engineering Notes
            ACM SIGSOFT Software Engineering Notes  Volume 49, Issue 2
            April 2024
            28 pages
            ISSN:0163-5948
            DOI:10.1145/3650142
            Issue’s Table of Contents

            Copyright © 2024 Copyright is held by the owner/author(s)

            Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 3 April 2024

            Check for updates

            Qualifiers

            • research-article
          • Article Metrics

            • Downloads (Last 12 months)15
            • Downloads (Last 6 weeks)8

            Other Metrics

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader