skip to main content
10.1145/3548771.3561411acmconferencesArticle/Chapter ViewAbstractPublication PagesfseConference Proceedingsconference-collections
research-article

Gamification of exploratory testing process

Published:09 November 2022Publication History

ABSTRACT

Exploratory testing is an experience-based testing technique often used in addition to formal ones. However, it can be used as a replacement for formal techniques when time is limited and/or documentation is poor. Conducting test charters and maximizing efficiency are seen as tough works due to their informal nature. Dividing test load to testers, scoring the severity level, consolidating the results, and reporting the issues are some challenges of this process. In this experience study, efforts of gamifying exploratory testing process are told. A public institution in Turkiye demanded software testing for their software for a limited timeframe and employed testers were motivated by gamification efforts. It was seen that gamification helped us detecting more critical faults quickly. Failure cases such as test contest organization attempts are told as well.

References

  1. Robert Baggen, José Pedro Correia, Katrin Schill, and Joost Visser. 2012. Standardized Code Quality Benchmarking for Improving Software Maintainability. Software Quality Journal, 20, 2 (2012), jun, 287–307. issn:0963-9314 https://doi.org/10.1007/s11219-011-9144-9 Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Shuib Basri, Thangiah Murugan, and Dhanapal Durai Dominic. 2019. Validating the Conceptual Framework with Exploratory Testing. In Software Engineering Methods in Intelligent Algorithms, Radek Silhavy (Ed.). Springer International Publishing, Cham. 305–317. isbn:978-3-030-19807-7 Google ScholarGoogle Scholar
  3. S. R. Chidamber and C. F. Kemerer. 1994. A Metrics Suite for Object Oriented Design. IEEE Trans. Softw. Eng., 20, 6 (1994), jun, 476–493. issn:0098-5589 https://doi.org/10.1109/32.295895 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Gabriela Martins de Jesus, Leo Natan Paschoal, Fabiano Cutigi Ferrari, and Simone R. S. Souza. 2019. Is It Worth Using Gamification on Software Testing Education? An Experience Report. In Proceedings of the XVIII Brazilian Symposium on Software Quality (SBQS’19). Association for Computing Machinery, New York, NY, USA. 178–187. isbn:9781450372824 https://doi.org/10.1145/3364641.3364661 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Gordon Fraser. 2017. Gamification of Software Testing. In 2017 IEEE/ACM 12th International Workshop on Automation of Software Testing (AST). 2–7. https://doi.org/10.1109/AST.2017.20 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Tommaso Fulcini and Luca Ardito. 2022. Gamified Exploratory GUI Testing of Web Applications: a Preliminary Evaluation. In 2022 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). 215–222. https://doi.org/10.1109/ICSTW55395.2022.00045 Google ScholarGoogle ScholarCross RefCross Ref
  7. D. Graham, R. Black, and E. van Veenendaal. 2021. Foundations of Software Testing ISTQB Certification, 4th edition. Cengage Learning. isbn:9780357884157 https://books.google.com.tr/books?id=mOwxEAAAQBAJ Google ScholarGoogle Scholar
  8. International Software Qualifications Board (ISTQB). 2022. International Software Qualifications Board (ISTQB). https://www.istqb.org/certifications/certified-tester-foundationlevel/ [Online; accessed 13-September-2022] Google ScholarGoogle Scholar
  9. Harold W. Kuhn. 1955. The Hungarian Method for the Assignment Problem. Naval Research Logistics Quarterly, 2, 1–2 (1955), March, 83–97. https://doi.org/10.1002/nav.3800020109 Google ScholarGoogle ScholarCross RefCross Ref
  10. Mika V Mäntylä and Kari Smolander. 2016. Gamification of Software Testing - An MLR. 2 (2016), 611–614. isbn:9783319490946 https://doi.org/10.1007/978-3-319-49094-6 Google ScholarGoogle ScholarCross RefCross Ref
  11. Thomas McCabe. 1976. A Complexity Measure. IEEE Transactions on Software Engineering, 2 (1976), 308–320. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Christopher J. Schaefer and Hyunsook Do. 2014. Model-Based Exploratory Testing: A Controlled Experiment. In 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops. 284–293. https://doi.org/10.1109/ICSTW.2014.31 Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Klaas-Jan Stol, Mario Schaarschmidt, and Shelly Goldblit. 2022. Gamification in Software Engineering: The Mediating Role of Developer Engagement and Job Satisfaction. Empirical Softw. Engg., 27, 2 (2022), mar, 34 pages. issn:1382-3256 https://doi.org/10.1007/s10664-021-10062-w Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Gamification of exploratory testing process

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          Gamify 2022: Proceedings of the 1st International Workshop on Gamification of Software Development, Verification, and Validation
          November 2022
          17 pages
          ISBN:9781450394543
          DOI:10.1145/3548771

          Copyright © 2022 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 9 November 2022

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Upcoming Conference

          FSE '24
        • Article Metrics

          • Downloads (Last 12 months)73
          • Downloads (Last 6 weeks)15

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader