ABSTRACT
Exploratory testing is an experience-based testing technique often used in addition to formal ones. However, it can be used as a replacement for formal techniques when time is limited and/or documentation is poor. Conducting test charters and maximizing efficiency are seen as tough works due to their informal nature. Dividing test load to testers, scoring the severity level, consolidating the results, and reporting the issues are some challenges of this process. In this experience study, efforts of gamifying exploratory testing process are told. A public institution in Turkiye demanded software testing for their software for a limited timeframe and employed testers were motivated by gamification efforts. It was seen that gamification helped us detecting more critical faults quickly. Failure cases such as test contest organization attempts are told as well.
- Robert Baggen, José Pedro Correia, Katrin Schill, and Joost Visser. 2012. Standardized Code Quality Benchmarking for Improving Software Maintainability. Software Quality Journal, 20, 2 (2012), jun, 287–307. issn:0963-9314 https://doi.org/10.1007/s11219-011-9144-9 Google ScholarDigital Library
- Shuib Basri, Thangiah Murugan, and Dhanapal Durai Dominic. 2019. Validating the Conceptual Framework with Exploratory Testing. In Software Engineering Methods in Intelligent Algorithms, Radek Silhavy (Ed.). Springer International Publishing, Cham. 305–317. isbn:978-3-030-19807-7 Google Scholar
- S. R. Chidamber and C. F. Kemerer. 1994. A Metrics Suite for Object Oriented Design. IEEE Trans. Softw. Eng., 20, 6 (1994), jun, 476–493. issn:0098-5589 https://doi.org/10.1109/32.295895 Google ScholarDigital Library
- Gabriela Martins de Jesus, Leo Natan Paschoal, Fabiano Cutigi Ferrari, and Simone R. S. Souza. 2019. Is It Worth Using Gamification on Software Testing Education? An Experience Report. In Proceedings of the XVIII Brazilian Symposium on Software Quality (SBQS’19). Association for Computing Machinery, New York, NY, USA. 178–187. isbn:9781450372824 https://doi.org/10.1145/3364641.3364661 Google ScholarDigital Library
- Gordon Fraser. 2017. Gamification of Software Testing. In 2017 IEEE/ACM 12th International Workshop on Automation of Software Testing (AST). 2–7. https://doi.org/10.1109/AST.2017.20 Google ScholarDigital Library
- Tommaso Fulcini and Luca Ardito. 2022. Gamified Exploratory GUI Testing of Web Applications: a Preliminary Evaluation. In 2022 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). 215–222. https://doi.org/10.1109/ICSTW55395.2022.00045 Google ScholarCross Ref
- D. Graham, R. Black, and E. van Veenendaal. 2021. Foundations of Software Testing ISTQB Certification, 4th edition. Cengage Learning. isbn:9780357884157 https://books.google.com.tr/books?id=mOwxEAAAQBAJ Google Scholar
- International Software Qualifications Board (ISTQB). 2022. International Software Qualifications Board (ISTQB). https://www.istqb.org/certifications/certified-tester-foundationlevel/ [Online; accessed 13-September-2022] Google Scholar
- Harold W. Kuhn. 1955. The Hungarian Method for the Assignment Problem. Naval Research Logistics Quarterly, 2, 1–2 (1955), March, 83–97. https://doi.org/10.1002/nav.3800020109 Google ScholarCross Ref
- Mika V Mäntylä and Kari Smolander. 2016. Gamification of Software Testing - An MLR. 2 (2016), 611–614. isbn:9783319490946 https://doi.org/10.1007/978-3-319-49094-6 Google ScholarCross Ref
- Thomas McCabe. 1976. A Complexity Measure. IEEE Transactions on Software Engineering, 2 (1976), 308–320. Google ScholarDigital Library
- Christopher J. Schaefer and Hyunsook Do. 2014. Model-Based Exploratory Testing: A Controlled Experiment. In 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops. 284–293. https://doi.org/10.1109/ICSTW.2014.31 Google ScholarDigital Library
- Klaas-Jan Stol, Mario Schaarschmidt, and Shelly Goldblit. 2022. Gamification in Software Engineering: The Mediating Role of Developer Engagement and Job Satisfaction. Empirical Softw. Engg., 27, 2 (2022), mar, 34 pages. issn:1382-3256 https://doi.org/10.1007/s10664-021-10062-w Google ScholarDigital Library
Index Terms
- Gamification of exploratory testing process
Recommendations
Are test cases needed? Replicated comparison between exploratory and test-case-based software testing
Manual software testing is a widely practiced verification and validation method that is unlikely to fade away despite the advances in test automation. In the domain of manual testing, many practitioners advocate exploratory testing (ET), i.e., creative,...
Experience report on teaching testing through gamification
EASEAI 2021: Proceedings of the 3rd International Workshop on Education through Advanced Software Engineering and Artificial IntelligenceSoftware systems become increasingly complex and testing is a vital component of the development process. Teaching software testing concepts are now more than ever acknowledged as essential.
The aim of this paper is to report on our software testing ...
Exploratory Datamorphic Testing of Classification Applications
AST '20: Proceedings of the IEEE/ACM 1st International Conference on Automation of Software TestTesting has been widely recognised as difficult for AI applications. This paper proposes a set of testing strategies for testing machine learning applications in the framework of the datamorphism testing methodology. In these strategies, testing aims at ...
Comments