Zhongyan Chen
ABSTRACT
Software testing is a crucial phase of software development. Educators now are assessing tests written by students. Methods have been proposed to assess the completeness of student-written tests. However, there is more to good test quality than completeness, and these additional quality are not assessed by the previous work. Test smells are patterns of poorly designed tests that may negatively affect the quality of test and production code. We propose to assess test smells in students' code to improve the quality of software tests they write. In the early stages of this research, we will examine whether practitioners actually spend time and energy to remove those test smells summarized by researchers backed by real-world software projects. Then, we will develop and evaluate our new assessment method.
- Kalle Aaltonen, Petri Ihantola, and Otto Seppälä. 2010. Mutation analysis vs. code coverage in automated assessment of students' testing skills. In Proceedings of the ACM international conference companion on Object oriented programming systems languages and applications companion. 153--160.Google Scholar
Digital Library
- Kirsti M Ala-Mutka. 2005. A survey of automated assessment approaches for programming assignments. Computer science education 15, 2 (2005), 83--102.Google Scholar
- Gina R Bai, Justin Smith, and Kathryn T Stolee. 2021. How Students Unit Test: Perceptions, Practices, and Pitfalls. In Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1. 248--254.Google ScholarDigital Library
- Kevin Buffardi and Juan Aguirre-Ayala. 2021. Unit Test Smells and Accuracy of Software Engineering Student Test Suites. In Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1. 234--240.Google ScholarDigital Library
- Richard A DeMillo, Richard J Lipton, and Frederick G Sayward. 1978. Hints on test data selection: Help for the practicing programmer. Computer 11, 4 (1978), 34--41.Google ScholarDigital Library
- Stephen H Edwards. 2004. Using software testing to move students from trial-and-error to reflection-in-action. In Proceedings of the 35th SIGCSE technical symposium on Computer science education. 26--30.Google ScholarDigital Library
- Stephen H Edwards and Zalia Shams. 2014. Comparing test quality measures for assessing student-written tests. In Companion Proceedings of the 36th International Conference on Software Engineering. 354--363.Google ScholarDigital Library
- Sukru Eraslan, Kamilla Kopec-Harding, Caroline Jay, Suzanne M Embury, Robert Haines, Julio César Cortés Ríos, and Peter Crowther. 2020. Integrating GitLab metrics into coursework consultation sessions in a software engineering course. Journal of Systems and Software 167 (2020), 110613.Google ScholarCross Ref
- Vahid Garousi and Barış Küçük. 2018. Smells in software test code: A survey of knowledge in industry and academia. Journal of systems and software 138 (2018), 52--81.Google ScholarCross Ref
- Michael H Goldwasser. 2002. A gimmick to integrate software testing throughout the curriculum. ACM SIGCSE Bulletin 34, 1 (2002), 271--275.Google ScholarDigital Library
- Divya Kumar and Krishn Kumar Mishra. 2016. The impacts of test automation on software's cost, quality and time to market. Procedia Computer Science 79 (2016), 8--15.Google ScholarCross Ref
- Stefano Lambiase, Andrea Cupito, Fabiano Pecorelli, Andrea De Lucia, and Fabio Palomba. 2020. Just-In-Time Test Smell Detection and Refactoring: The DARTS Project. In Proceedings of the 28th International Conference on Program Comprehension. 441--445.Google ScholarDigital Library
- Anthony Peruma, Khalid Almalki, Christian D Newman, Mohamed Wiem Mkaouer, Ali Ouni, and Fabio Palomba. 2020. Tsdetect: An open source test smells detection tool. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 1650--1654.Google ScholarDigital Library
- Abdallah Qusef, Mahmoud O Elish, and David Binkley. 2019. An exploratory study of the relationship between software test smells and fault-proneness. IEEE Access 7 (2019), 139526--139536.Google ScholarCross Ref
- Railana Santana, Luana Martins, Larissa Rocha, Tássio Virgínio, Adriana Cruz, Heitor Costa, and Ivan Machado. 2020. RAIDE: a tool for Assertion Roulette and Duplicate Assert identification and refactoring. In Proceedings of the 34th Brazilian Symposium on Software Engineering. 374--379.Google ScholarDigital Library
- Danilo Silva, Nikolaos Tsantalis, and Marco Tulio Valente. 2016. Why we refactor? confessions of github contributors. In Proceedings of the 2016 24th acm sigsoft international symposium on foundations of software engineering. 858--870.Google ScholarDigital Library
- Brent van Bladel and Serge Demeyer. 2017. Test refactoring: a research agenda. In Proceedings SATToSE.Google Scholar
- Arie Van Deursen, Leon Moonen, Alex Van Den Bergh, and Gerard Kok. 2001. Refactoring test code. In Proceedings of the 2nd international conference on extreme programming and flexible processes in software engineering (XP2001). Citeseer, 92--95.Google Scholar
- Tongjie Wang, Yaroslav Golubev, Oleg Smirnov, Jiawei Li, Timofey Bryksin, and Iftekhar Ahmed. 2021. PyNose: A Test Smell Detector For Python. arXiv preprint arXiv:2108.04639 (2021).Google Scholar
Index Terms
- Students vs. professionals: improving the learning of software testing
Recommendations
How Students Unit Test: Perceptions, Practices, and Pitfalls
ITiCSE '21: Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1Unit testing is reported as one of the skills that graduating students lack, yet it is an essential skill for professional software developers. Understanding the challenges students face during testing can help inform practices for software testing ...
Unit Test Smells and Accuracy of Software Engineering Student Test Suites
ITiCSE '21: Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1With an increasing emphasis on unit testing in computer science curricula, we examined students' work on testing assignments to investigate their adoption of test smells---practices that indicate potential problems in unit tests. We discovered three ...
The secret life of test smells - an empirical study on test smell evolution and maintenance
AbstractIn recent years, researchers and practitioners have been studying the impact of test smells on test maintenance. However, there is still limited empirical evidence on why developers remove test smells in software maintenance and the mechanism ...
Comments