skip to main content
10.1145/3459960.3459971acmotherconferencesArticle/Chapter ViewAbstractPublication PagesecbsConference Proceedingsconference-collections
research-article

Survey of Learning Environments for Software Testing Education

Published: 27 May 2021 Publication History

Abstract

Software development is one of the fastest growing industries today. The defects in software can be very costly, either in terms of losing money, reputation, or even lives in case of some critical applications. Consequently, there is a high and always increasing demand for software engineers specialized in the branch of software testing. However, traditional software engineering courses pay very little attention to the software testing, and students are entering the market with very little practical testing experience. One way to address this problem is to integrate software testing into the engineering studies through collaborative learning environments and simulators that can help students gain practical experience and learn testing techniques in an interesting way. In this paper, we provide a survey of software testing environments and tools that can help in this process.

References

[1]
Maurício Aniche, Felienne Hermans, and Arie Van Deursen. 2019. Pragmatic software testing education. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education. 414–420.
[2]
Tara Astigarraga, Eli M Dow, Christina Lara, Richard Prewitt, and Maria R Ward. 2010. The emerging role of software testing in curricula. In 2010 IEEE Transforming Engineering Education: Creating Interdisciplinary Skills for Complex Global Environments. IEEE, 1–26.
[3]
Craig Caulfield, Jianhong Cecilia Xia, David Veal, and S Maj. 2011. A systematic survey of games used for software engineering education. Modern Applied Science 5, 6 (2011), 28–43.
[4]
Peter J Clarke, Debra Davis, Tariq M King, Jairo Pava, and Edward L Jones. 2014. Integrating testing into software engineering courses supported by a collaborative learning environment. ACM Transactions on Computing Education (TOCE) 14, 3 (2014), 1–33.
[5]
Sebastian Elbaum, Suzette Person, Jon Dokulil, and Matt Jorde. 2007. Bug hunt: Making early software testing lessons engaging and affordable. In 29th International Conference on Software Engineering (ICSE’07). IEEE, 688–697.
[6]
Union européenne. Commission européenne and Union européenne. Direction générale de la recherche. 2007. Science education now: A renewed pedagogy for the future of Europe. Office for Official Publications of the European Communities.
[7]
Gordon Fraser, Alessio Gambi, Marvin Kreis, and José Miguel Rojas. 2019. Gamifying a software testing course with code defenders. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education. 571–577.
[8]
Edward L Jones. 2001. An experiential approach to incorporating software testing into the computer science curriculum. In 31st Annual Frontiers in Education Conference. Impact on Engineering and Science Education. Conference Proceedings (Cat. No. 01CH37193), Vol. 2. IEEE, F3D–7.
[9]
Per Lauvås Jr and Andrea Arcuri. 2018. Recent trends in software testing education: A systematic literature review. In Norsk IKT-konferanse for forskning og utdanning.
[10]
Otávio Augusto Lazzarini Lemos, Fábio Fagundes Silveira, Fabiano Cutigi Ferrari, and Alessandro Garcia. 2018. The impact of Software Testing education on code reliability: An empirical assessment. Journal of Systems and Software 137 (2018), 497–511.
[11]
Timothy C Lethbridge, Jorge Diaz-Herrera, J Richard Jr, J Barrie Thompson, 2007. Improving software practice through education: Challenges and future trends. In Future of Software Engineering (FOSE’07). IEEE, 12–28.
[12]
Bosko Nikolic, Zaharije Radivojevic, Jovan Djordjevic, and Veljko Milutinovic. 2009. A survey and evaluation of simulators suitable for teaching courses in computer architecture and organization. IEEE Transactions on Education 52, 4 (2009), 449–458.
[13]
Juan P Ucán Pech, Raúl A Aguilar Vera, and Omar S Gómez. 2017. Software testing education through a collaborative virtual approach. In International Conference on Software Process Improvement. Springer, 231–240.
[14]
PWC Prasad, Abeer Alsadoon, Azam Beg, and Anthony Chan. 2016. Using simulators for teaching computer organization and architecture. Computer Applications in Engineering Education 24, 2 (2016), 215–224.
[15]
José Miguel Rojas and Gordon Fraser. 2016. Code defenders: a mutation testing game. In 2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW). IEEE, 162–167.
[16]
Rebecca Smith, Terry Tang, Joe Warren, and Scott Rixner. 2017. An automated system for interactively learning software testing. In Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education. 98–103.
[17]
Alexander Soska, Jürgen Mottok, and Christian Wolff. 2016. An experimental card game for software testing: Development, design and evaluation of a physical card game to deepen the knowledge of students in academic software testing education. In 2016 IEEE Global Engineering Education Conference (EDUCON). IEEE, 576–584.
[18]
Jaime Spacco, David Hovemeyer, William Pugh, Fawzi Emad, Jeffrey K Hollingsworth, and Nelson Padua-Perez. 2006. Experiences with marmoset: designing and using an advanced submission and testing system for programming courses. ACM Sigcse Bulletin 38, 3 (2006), 13–17.
[19]
Jaime Spacco, Jaymie Strecker, David Hovemeyer, and William Pugh. 2005. Software repository mining with Marmoset: An automated programming project snapshot and testing system. In Proceedings of the 2005 international workshop on Mining software repositories. 1–5.
[20]
Pedro Henrique Dias Valle, Armando Maciel Toda, Ellen Francine Barbosa, and José Carlos Maldonado. 2017. Educational games: A contribution to software testing education. In 2017 IEEE Frontiers in education Conference (FIE). IEEE, 1–8.
[21]
Erik Van Veenendaal, Dorothy Graham, and Rex Black. 2012. Foundations of software testing: ISTQB certification. Delmar Learning.
[22]
Dimiter Velev and Plamena Zlateva. 2017. Virtual reality challenges in education and training. International Journal of Learning and Teaching 3, 1 (2017), 33–37.
[23]
Eric Wong. 2012. Improving the state of undergraduate software testing education. In American Society for Engineering Education. American Society for Engineering Education.
[24]
PE Yujian Fu and Peter J Clarke. 2015. Integrating Software Testing to CS Curriculum Using WRESTT-CyLE. (2015).
[25]
Miodrag Živković 2019. Pregled primena virtuelnih okruženja u obrazovanju. In Sinteza 2019-International Scientific Conference on Information Technology and Data Related Research. Singidunum University, 99–106.
[26]
Miodrag Živković, Boško Nikolić, Jelica Protić, and Ranko Popović. 2014. A survey and classification of wireless sensor networks simulators based on the domain of use. Adhoc and Sensor Wireless Networks 20 (2014).
[27]
Tamara Živković and Miodrag Živković. 2020. Comparative Analysis of Techniques for Testing Object Oriented Programs. In 2020 Zooming Innovation in Consumer Technologies Conference (ZINC). IEEE, 270–275.

Cited By

View all
  • (2024)Element and Event-Based Test Suite Reduction for Android Test Suites Generated by Reinforcement Learningundefined10.12794/metadc2356236Online publication date: Jul-2024
  • (2024)Testing Robot Challenge: A Serious Game for Testing LearningProceedings of the 3rd ACM International Workshop on Gamification in Software Development, Verification, and Validation10.1145/3678869.3685686(26-29)Online publication date: 13-Sep-2024
  • (2023)Events-Based Test Suite Reduction for Mobile App Test Suites Generated by Reinforcement Learning2023 Congress in Computer Science, Computer Engineering, & Applied Computing (CSCE)10.1109/CSCE60160.2023.00423(2650-2657)Online publication date: 24-Jul-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ECBS 2021: 7th Conference on the Engineering of Computer Based Systems
May 2021
168 pages
ISBN:9781450390576
DOI:10.1145/3459960
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 May 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. distance learning
  2. education
  3. game-based learning
  4. learning environments
  5. software testing
  6. testing tools

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ECBS 2021

Acceptance Rates

Overall Acceptance Rate 25 of 49 submissions, 51%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)28
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Element and Event-Based Test Suite Reduction for Android Test Suites Generated by Reinforcement Learningundefined10.12794/metadc2356236Online publication date: Jul-2024
  • (2024)Testing Robot Challenge: A Serious Game for Testing LearningProceedings of the 3rd ACM International Workshop on Gamification in Software Development, Verification, and Validation10.1145/3678869.3685686(26-29)Online publication date: 13-Sep-2024
  • (2023)Events-Based Test Suite Reduction for Mobile App Test Suites Generated by Reinforcement Learning2023 Congress in Computer Science, Computer Engineering, & Applied Computing (CSCE)10.1109/CSCE60160.2023.00423(2650-2657)Online publication date: 24-Jul-2023
  • (2023)Can gamification help in software testing education? Findings from an empirical studyJournal of Systems and Software10.1016/j.jss.2023.111647200:COnline publication date: 1-Jun-2023
  • (2023)Learning environments in software testing education: An overviewComputer Applications in Engineering Education10.1002/cae.2265731:6(1497-1521)Online publication date: 27-Jun-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media