skip to main content
10.1145/3358501.3361234acmconferencesArticle/Chapter ViewAbstractPublication PagesdsmConference Proceedingsconference-collections
short-paper

Mutation testing for DSLs (tool demo)

Published: 20 October 2019 Publication History

Abstract

Mutation testing (MT) is a well-known technique to evaluate and improve the quality of a given test-suite. While several MT tools exist for traditional programming languages, there is no common method to take advantage of MT in the case of domain-specific languages (DSLs). The current MT tools for DSLs are created ad-hoc, incurring in a high cost.
To improve this situation, in this demo-paper we present Wodel-Test, a domain-independent tool to synthesize MT tools for arbitrary DSLs, and illustrate its usefulness by creating a MT tool for Finite Automata.

References

[1]
Hiralal Agrawal, Richard A. DeMillo, Bob Hathaway, William Hsu, Wynne Hsu, E.W. Krauser, R.J. Martin, Aditya P. Mathur, and Eugene Spafford. 1989. Design of Mutant Operators for the C Programming Language. Technical Report. Purdue University.
[2]
Thomas Allweyer. 2010. BPMN 2.0. BoD.
[3]
Alexandre Bartel, Benoit Baudry, Freddy Munoz, Jacques Klein, Tejeddine Mouelhi, and Yves Le Traon. 2011. Model Driven Mutation Applied to Adaptative Systems Testing. In Proc. Mutation Analysis Workshop. 408-413.
[4]
Jeremy S. Bradbury, James R. Cordy, and Juergen Dingel. 2006. Mutation Operators for Concurrent Java (J2SE 5.0). In 2nd Workshop on Mutation Analysis (Mutation 2006 - ISSRE Workshops 2006). 83-92.
[5]
Stefano Ceri, Piero Fraternali, and Aldo Bongio. 2000. Web Modeling Language (WebML): a modeling language for designing Web sites. Computer Networks 33, 1 (2000), 137 - 157.
[6]
Pedro Delgado-Pérez, Inmaculada Medina-Bulo, Francisco Palomo-Lozano, Antonio García-Domínguez, and Juan José Domínguez-Jiménez. 2017. Assessment of class mutation operators for C++ with the MuCPP mutation system. Information & Software Technology 81 (2017), 169-184.
[7]
Alex Denisov and Stanislav Pankevich. 2018. Mull It Over: Mutation Testing Based on LLVM. In IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). 25-31.
[8]
Pablo Gómez-Abajo, Esther Guerra, and Juan de Lara. 2016. Wodel: a domain-specific language for model mutation. In Proceedings of the 31st ACM/SIGAPP Symposium on Applied Computing, SAC. ACM, 1968- 1973.
[9]
Pablo Gómez-Abajo, Esther Guerra, and Juan de Lara. 2017. A domain-specific language for model mutation and its application to the automated generation of exercises. Computer Languages, Systems & Structures 49 (2017), 152 - 173.
[10]
Pablo Gómez-Abajo, Esther Guerra, Juan de Lara, and Mercedes G. Merayo. 2018. A tool for domain-independent model mutation. Science of Computer Programmming 163 (2018), 85-92.
[11]
Pablo Gómez-Abajo, Esther Guerra, Juan de Lara, and Mercedes G. Merayo. 2018. Towards a model-driven engineering solution for language independent mutation testing. In Jornadas de Ingeniería del Software y Bases de Datos (JISBD). Biblioteca digital SISTEDES, 4pps.
[12]
Alex Groce, Josie Holmes, Darko Marinov, August Shi, and Lingming Zhang. 2018. An Extensible, Regular-expression-based Tool for Multilanguage Mutant Generation. In International Conference on Software Engineering (ICSE). ACM, New York, NY, USA, 25-28.
[13]
Nicolas Harrand, Franck Fleurey, Brice Morin, and Knut Eilif Husa. 2016. ThingML: a language and code generation framework for heterogeneous targets. In Proceedings of the ACM/IEEE 19th International Conference on Model Driven Engineering Languages and Systems, Saint-Malo, France, October 2-7, 2016. 125-135. http://dl.acm.org/citation.cfm?id=2976812
[14]
Christopher Henard, Mike Papadakis, and Yves Le Traon. 2014. MutaLog: A Tool for Mutating Logic Formulas. In Proc. International Conference on Software Testing, Verification and Validation Workshops (ICSTW). IEEE CS, 399-404.
[15]
John E. Hopcroft and Richard M. Karp. 1971. A Linear Algorithm for Testing Equivalence of Finite Automata. Technical Report 0. Dept. of Computer Science, Cornell U.
[16]
Yue Jia and Mark Harman. 2008. MILU: A Customizable, Runtime-Optimized Higher Order Mutation Testing Tool for the Full C Language. In Testing: Academic Industrial Conference - Practice and Research Techniques (taic part 2008). 94-98.
[17]
Sun-Woo Kim, John A. Clark, and John A. McDermid. 2001. Investigating the effectiveness of object-oriented testing strategies using the mutation method. Softw. Test., Verif. Reliab. 11, 3 (2001), 207-225.
[18]
Markus Kusano and Chao Wang. 2013. CCmutator: A Mutation Generator for Concurrency Constructs in Multithreaded C/C++ Applications. In IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE Press, 722-725.
[19]
Yu-Seung Ma, Yong Rae Kwon, and Jeff Offutt. 2002. Inter-Class Mutation Operators for Java. In 13th International Symposium on Software Reliability Engineering (ISSRE). 352-366.
[20]
Dorsa Sadigh, Sanjit A. Seshia, and Mona Gupta. 2013. Automating Exercise Generation: A Step Towards Meeting the MOOC Challenge for Embedded Systems. In WESE. ACM, Article 2, 8 pages.
[21]
Dave Steinberg, Frank Budinsky, Ed Merks, and Marcelo Paternostro. 2008. EMF: eclipse modeling framework. Pearson Education.

Cited By

View all
  • (2020)Model-Driven Fault Injection in Java Source Code2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE)10.1109/ISSRE5003.2020.00046(414-425)Online publication date: Oct-2020
  • (2020)Wodel-Test: a model-based framework for language-independent mutation testingSoftware and Systems Modeling10.1007/s10270-020-00827-0Online publication date: 17-Oct-2020
  • (2020)Seed Model Synthesis for Testing Model-Based Mutation OperatorsAdvanced Information Systems Engineering10.1007/978-3-030-58135-0_6(64-76)Online publication date: 28-Aug-2020

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
DSM 2019: Proceedings of the 17th ACM SIGPLAN International Workshop on Domain-Specific Modeling
October 2019
62 pages
ISBN:9781450369848
DOI:10.1145/3358501
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Model-driven engineering
  2. domain-specific languages
  3. model mutation
  4. mutation testing

Qualifiers

  • Short-paper

Conference

SPLASH '19
Sponsor:

Acceptance Rates

Overall Acceptance Rate 31 of 50 submissions, 62%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2020)Model-Driven Fault Injection in Java Source Code2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE)10.1109/ISSRE5003.2020.00046(414-425)Online publication date: Oct-2020
  • (2020)Wodel-Test: a model-based framework for language-independent mutation testingSoftware and Systems Modeling10.1007/s10270-020-00827-0Online publication date: 17-Oct-2020
  • (2020)Seed Model Synthesis for Testing Model-Based Mutation OperatorsAdvanced Information Systems Engineering10.1007/978-3-030-58135-0_6(64-76)Online publication date: 28-Aug-2020

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media