Abstract
Mutation testing is a kind of fault injection approach that can be used to generate tests or to assess the quality of test sets. For object-oriented languages, like C#, both object-oriented and standard (traditional) mutation operators should be applied. The methods that can contribute to reducing the number of applied operators and lowering the costs of mutation testing were experimentally investigated. We extended the CREAM mutation tool to support selective testing, sampling and clustering of mutants, and combining code coverage with mutation testing. We propose an approach to quality evaluation and present experimental results of mutation operators applied to C# programs.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Jia, Y., Harman, M.: An Analysis and Survey of the Development of Mutation Testing. IEEE Transactions on Software Engineering 37(5), 649–678 (2011)
Chevalley, P.: Applying Mutation Analysis for Object-Oriented Programs Using a Reactive Approach. In: Proc. of the 8th Asia-Pacific Software Engineering Conference, ASPEC, pp. 267–270 (2001)
Kim, S., Clark, J., McDermid J.A.: Class Mutation: Mutation Testing for Object-Oriented Programs. In: Conference on Object-Oriented Software Systems, Erfurt, Germany (2000)
Ma, Y.-S., Kwon, Y.-R., Offutt, J.: Inter-class Mutation Operators for Java. In: Proc. of International Symposium on Software Reliability Engineering, ISSRE 2002. IEEE Computer Soc. (2002)
Derezińska, A.: Advanced Mutation Operators Applicable in C# Programs. In: Sacha, K. (ed.) Software Engineering Techniques: Design for Quality. IFIP, vol. 227, pp. 283–288. Springer, Boston (2006)
Derezińska, A.: Quality Assessment of Mutation Operators Dedicated for C# Programs. In: Proc. of the 6th International Conference on Quality Software, QSIC 2006, pp. 227–234. IEEE Soc. Press (2006)
Derezińska, A., Szustek, A.: Tool-supported Mutation Approach for Verification of C# Programs. In: Zamojski, W., et al. (eds.) Proc. of International Conference on Dependability of Computer Systems, DepCoS-RELCOMEX 2008, pp. 261–268. IEEE Comp. Soc. (2008)
Derezińska, A., Szustek, A.: Object-Oriented Testing Capabilities and Performance Evaluation of the C# Mutation System, In: Szmuc, T., Szpyrka, M., Zendulka, J. (eds.) CEE-SET 2009. LNCS, vol. 7054, pp. 229–242 (2012)
Derezińska, A., Sarba, K.: Distributed Environment Integrating Tools for Software Testing. In: Elleithy, K. (ed.) Advanced Techniques in Computing Sciences and Software Engineering, pp. 545–550. Springer, Dordrecht (2009)
Derezińska, A., Kowalski, K.: Object-oriented Mutation Applied in Common Intermediate Language Programs Originated from C#. In: Proc. of 4th International Conference Software Testing Verification and Validation Workshops, 6th Workshop on Mutation Analysis, pp. 342–350. IEEE Comp. Soc. (2011)
Derezińska, A.: Classification of Operators of C# Language. In: Borzemski, L., et al. (eds.) Information Systems Architecture and Technology, New Developments in Web-Age Information Systems, pp. 261–271. Wrocław University of Technology (2010)
Offut, J., Rothermel, G., Zapf, C.: An Experimental Evaluation of Selective Mutation. In: Proc. of 15th International Conference on Software Engineering, pp. 100–107. IEEE Comp. Soc. Press (1993)
Barbosa, E.F., Maldonado, J.C., Vincenzi, A.M.R.: Toward the Determination of Sufficient Mutant Operators for C. Journal Software, Testing, Verification, and Reliability 11, 113–136 (2001)
Namin, S., Andrews, J.H.: On Sufficiency of Mutants. In: Proc. of 29th International Conference on Software Engineering, ICSE 2007 (2007)
Zhang, L., Hou, S.-S., Hu, J.-J., Xie, T., Mei, H.: Is Operator-Based Mutant Selection Superior to Random Mutant Selection? In: Proc. of the 32nd International Conference on Software Engineering, ICSE 2010, pp. 435–444 (2010)
Ma, Y.-S., Kwon, Y.-R., Kim, S.-W.: Statistical Investigation on Class Mutation Operators. ETRI Journal 31(2), 140–150 (2009)
Hu, J., Li, N., Offutt, J.: An Analysis of OO Mutation Operators. In: Proc. of 4th International Conference Software Testing Verification and Validation Workshops, 6th Workshop on Mutation Analysis, pp. 334–341. IEEE Comp. Soc. (2011)
Kaminski, G., Praphamontripong, U., Ammann, P., Offutt, J.: A Logic Mutation Approach to Selective Mutation for Programs and Queries. Information and Software Technology, 1137–1152 (2011)
Usaola, M.P., Mateo, P.R.: Mutation Testing Cost Reduction Techniques: a Survey. IEEE Software 27(3), 80–86 (2010)
Mathur, A.P., Wong, W.E.: Reducing the Cost of Mutation Testing: An Empirical Study. Journal of Systems and Software 31, 185–196 (1995)
Hussain, S.: Mutation Clustering. Ms. Th., King’s College London, Strand, London (2008)
Ji, C., Chen, Z.Y., Xu, B.W., Zhao, Z.: A Novel Method of Mutation Clustering Based on Domain Analysis. In: Proc. of 21st International Conference on Software Engineering & Knowledge Engineering, SEKE 2009, pp.422–425 (2009)
NUnit, http://www.nunit.org
NCover, http://www.ncover.com
Subversion svn, http://subversion.tigris.org
Derezińska, A., Rudnik, M.: Empirical Evaluation of Cost Reduction Techniques of Mutation Testing for C# Programs, Warsaw Univ. of Tech., Inst. of Computer Science Res. Rap. 1/2012 (2012)
Source Monitor, http://www.campwoodsw.com/sourcemonitor.html
Lee, H.-J., Ma, Y.-S., Kwon, Y.-R.: Empirical Evaluation of Orthogonality of Class Mutation Operators. In: Proc. of 11th Asia-Pacific Software Engineering Conference. IEEE Comp. Soc. (2004)
Ma, Y.-S., Harrold, M.J., Kwon, Y.-R.: Evaluation of Mutation Testing for Object-Oriented Programs. In: Proc. of 28th International Conference on Software Engineering, pp 869–872. IEEE Comp. Soc. Press (2006)
Ma, Y.-S., Offutt, J., Kwon, Y.-R.: MuJava: an Automated Class Mutation System. Software Testing, Verification and Reliability 15(2) (June 2005)
Smith, B.H., Williams, L.: A Empirical Evaluation of the MuJava Mutation Operators. In: Proc. 3rd International Workshop on Mutation Analysis Mutation 2007 at TAIC.Part 2007, Cumberland Lodge, Windsor UK, pp. 193–202 (September 2007)
Nester, http://nester.sourceforge.net/
Pexmutator, http://www.pexase.codeplex.com
Segura, S., Hierons, R.M., Benavides, D., Ruiz-Cortes, A.: Mutation Testing on an Object-oriented Framework: an Experience Report. Information and Software Technology, 1124–1136 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Derezińska, A., Rudnik, M. (2012). Quality Evaluation of Object-Oriented and Standard Mutation Operators Applied to C# Programs. In: Furia, C.A., Nanz, S. (eds) Objects, Models, Components, Patterns. TOOLS 2012. Lecture Notes in Computer Science, vol 7304. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30561-0_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-30561-0_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30560-3
Online ISBN: 978-3-642-30561-0
eBook Packages: Computer ScienceComputer Science (R0)