Skip to main content
Log in

Optimized test suites for automated testing using different optimization techniques

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Automated testing mitigates the risk of test maintenance failure, selects the optimized test suite, improves efficiency and hence reduces cost and time consumption. This paper is based on the development of an automated testing tool which includes two major automated components of software testing, test suite generation and test suite optimization. The control flow of the software under test has been represented by a flow graph. There are five test suite generation methods which are made available in the tool, namely boundary value testing, robustness testing, worst-case testing, robust worst-case testing and random testing. The generated test suite is further optimized to a desired fitness level using the artificial bee colony algorithm or the cuckoo search algorithm. The proposed method is able to provide a set of minimal test cases with maximum path coverage as compared to other algorithms. Finally, the generated optimal test suite is used for automated fault detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Abbreviations

TSG:

Test suite generation

TSO:

Test suite optimization

ABC:

Artificial bee colony

CSA:

Cuckoo search algorithm

SUT:

Software under test

N:

Nodes

E:

Edge

PSO:

Particle swarm optimization

GA:

Genetic algorithm

References

  • Badlaney J, Ghatol R, Jadhwani R (2006) An introduction to data-flow testing. In: NCSU CSC TR-2006

  • Barón HB, Crespo RG, Espada JP, Martínez OS (2015) Assessment of learning in environments interactive through fuzzy cognitive maps. Soft Comput. 19(4):1037–1050

    Article  Google Scholar 

  • Cabrerizo FJ, Moreno JM, Pérez IJ, Herrera-Viedma E (2010) Analyzing consensus approaches in fuzzy group decision making: advantages and drawbacks. Soft Comput 14(5):451–463

    Article  Google Scholar 

  • Cabrerizo FJ, Chiclana F, Al-Hmouz R, Morfeq A, Balamash AS, Herrera-Viedma E (2015) Decision making and consensus: challenges. J Intell Fuzzy Syst 29(3):1109–1118

    Article  MathSciNet  Google Scholar 

  • Chakri A, Khelif R, Benouaret M, Yang XS (2017) New directional bat algorithm for continuous optimization problems. Expert Syst Appl 69:159–175

    Article  Google Scholar 

  • Dash J, Dam B, Swain R (2016) Optimal design of linear phase multi-band stop filters using improved cuckoo search particle swarm optimization. Appl Soft Comput 52:435

    Article  Google Scholar 

  • Deason WH, Brown DB, Chang KH, Cross JH (1991) A rule-based software test data generator. IEEE Trans Knowl Data Eng 3(1):108–117

    Article  Google Scholar 

  • Gandomi AH, Yang XS, Alavi AH (2013) Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Eng. Comput. 29(1):17–35

    Article  Google Scholar 

  • Jamil M, Yang XS (2013) A literature survey of benchmark functions for global optimisation problems. Int J Math Model Numer Optim 4(2):150–194

    MATH  Google Scholar 

  • Karaboga D (2005) An idea based on honey bee swarm for numerical optimization. In: Technical report-tr06, Erciyes University, engineering faculty, computer engineering department, vol 200

  • Karaboga D, Basturk B (2007) Artificial bee colony (ABC) optimization algorithm for solving constrained optimization problems. In: Foundations of fuzzy logic and soft computing. Springer Berlin Heidelberg, pp 789–798

  • Korel B (1990) Automated software test data generation. IEEE Trans Softw Eng 16(8):870–879

    Article  Google Scholar 

  • Koziel S, Michalewicz Z (1999) Evolutionary algorithms, homomorphous mappings, and constrained parameter optimization. Evolut Comput 7(1):19–44

    Article  Google Scholar 

  • Kumar A, Chakarverty S (2011) Design optimization using genetic algorithm and cuckoo search. In: 2011 IEEE international conference on electro/information technology (EIT), pp 1–5

  • Luo J, Liu Q, Yang Y, Li X, Chen MR, Cao W (2016) An artificial bee colony algorithm for multi- objective optimisation. Appl. Softw Comput. doi:10.1016/j.asoc.2016.11.014

    Article  Google Scholar 

  • Mala DJ, Mohan V, Kamalapriya M (2010) Automated software test optimisation framework-an artificial bee colony optimisation-based approach. IET Softw 4(5):334–348

    Article  Google Scholar 

  • Malhotra R, Khari M (2014) Test suite optimization using mutated artificial bee colony. In: Proceedings of international conference on advances in communication, network, and computing, CNC, Elsevier, pp 45–54

  • Meza J, Espitia H, Montenegro C, Crespo RG (2015) Statistical analysis of a multi-objective optimization algorithm based on a model of particles with vorticity behaviour. Softw Comput, pp 1–16

  • Meza J, Espitia H, Montenegro C, Giménez E, González-Crespo R (2016) MOVPSO: vortex multi-objective particle swarm optimization. Appl Soft Comput 52:1042–1057

    Article  Google Scholar 

  • Morente-Molinera JA, Mezei J, Carlsson C, Herrera-Viedma E (2016) Improving supervised learning classification methods using multi-granular linguistic modelling and fuzzy entropy. In: IEEE transactions on fuzzy systems

  • Myers GJ (1979) The art of software testing. Wiley, Hoboken

    Google Scholar 

  • Pérez LG, Mata F, Chiclana F, Kou G, Herrera-Viedma E (2016) Modelling influence in group decision making. Soft Comput 20(4):1653–1665

    Article  Google Scholar 

  • Radatz J, Geraci A, Katki F (1990) IEEE standard glossary of software engineering terminology. IEEE Std 610121990(121990):3

    Google Scholar 

  • Ramchoun H, Amine M, Idrissi J, Ghanou Y, Ettaouil M (2016) Multilayer perceptron: architecture optimization and training. In: International journal of interactive multimedia and artificial inteligence, vol 4(Special Issue on Artificial Intelligence Underpinning)

  • Semwal VB, Singha J, Sharma PK, Chauhan A, Behera B (2016) An optimized feature selection technique based on incremental feature analysis for bio-metric gait data classification. In: Multimedia tools and applications, pp 1–19

    Article  Google Scholar 

  • Singh Y (2015) Automated expected output generation: is this a problem that has been solved? ACM SIGSOFT Softw Eng Notes 40(6):1–5

    Article  Google Scholar 

  • Yang XS, Deb S (2009) Cuckoo search via Lévy flights. In: World congress on nature and biologically inspired computing, 2009. NaBIC 2009. IEEE, pp 210–214

  • Yang XS, Deb S (2015) Cuckoo search for optimization and computational intelligence. In: IGI global

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rubén González Crespo.

Ethics declarations

Conflict of interest

There is no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khari, M., Kumar, P., Burgos, D. et al. Optimized test suites for automated testing using different optimization techniques. Soft Comput 22, 8341–8352 (2018). https://doi.org/10.1007/s00500-017-2780-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-017-2780-7

Keywords

Navigation