Xiaofang Zhang
ABSTRACT
The optimization of software testing is one of the essential problems. In this paper, a stochastic Markov Decision Process (MDP) model of software testing is proposed, and the process of software testing is described as a reinforcement learning problem. A learning strategy based on the policy iteration of dynamic programming is presented to obtain the optimal testing profile. The case study indicates that, compared with random testing strategy, our learning strategy can significantly reduce the testing cost to detect and remove a certain number of software defects.
- Cai KY. Optimal software testing and adaptive software testing in the context of software cybernetics. Information and Software Technology, 2002, 44(4):841--855.Google Scholar
Cross Ref
- Gao Y, Zhou RY, Wang H, Cao ZX. Study on an Average Reward Reinforcement Learning Algorithm. Chinese Journal of Computers, 2007, 30(8): 1372--1378.Google Scholar
- Sutton RS, Barto G A. Reinforcement learning. MIT Press, 1998. Google ScholarDigital Library
- Walton GH, Poore JH. Measuring complexity and coverage of software specifications. Information and Software Technology, 2000, 42(12):859--872.Google ScholarCross Ref
- Frankl PG, Hamlet RG, Littlewood B, Strigini L. Evaluating testing methods by delivered reliability. IEEE Trans. on Software Engineering, 1998, 24(6):586--601. Google ScholarDigital Library
- Berman O, Cutler M. Resource allocation during tests for optimally reliable software. Computers and Operations Research, 2004, 31(11):1847--1865. Google ScholarDigital Library
- Dai YS, Xie M, Poh KL, Yang B. Optimal testing-resource allocation with genetic algorithm for modular software systems. The Journal of Systems and Software, 2003, 66(1):47--55. Google ScholarDigital Library
- Tal O, McCollin C, Bendell A. An optimal statistical testing policy for software reliability demonstration of safety-critical systems. European Journal of Operational Research, 2002, 137(3):544--557.Google ScholarCross Ref
- Sahinoglu M, Mayrhauser VA, Hajjar A, Chen T, Anderson C. On the efficiency of a compound Poisson stooping-rule for mixed strategy testing. In: Proc. of the 4th Int'l High-Assurance Systems Engineering Symposium (HASE). 1999. 249--256.Google Scholar
- Sahinoglu M. An empirical Bayesian stopping rule in testing and verification of behavioral models. IEEE Trans. on Instrumentation and Measurement, 2003, 52(5):1428--1442.Google ScholarCross Ref
- Rajgopal J, Mazumdar M. Modular operational test plans for inferences on software reliability based on a Markov model. IEEE Trans. on Software Engineering, 2002, 28(4):358--363. Google ScholarDigital Library
- Cai KY, Li YC, Ning WY. Optimal software testing in the setting of controlled Markov chains. European Journal of Operational Research, 2005, 162(2):552--579.Google ScholarCross Ref
- Zhang DP, Nie CH, Xu BW. Cross-Entropy method based on Markov Decision Process for optimal software testing. Journal of Software, 2008, 19(10):2770--2779.Google ScholarCross Ref
Index Terms
- A learning strategy for software testing optimization based on dynamic programming
Recommendations
Optimisation of software testing using Genetic Algorithm
Software testing is meant to increase confidence in the correctness of software. Test data generation is one of the key issues in software testing. A properly generated test suite may not only locate the errors in a software system, but also help in ...
The role of Reinforcement Learning in software testing
Abstract Context:Software testing is applied to validate the behavior of the software system and identify flaws and bugs. Different machine learning technique types such as supervised and unsupervised learning were utilized in software testing. However, ...
Test Suite Optimization Using Chaotic Firefly Algorithm in Software Testing
Software testing is time consuming and a costly activity. Effective generation of test cases is necessary in order to perform rigorous testing. There exist various techniques for effective test case generation. These techniques are based on various test ...
Comments