Abstract
Random testing (RT) is a fundamental and important software testing technique. Based on the observation that failure-causing inputs tend to be clustered together in the input domain, the approach of Adaptive Random Testing (ART) has been proposed to improve the fault-detection capability of RT. ART employs the location information of previously executed test cases to enforce an even spread of random test cases over the entire input domain. There have been several implementations (algorithms) of ART based on different intuitions and principles. Due to the nature of the principles adopted, these implementations have their own advantages and disadvantages. The majority of them require intensive computations to ensure the generation of evenly spread test cases, and hence incur high overhead. In this paper, we propose the notion of iterative partitioning to reduce the amount of the computation while retaining a high fault-detection capability. As a result, the cost effectiveness of ART has been improved.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bird, D.L., Munoz, C.U.: Automatic generation of random self-checking test cases. IBM Systems Journal 22(3), 229–245 (1983)
Chan, K.P., Chen, T.Y., Towey, D.: Normalized restricted random testing. In: Rosen, J.-P., Strohmeier, A. (eds.) Ada-Europe 2003. LNCS, vol. 2655, pp. 368–381. Springer, Heidelberg (2003)
Chen, T.Y., Eddy, G., Merkel, R., Wong, P.K.: Adaptive random testing through dynamic partitioning. In: Proceedings of the 4th International Conference on Quality Software (QSIC 2004), pp. 79–86. IEEE Computer Society Press, Los Alamitos (2004)
Chen, T.Y., Huang, D.H.: Adaptive random testing by localization. In: Proceedings of the 11th Asia-Pacific Software Engineering Conference (APSEC 2004), pp. 292–298. IEEE Computer Society, Los Alamitos (2004)
Chen, T.Y., Leung, H., Mak, I.K.: Adaptive Random Testing. In: Maher, M.J. (ed.) ASIAN 2004. LNCS, vol. 3321, pp. 320–329. Springer, Heidelberg (2004)
Chen, T.Y., Tse, T.H., Yu, Y.T.: Proportional sampling strategy: A compendium and some insights. The Journal of Systems and Software 58(1), 65–81 (2001)
Cobb, R., Mills, H.D.: Engineering software under statistical quality control. IEEE Software 7(6), 45–54 (1990)
Collected Algorithms from ACM. Association for Computing Machinery (1980)
Dabóczi, T., Kollár, I., Simon, G., Megyeri, T.: Automatic testing of graphical user interfaces. In: Proceedings of the 20th IEEE Instrumentation and Measurement Technology Conference 2003 (IMTC 2003), pp. 441–445 (2003)
Forrester, J.E., Miller, B.P.: An empirical study of the robustness of Windows NT applications using random testing. In: Proceedings of the 4th USENIX Windows Systems Symposium, pp. 59–68 (2000)
Godefroid, P., Klarlund, N., Sen, K.: DART: Directed automated random testing. In: Proceedings of ACM SIGPLAN 2005 Conference on Programming Language Design and Implementation (PLDI), pp. 213–223 (2005)
Hailpern, B., Santhanam, P.: Software debugging, testing, and verification. IBM Systems Journal 41(1), 4–12 (2002)
Hamlet, R.: Random testing. In: Marciniak, J. (ed.) Encyclopedia of Software Engineering, 2nd edn. John Wiley & Sons, Chichester (2002)
Loo, P.S., Tsai, W.K.: Random testing revisited. Information and Software Technology 30(7), 402–417 (1988)
Mak, I.K.: On the effectiveness of random testing. Master’s thesis, Department of Computer Science, The University of Melbourne (1997)
Mayer, J.: Adaptive Random Testing by Bisection and Localization. In: Grieskamp, W., Weise, C. (eds.) FATES 2005. LNCS, vol. 3997, pp. 72–86. Springer, Heidelberg (2006)
Miller, B.P., Fredriksen, L., So, B.: An empirical study of the reliability of UNIX utilities. Communications of the ACM 33(12), 32–44 (1990)
Miller, B.P., Koski, D., Lee, C.P., Maganty, V., Murthy, R., Natarajan, A., Steidl, J.: Fuzz revisited: A re-examination of the reliability of UNIX utilities and services. Technical Report CS-TR-1995-1268, University of Wisconsin (1995)
Miller, E.: Website testing, http://www.soft.com/eValid/Technology/White.Papers/website.testing.html
Nyman, N.: In defense of monkey testing: Random testing can find bugs, even in well engineered software. Microsoft Corporation, http://www.softtest.org/sigs/material/nnyman2.htm
Slutz, D.: Massive stochastic testing of SQL. In: Proceedings of the 24th International Conference on Very Large Data Bases (VLDB 1998), pp. 618–622 (1998)
Yoshikawa, T., Shimura, K., Ozawa, T.: Random program generator for Java JIT compiler test system. In: Proceedings of the 3rd International Conference on Quality Software (QSIC 2003), pp. 20–24. IEEE Computer, Los Alamitos (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, T.Y., Huang, D.H., Zhou, Z.Q. (2006). Adaptive Random Testing Through Iterative Partitioning. In: Pinho, L.M., González Harbour, M. (eds) Reliable Software Technologies – Ada-Europe 2006. Ada-Europe 2006. Lecture Notes in Computer Science, vol 4006. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11767077_13
Download citation
DOI: https://doi.org/10.1007/11767077_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-34663-0
Online ISBN: 978-3-540-34664-7
eBook Packages: Computer ScienceComputer Science (R0)