ABSTRACT
Timing-related defects are among the most difficult types of defects to catch while testing software. They are by definition difficult to reproduce and hence difficult to debug. Not all components of a software system have timing-related defects. For example, either a parser can analyze an input or it cannot. However, systems that have concurrent threads such as database systems are prone to timing-related defects. As a result, software developers must tailor testing to exploit vulnerabilities that occur because of threading. This paper presents the Focused Iterative Testing (FIT) approach, which uses a repetitive and iterative approach to find timing-related defects and target product areas with multithreaded characteristics by executing system tests with a multi-user test suite.
- H. Bati, L. Giakoumakis, S. Herbert, and A. Surna. A genetic approach for random testing of database systems. In The 33rd International Conference on Very Large Data Bases, pages 1243--1251, Vienna, Austria, September 2007. VLDB Endowment. Google ScholarDigital Library
- J. W. Duran and S. C. Ntafos. An evaluation of random testing. IEEE Transactions on Software Engineering, SE-10(4):438--443, July 1984.Google ScholarDigital Library
- R. Hamlet. Random testing. Encyclopedia of Software Engineering. Wiley, 1994.Google Scholar
- IBM. DB2 for Linux, UNIX, and Windows, Current May 2008. http://publib.boulder.ibm.com/infocenter/db2luw/v9.Google Scholar
- S. K. Effective random testing of concurrent programs. In The 22nd IEEE/ACM International Conference on Automated Software Engineering, pages 323--332, Atlanta, Georgia, USA, November 2007. ACM New York. Google ScholarDigital Library
- M. Musuvathi and S. Qadeer. Iterative context bounding for systematic testing of multi-threaded programs. In The 2007 ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI '07), pages 446--455, San Diego, California, USA, June 2007. ACM New York. Google ScholarDigital Library
- V. Mutilin. Concurrent testing of java components using java pathfinder. In The 2nd International Symposium on Leveraging Applications of Formal Methods, Verification and Validation, pages 53--59, Paphos, Cyprus, November 2006. IEEE Press. Google ScholarDigital Library
- J.-C. Tai and R. Carver. Use of sequencing constraints for specifying, testing, and debugging concurrent programs. In International Conference on Parallel and Distributed Systems, pages 280--287, Hsinchu, December 1994. IEEE Press. Google ScholarDigital Library
- W. Visser, K. Havelund, G. Brat, and S. Park. Model checking programs. In The 15th International Conference on Automated Software Engineering. IEEE Press, September 2000. Google ScholarDigital Library
Index Terms
- Focused iterative testing: a test automation case study
Recommendations
Diversifying Focused Testing for Unit Testing
Continuous Special Section: AI and SESoftware changes constantly, because developers add new features or modifications. This directly affects the effectiveness of the test suite associated with that software, especially when these new modifications are in a specific area that no test case ...
Iterative Metamorphic Testing
COMPSAC '05: Proceedings of the 29th Annual International Computer Software and Applications Conference - Volume 01An enhanced version of metamorphic testing, namely n-iterative metamorphic testing, is proposed to systematically exploit more information out of metamorphic tests by applying metamorphic relations in a chain style. A contrastive case study, conducted ...
Parameterized unit testing: theory and practice
ICSE '10: Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 2Unit testing has been widely recognized as an important and valuable means of improving software reliability, as it exposes bugs early in the software development life cycle. However, manual unit testing is often tedious and insufficient. Testing tools ...
Comments