skip to main content
10.1145/1385269.1385279acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
research-article

Focused iterative testing: a test automation case study

Published:13 June 2008Publication History

ABSTRACT

Timing-related defects are among the most difficult types of defects to catch while testing software. They are by definition difficult to reproduce and hence difficult to debug. Not all components of a software system have timing-related defects. For example, either a parser can analyze an input or it cannot. However, systems that have concurrent threads such as database systems are prone to timing-related defects. As a result, software developers must tailor testing to exploit vulnerabilities that occur because of threading. This paper presents the Focused Iterative Testing (FIT) approach, which uses a repetitive and iterative approach to find timing-related defects and target product areas with multithreaded characteristics by executing system tests with a multi-user test suite.

References

  1. H. Bati, L. Giakoumakis, S. Herbert, and A. Surna. A genetic approach for random testing of database systems. In The 33rd International Conference on Very Large Data Bases, pages 1243--1251, Vienna, Austria, September 2007. VLDB Endowment. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. J. W. Duran and S. C. Ntafos. An evaluation of random testing. IEEE Transactions on Software Engineering, SE-10(4):438--443, July 1984.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. R. Hamlet. Random testing. Encyclopedia of Software Engineering. Wiley, 1994.Google ScholarGoogle Scholar
  4. IBM. DB2 for Linux, UNIX, and Windows, Current May 2008. http://publib.boulder.ibm.com/infocenter/db2luw/v9.Google ScholarGoogle Scholar
  5. S. K. Effective random testing of concurrent programs. In The 22nd IEEE/ACM International Conference on Automated Software Engineering, pages 323--332, Atlanta, Georgia, USA, November 2007. ACM New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. M. Musuvathi and S. Qadeer. Iterative context bounding for systematic testing of multi-threaded programs. In The 2007 ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI '07), pages 446--455, San Diego, California, USA, June 2007. ACM New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. V. Mutilin. Concurrent testing of java components using java pathfinder. In The 2nd International Symposium on Leveraging Applications of Formal Methods, Verification and Validation, pages 53--59, Paphos, Cyprus, November 2006. IEEE Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. J.-C. Tai and R. Carver. Use of sequencing constraints for specifying, testing, and debugging concurrent programs. In International Conference on Parallel and Distributed Systems, pages 280--287, Hsinchu, December 1994. IEEE Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. W. Visser, K. Havelund, G. Brat, and S. Park. Model checking programs. In The 15th International Conference on Automated Software Engineering. IEEE Press, September 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Focused iterative testing: a test automation case study

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            DBTest '08: Proceedings of the 1st international workshop on Testing database systems
            June 2008
            74 pages
            ISBN:9781605582337
            DOI:10.1145/1385269

            Copyright © 2008 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 13 June 2008

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article

            Acceptance Rates

            Overall Acceptance Rate31of56submissions,55%

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader