Pat McGee
Abstract
We are working with a broad class of testing techniques we collectively call High Volume Test Automation (HVTA). The essence of HVTA techniques is automated execution and evaluation of large numbers of tests, for the purpose of exposing functional errors that are otherwise hard to find. These techniques are not widely used in industry, but we believe they have the potential to help us substantially increase the reliability of software.We propose to find existing industry HVTA projects, write informal case studies of them, create our own tools to implement the technique, and apply our tool in a case study of one or more open source projects.
- Edelman, A. The mathematics of the Pentium division bug. SIAM Reviews, 39 (1). 54--67. Google Scholar
Digital Library
- Jorgensen, A. A. Testing with Hostile Data Streams. ACM Software Engineering Notes, 28 (2). Google ScholarDigital Library
- Kaner, C. The impossibility of complete testing Software QA, 1997, 28.Google Scholar
- McGee, P. and Kaner, C., Extended Random Regression Testing: Running long sequences of already-passed tests. in submitted to International Symposium on Software Testing and Analysis, (2004).Google Scholar
- Nicely, T. R. Letter to Intel: Bug in the Pentium FPU, 1994.Google Scholar
- U.S.-Canada Power System Outage Task Force. Final Report on the August 14th Blackout in the United States and Canada, 2004.Google Scholar
- Yin, R. K. Case Study Research: Design and Methods, 1994.Google Scholar
Index Terms
- Experiments with high volume test automation
Recommendations
A Static Approach to Prioritizing JUnit Test Cases
Test case prioritization is used in regression testing to schedule the execution order of test cases so as to expose faults earlier in testing. Over the past few years, many test case prioritization techniques have been proposed in the literature. Most ...
Empirically evaluating Greedy-based test suite reduction methods at different levels of test suite complexity
Test suite reduction is an important approach that decreases the cost of regression testing. A test suite reduction technique operates based on the relationship between the test cases in the regression test suite and the test requirements in the program ...
Test-Suite Reduction and Prioritization for Modified Condition/Decision Coverage
ICSM '01: Proceedings of the IEEE International Conference on Software Maintenance (ICSM'01)Software testing is particularly expensive for developers of high-assurance software, such as software that is produced for commercial airborne systems. One reason for this expense is the Federal Aviation Administration's requirement that test suites be ...
Comments