Bogdan Korel
ABSTRACT
During regression testing, a modified system needs to be retested using the existing test suite. Since test suites may be very large, developers are interested in detecting faults in the system as early as possible. Test prioritization orders test cases for execution to increase potentially the chances of early fault detection during retesting. Most of the existing test prioritization methods are based on the code of the system, but model-based test prioritization has been recently proposed. System modeling is a widely used technique to model state-based systems. System models may not only be used to generate test cases but also to prioritize tests. In model-based prioritization, information collected during execution of a model is used to prioritize tests for execution. In this paper we present several model-based test prioritization heuristics. The major motivation to develop these heuristics was simplicity and effectiveness in early fault detection. We have conducted a small experimental study in which we experimentally compared model-based test prioritization heuristics. The results have shown that some simple heuristic methods can be as effective in early fault detection as more complex ones.
- K. Cheng, A. Krishnakumar, "Automatic Functional Test Generation Using The Extended Finite State Machine Model," Proc. ACM/IEEE Design Automation Conf., pp. 86--91, 1993. Google Scholar
Digital Library
- J. Dick, A. Faivre, "Automating the Generation and Sequencing of Test Case from Model-Based Specification," Proc. International Symposium on Formal Methods, pp. 268--284, 1992. Google ScholarDigital Library
- R. Dssouli, K. Saleh, E. Aboulhamid, A. En-Nouaary, C. Bourhfir, "Test Development For Communication Protocols: Towards Automation," Computer Networks, 31, pp. 1835--1872, 1999. Google ScholarDigital Library
- S. Elbaum, A. Malishevsky, G. Rothermel, "Incorportaing Varying Test Costs and Fault Severities into Test Case Prioritization," Proc. 23rd International Conference on Software Engineering, ICSE-01, pp. 329--338, 2001. Google ScholarDigital Library
- H. Hong, H. Ural, "A test sequence selection method for statecharts", Software Testing, Verification, and Reliability, Vol. 10, No. 4, pp. 203--227, 2000.Google ScholarCross Ref
- J. Kim, A. Porter, "A History-Based Test Prioritization Technique for Regression Testing in Resource Constraint Environments," Proc. 24th International Conference on Software Engineering, pp. 119--129, 2002. Google ScholarDigital Library
- B. Korel, L. Tahat, B. Vaysburg, "Model Based Regression Test Reduction Using Dependence Analysis," Proc. IEEE International Conf. on Software Maintenance, pp. 214--223, 2002. Google ScholarDigital Library
- B. Korel, L. H. Tahat, and M. Harman, "Test Prioritization Using System Models" Proc. 21st IEEE Int'l Conf. Software Maintenance (ICSM '05), pp. 559--568, 2005. Google ScholarDigital Library
- Z. Li, M. Harman, R. Hierons, "Search Algorithms for Regression Test Case Prioritization," IEEE Tran. Software Engineering, vol. 33, No. 4, pp. 225--237, 2007. Google ScholarDigital Library
- G. Rothermel, M. Harrold, "Selecting Tests and Identifying Test Coverage Requirements for Modified Software," Proc. IEEE International Conf. on Software Maintenance, pp. 358--367, 1994.Google Scholar
- G. Rothermel, M. Harrold, "A Safe, Efficient Regression Test Selection Technique," ACM Transactions on Software Engineering & Methodology, 6(2), pp. 173--210, 1997. Google ScholarDigital Library
- G. Rothermel, R. Untch, M. Harrold, "Prioritizing Test Cases For Regression Testing," IEEE Transactions on Software Engineering, vol. 27, No. 10, pp. 929--948, 2001. Google ScholarDigital Library
- A. Srivastava, J. Thiagarajan, "Effectively Prioritizing Tests in Development Environment," Proc. ACM International Symposium on Software Testing and Analysis, ISSTA-02, pp. 97--106, 2002. Google ScholarDigital Library
- B. Vaysburg, L. Tahat, B. Korel, "Dependence Analysis in Reduction of Requirement Based Test Suites," Proc. ACM International Symposium on Software Testing and Analysis, pp. 107--111, 2002. Google ScholarDigital Library
- W. Wong, J. Horgan, S. London, H. Agrawal, "A Study of Effective Regression Testing in Practice," Proc. 8th International Symposium on Software Reliability, pp. 230--238, 1997. Google ScholarDigital Library
- Model-based test prioritization heuristic methods and their evaluation
Recommendations
Optimizing test prioritization via test distribution analysis
ESEC/FSE 2018: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software EngineeringTest prioritization aims to detect regression faults faster via reordering test executions, and a large number of test prioritization techniques have been proposed accordingly. However, test prioritization effectiveness is usually measured in terms of ...
A Heuristic Model-Based Test Prioritization Method for Regression Testing
IS3C '12: Proceedings of the 2012 International Symposium on Computer, Consumer and ControlDue to the resource and time constraints for re-executing large test suites in regression testing, developers are interested in detecting faults in the system as early as possible. Test case prioritization seeks to order test cases in such a way that ...
Experimental Comparison of Code-Based and Model-Based Test Prioritization
ICSTW '09: Proceedings of the IEEE International Conference on Software Testing, Verification, and Validation WorkshopsDuring regression testing, a modified system needs to beretested using the existing test suite. Since test suites may be very large, developers are interested in detecting faults in the system as early as possible. Test prioritization orders test cases ...
Comments