Zeeshan Anwar
Skip Abstract Section
Abstract
Regression Test Suite Optimization (RTO) is an active research area. A Regression Test Suite is always growing due to changes in software, which increases testing time. To save time and resources optimization of regression test suites is mandatory. Researchers have optimized test suites using conventional and Computational Intelligence based approaches and achieve optimization of regression test suites through selection techniques, minimization or reduction techniques and ranking or prioritization techniques. This paper surveys existing techniques for regression test suite optimization, various tools and mathematical models being used for RTO. During this survey we found many interesting facts about regression test suite optimization that will be shared in the conclusion.
- Manoj Kumar, Arun Sharma and Rajesh Kumar, Optimization of Test Cases using Soft Computing Techniques: A Critical Review, WSEAS Transactions on Information Science and Applications, Issue 11, Volume 8, November 2011, pp 440--452.Google Scholar
- A. A. Haider, S. Rafique and A. Nadeem, Test Suite Optimization using Fuzzy Logic, 8th International Conference of Emerging Techniques (ICET), 8th October 2012.Google ScholarCross Ref
- Gaurav Duggal, Bharti Suri,Understanding Regression Testing Techniques http://www.rimtengg.com/coit2008/proceedings/SW15.pdfGoogle Scholar
- Todd L. Graves, Mary Jean Harrold, Jung-Min Kim, Adam Porter and Gregg Rothermel, ACM Transactions on Software Engineering and Methodology, Vol. 10, No. 2, April 2001, pp 184--208. Google ScholarDigital Library
- S. Yoo and M. Harman, Regression Testing Minimisation, Selection and Prioritisation: A Survey, Softw. Test. Verif. Reliab. 2007; 00:1--7, pp 1--60. Google ScholarDigital Library
- W. Eric Wong, J. R. Horgan, Saul London and Hira Agrawal, A Study of Effective Regression Testing in Practice, 8th IEEE International Symposium on Software Reliability Engineering (ISSRE'97), pp 264--274,Albuquerque,NM, November 1997. Google ScholarDigital Library
- Ruchika Malhotra, Arvinder Kaur and Yogesh Singh, A Regression Test Selection and Prioritization Technique, Journal of Information Processing Systems, Vol.6, No.2, June 2010, pp 235--252.Google ScholarCross Ref
- Saran Prasad , Mona Jain and Shradha Singh, Regression Optimizer A Multi Coverage Criteria Test Suite Minimization Technique, International Journal of Applied Information Systems (IJAIS) -- ISSN : 2249-0868, Foundation of Computer Science FCS, New York, USA Volume 1-- No.8, April 2012 -- www.ijais.org, pp 5--11.Google Scholar
- Nanda, Agastya, Senthil Mani, Saurabh Sinha, Mary Jean Harrold, and Alessandro Orso. "Regression testing in the presence of noncode changes." In Software Testing, Verification and Validation (ICST), 2011 IEEE Fourth International Conference on, pp. 21--30. Google ScholarDigital Library
- Gregg Rothermel, Roland H. Untch, Chengyun Chu and Mary Jean Harrold, Test Case Prioritization: An Empirical Study, Proceedings of the International Conference on Software Maintenance, Oxford, UK, September, 1999. Google ScholarDigital Library
- Mansour, Nashat, and WaelStatieh. "Regression test selection for C# programs." Advances in Software Engineering 2009 (2009): 1. Google ScholarDigital Library
- Machani Siva Prasad, An Efficient Regression Testing By Computing Coverage Data For Software Evolution, International Journal of Computer Science & Informatics, Volume-I, Issue- II,2011, pp 76--79.Google Scholar
- Jung-Min Kim and Adam Porter, A History-Based Test Prioritization Technique for Regression Testing in Resource Constrained Environments, 1CSE'02, May 19-25, 2002, Orlando, Florida, USA. Google ScholarDigital Library
- Alessandro Orso, Nanjuan Shi, and Mary Jean Harrold, Scaling Regression Testing to Large Software Systems, SIGSOFT'04 /FSE12, Oct. 31--Nov. 6, 2004, Newport Beach, CA, USA Google ScholarDigital Library
- Chittimalli, Pavan Kumar, and M-J. Harrold. "Recomputing coverage information to assist regression testing." Software Engineering, IEEE Transactions on 35, No. 4, 2009, pp 452--469. Google ScholarDigital Library
- Willmor, David, and Suzanne M. Embury. "A safe regression test selection technique for database-driven applications." In Software Maintenance, 2005. ICSM'05. Proceedings of the 21st IEEE International Conference, pp. 421--430. Google ScholarDigital Library
- Chang-ai Sun, A Constraint-based Test Suite Reduction Method for Conservative Regression Testing, Journal of Software, Vol. 6, No. 2, February 2011, pp 314--321.Google Scholar
- Saran Prasad, Mona Jain and Shradha Singh, Regression Optimizer A Multi Coverage Criteria Test Suite Minimization Technique, International Journal of Applied Information Systems (IJAIS) -- ISSN : 2249-0868, Foundation of Computer Science FCS, New York, USA Volume 1-- No.8, April 2012 -- www.ijais.org, pp 5--11Google Scholar
- Saeed Parsa and Alireza Khalilian, On the Optimization Approach towards Test Suite Minimization, International Journal of Software Engineering and Its Applications Vol. 4, No. 1, January 2010, pp 15--28.Google Scholar
- Zheng Li, Mark Harman, and Robert M. Hierons, Search Algorithms for Regression Test Case Prioritization, IEEE Transactions on Software Engineering, Vol. 33, No. 4, April 2007. Google ScholarDigital Library
- Qian Zhongsheng, Test Case Generation and Optimization for User Session-based Web Application Testing, Journal of Computers, Vol. 5, No. 11, November 2010, pp 1655--1662.Google Scholar
- S. Nachiyappan A. Vimaladevi and C.B. Selva Lakshmi, An Evolutionary Algorithm for Regression Test Suite Reduction, Proceedings of the International Conference on Communication and Computational Intelligence -- 2010,pp 503--508Google Scholar
- Arvinder Kaur and Shubhra Goyal, A Genetic Algorithm for Fault based Regression Test Case Prioritization, International Journal of Computer Applications (0975 -- 8887) Volume 32-- No.8, October 2011, pp 30--37.Google Scholar
- Arvinder Kaur, A Bee Colony Optimization Algorithm for Code Coverage Test Suite Prioritization, International Journal of Engineering Science and Technology (IJEST), Vol. 3 No. 4 April 2011, pp 2786--2795Google Scholar
- Arvinder Kaur and Shubhra Goyal, A Genetic Algorithm for Regression Test Case Prioritization using Code Coverage, International Journal on Computer Science and Engineering (IJCSE), ISSN : 0975-3397 Vol. 3 No. 5 May 2011, pp 1839--1847.Google Scholar
- Luciano S. de Souza, Pericles B. C. de Miranda, Ricardo B. C. Prudencio and Flavia de A. Barros, A Multi-Objective Particle Swarm Optimization for Test Case Selection Based on Functional Requirements Coverage and Execution Effort, 2011 23rd IEEE International Conference on Tools with Artificial Intelligence, pp 245--252. Google ScholarDigital Library
- Arvinder Kaur and Divya Bhatt, Hybrid Particle Swarm Optimization for Regression Testing, International Journal on Computer Science and Engineering (IJCSE) Vol. 3 No. 5 May 2011, pp 1815--1824.Google Scholar
- Arvinder Kaur and Divya Bhatt, Particle Swarm Optimization with Cross-Over Operator for Prioritization in Regression Testing, International Journal of Computer Applications (0975 -- 8887) Volume 27-- No.10, August 2011, pp 27--34.Google ScholarCross Ref
- Xu, Zhiwei, KehanGao, and Taghi M. Khoshgoftaar. "Application of fuzzy expert system in test case selection for system regression test." Information Reuse and Integration, Conf, 2005. IRI-2005 IEEE International Conference IEEE, 2005.Google Scholar
- Ali M. Alakeel, A Fuzzy Test Cases Prioritization Technique for Regression Testing Programs with Assertions, ADVCOMP 2012 : The Sixth International Conference on Advanced Engineering Computing and Applications in Sciences, pp 78--82.Google Scholar
- Whyte, G. and Mulder, D.L. "Mitigating the Impact of Software Test Constraints on Software Testing Effectiveness" The Electronic Journal Information Systems Evaluation Volume 14 Issue 2 2011, pp 254--270.Google Scholar
- Ashraf, E., A. Rauf, and K. Mahmood. "Value based Regression Test Case Prioritization." Proceedings of the World Congress on Engineering and Computer Science. Vol. 1. 2012.Google Scholar
- Zeeshan Anwar and Ali Ahsan, Comparative Analysis of MOGA, NSGA-II and MOPSO for Regression Test Suite Optimization, International Journal of Software Engineering {Accepted for Publication}.Google Scholar
- Shin Yoo and Mark Harman, Pareto Efficient MultiObjective Test Case Selection.Google Scholar
- S. Yoo and M. Harman, Regression Testing Minimisation, Selection and Prioritisation: A Survey, Softw. Test. Verif. Reliab. 2007; 00:1--7, pp 1--60. Google ScholarDigital Library
- Harman, Mark. "Making the case for MORTO: Multi objective regression test optimization." Software Testing, Verification and Validation Workshops (ICSTW), 2011 IEEE Fourth International Conference on. IEEE, 2011. Google ScholarDigital Library
- Lin, Xuan. "Regression Testing in Research And Practice." Computer Science and Engineering Department University of Nebraska, Lincoln (2007): 1--402.Google Scholar
- Taneja, Kunal, Tao Xie, Nikolai Tillmann, Jonathan De Halleux, and Wolfram Schulte. "Guided path exploration for regression test generation." In Software Engineering-Companion Volume, 2009. ICSE-Companion 2009. 31st International Conference on, pp. 311--314.Google Scholar
- K.K. Aggarwal, and Y. Singh, "A book on software engineering", New Age International (P) Ltd.; Publishers, 4835/24, Ansari Road, Daryaganj, New Delhi, 2001.Google Scholar
- http://pleuma.cc.gatech.edu/aristotle/Tools/subjects/Google Scholar
- https://sites.google.com/site/asergrp/HomeGoogle Scholar
Index Terms
- Exploration and analysis of regression test suite optimization
Recommendations
On the Fly Test Suite Optimization with FuzzyOptimizer
FIT '13: Proceedings of the 2013 11th International Conference on Frontiers of Information TechnologyThere occur frequent requirement changes in software systems even after the software has been developed. Regression testing is continuously performed to identify the undesired affects of these requirement changes on already tested system. Test suites ...
Test-Suite Reduction and Prioritization for Modified Condition/Decision Coverage
Software testing is particularly expensive for developers of high-assurance software, such as software that is produced for commercial airborne systems. One reason for this expense is the Federal Aviation Administration's requirement that test suites be ...
On test suite composition and cost-effective regression testing
Regression testing is an expensive testing process used to revalidate software as it evolves. Various methodologies for improving regression testing processes have been explored, but the cost-effectiveness of these methodologies has been shown to vary ...
Comments