Mustafa Bozkurt
ABSTRACT
Runtime testing cost caused by service invocations is considered as one of the major limitations in Service-centric System Testing (ScST). Unfortunately, most of the existing work cannot achieve cost reduction at runtime as they perform offline testing. In this paper, we introduce a novel cost-aware pareto optimal test suite minimisation approach for ScST aimed at reducing runtime testing cost. In experimental analysis, the proposed approach achieved reductions between 69% and 98.6% in monetary cost of service invocations while retaining test suite coverage. The results also provided evidence for the effectiveness of the selected algorithm HNSGA-II over the two commonly used algorithms: Greedy and NSGA-II.
- M. Bozkurt, "Cost-cognisant test suite reduction for service-centric systems," University College London, Tech. Rep. RN/13/04, 2013.Google Scholar
- M. Bozkurt and M. Harman, "Automatically generating realistic test input from web services," in phSOSE '11 Irvine, CA, USA: IEEE Computer Society, 2011, pp. 13--24. Google ScholarDigital Library
- M. Bozkurt and M. Harman, "Optimised realistic test input generation using web services," SSBSE 2012, vol. 7515. Riva Del Garda, Italy: Springer Berlin / Heidelberg, 2012, pp. 105--120. Google ScholarDigital Library
- M. Bozkurt, M. Harman, and Y. Hassoun, "Testing & verification in service-oriented architecture: A survey," phSTVR, 2012, To Appear.Google Scholar
- \BIBentryALTinterwordspacingCalculator web service. {Online}. Available: http://www.html2xml.nl/Services/Calculator/Version1/Calculator.asmx?WSDL\BIBentrySTDinterwordspacingGoogle Scholar
- G. Canfora and M. Di Penta, "Service-oriented architectures testing: A survey," in phSoftware Engineering, ser. Lecture Notes in Computer Science. Springer, 2009, vol. 5413/2009, pp. 78--105. Google ScholarDigital Library
- \BIBentryALTinterwordspacingECJ 20. {Online}. Available: http://cs.gmu.edu/ eclab/projects/ecj/\BIBentrySTDinterwordspacingGoogle Scholar
- FedEx Rate Calculator. {Online}. Available: https://www.fedex.com/ratefinder/home?cc=US&language=en&locId=express\BIBentrySTDinterwordspacingGoogle Scholar
- M. Harman, "Making the case for MORTO: Multi objective regression test optimization," in phRegression 2011, Berlin, Germany, 2011. Google ScholarDigital Library
- S.-S. Hou, L. Zhang, T. Xie, and J.-S. Sun, "Quota-constrained test-case prioritization for regression testing of service-centric systems," ICSM '08. Beijing, China: IEEE, 2008, pp. 257--266.Google Scholar
- S. Ilieva, V. Pavlov, and I. Manova, "A composable framework for test automation of service-based applications," QUATIC '10. Oporto, Portugal: IEEE Computer Society, 2010, pp. 286--291. Google ScholarDigital Library
- Z. Li, W. Sun, Z. B. Jiang, and X. Zhang, "BPEL4WS unit testing: framework and implementation," ICWS '05. Orlando, FL, USA: IEEE Computer Society, 2005, pp. 103--110 vol.1. Google ScholarDigital Library
- S. Mani, V. S. Sinha, S. Sinha, P. Dhoolia, D. Mukherjee, and S. Chakraborty, "Efficient testing of service-oriented applications using semantic service stubs," ICWS '09. Los Angeles, CA, USA: IEEE Computer Society, 2009, pp. 197--204. Google ScholarDigital Library
- P. Mayer and D. Lübke, "Towards a BPEL unit testing framework," TAV-WEB '06. Portland, Maine, USA: ACM, 2006, pp. 33--42. Google ScholarDigital Library
- M. Palomo-Duarte, A. Garc'ıa-Dom'ınguez, I. Medina-Bulo, A. Álvarez Ayllón, and J. Santacruz, "Takuan: A tool for ws-bpel composition testing using dynamic invariant generation." ICWE '10, Vienna, Austria, 2010, pp. 531--534. Google ScholarDigital Library
- H. Reza and D. Van Gilst, "A framework for testing RESTful web services," ITNG '10. Las Vegas, NV, USA: IEEE Computer Society, 2010, pp. 216--221. Google ScholarDigital Library
- BIBentryALTinterwordspacingShipping Calculator. {Online}. Available: http://www.unitedstateszipcodes.org/shipping-calculator/\BIBentrySTDinterwordspacingGoogle Scholar
- S. Thummalapenta, T. Xie, N. Tillmann, J. de Halleux, and Z. Su, "Synthesizing method sequences for high-coverage testing," OOPSLA '11. New York, NY, USA: ACM, 2011, pp. 189--206. Google ScholarDigital Library
- J. Wegener, A. Baresel, and H. Sthamer, "Evolutionary test environment for automatic structural testing," Information and Software Technology, vol. 43, no. 14, pp. 841--854, 2001.Google ScholarCross Ref
- X. Xiao, "Problem identification for structural test generation: First step towards cooperative developer testing," ICSE '11, 2011. Google ScholarDigital Library
- S. Yoo and M. Harman, "Using hybrid algorithm for pareto effcient multi-objective test suite minimisation," Journal of Systems Software, vol. 83, no. 4, pp. 689--701, 2010. Google ScholarDigital Library
- S. Yoo and M. Harman, "Regression testing minimisation, selection and prioritisation: A survey," STVR, vol. 22, no. 2, pp. 67--120, 2012. Google ScholarDigital Library
- L. Zhang, S.-S. Hou, C. Guo, T. Xie, and H. Mei, "Time-aware test-case prioritization using integer linear programming," ISSTA '09. New York, NY, USA: ACM, 2009, pp. 213--224. Google ScholarDigital Library
- H. Zhu, "A framework for service-oriented testing of web services," COMPSAC '06, vol. 2. Chicago, IL, USA: IEEE Computer Society, 2006, pp. 145--150. Google ScholarDigital Library
Index Terms
- Cost-aware pareto optimal test suite minimisation for service-centric systems
Recommendations
Using hybrid algorithm for Pareto efficient multi-objective test suite minimisation
Test suite minimisation techniques seek to reduce the effort required for regression testing by selecting a subset of test suites. In previous work, the problem has been considered as a single-objective optimisation problem. However, real world ...
MS‐guided many‐objective evolutionary optimisation for test suite minimisation
Test suite minimisation is a process that seeks to identify and then eliminate the obsolete orredundant test cases from the test suite. It is a trade‐off between cost andother value criteria and is appropriate to be described as a many‐...
On test suite composition and cost-effective regression testing
Regression testing is an expensive testing process used to revalidate software as it evolves. Various methodologies for improving regression testing processes have been explored, but the cost-effectiveness of these methodologies has been shown to vary ...
Comments