Bisma Rehman
ABSTRACT
Complete coverage of all possible test instances in the testing of integrated systems could achieve by using combinatorial testing (CT) strategies. Combinatorial testing has widely been studied in Web service testing research. Few studies related to testing basic web services while others focus on the composite service behavior of web services to generate minimum test cases or test data. This paper is a part of another larger paper that systematically map the available research work on combinatorial testing of web services. The paper presents a Classification scheme to structure the area and to report results based on the answers of three selected research questions. A classification scheme comprises combinatorial techniques algorithms and tools for testing and standard based SUT. This study exposes that even web service testing is getting noteworthy attention still very few approaches of CT applied to test web services.
- B. Li, D. Qiu, H. Leung, and D. Wang, "Automatic test case selection for regression testing of composite service based on extensible BPEL flow graph," Journal of Systems and Software, vol. 85, no. 6, pp. 1300--1324, Jun. 2012. Google Scholar
Digital Library
- S. Jabbar, K. Naseer, M. Gohar, S. Rho, and H. Chang, "Trust model at service layer of cloud computing for educational institutes," J Supercomput, vol. 72, no. 1, pp. 58--83, Jan. 2016. Google ScholarDigital Library
- K. A. Alam and R. Ahmad, "A HYBRID FUZZY MULTI-CRITERIA DECISION MODEL FOR CLOUD SERVICE SELECTION AND IMPORTANCE DEGREE OF COMPONENT SERVICES IN SERVICE COMPOSITIONS," in Uncertainty Modelling in Knowledge Engineering and Decision Making, Roubaix, France, 2016, pp. 334--340.Google Scholar
- S. Jabbar, M. Khan, B. N. Silva, and K. Han, "A REST-based industrial web of things' framework for smart warehousing," J Supercomput, vol. 74, no. 9, pp. 4419--4433, Sep. 2018. Google ScholarDigital Library
- A. Paul, A. Ahmad, M. M. Rathore, and S. Jabbar, "Smartbuddy: defining human behaviors using big data analytics in social internet of things," IEEE Wireless communications, vol. 23, no. 5, pp. 68--74, 2016. Google ScholarDigital Library
- P. A. Jeff Offutt, in Introduction to software testing, UK: Cambridge University Press, pp. 23--26.Google Scholar
- R. Shaheen and M. Rehman, "Evaluating Health Information Apps on Real Life Smart Phone Use.", ICFNDS'18, 26-27 June, Amman, Jordan, 2018. Google ScholarDigital Library
- M. B. Cohen and S. Ur, "Combinatorial test design in practice," in Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - ICSE '10, Cape Town, South Africa, 2010, vol. 2, p. 495. Google ScholarDigital Library
- K. Petersen, S. Vakkalanka, and L. Kuzniarz, "Guidelines for conducting systematic mapping studies in software engineering: An update," Information and Software Technology, vol. 64, pp. 1--18, Aug. 2015. Google ScholarDigital Library
- Barbara A. Kitchenham, "Guidelines for performing Systematic Literature Reviews in Software engineering," Software Engineering Group School of Computer Science and Mathematics Keele University, UK, Technical, Jan. 2007.Google Scholar
- K. A. Alam, R. Ahmad, A. Akhunzada, M. H. N. M. Nasir, and S. U. Khan, "Impact analysis and change propagation in service-oriented enterprises: A systematic review," Information Systems, vol. 54, pp. 43--73, Dec. 2015. Google ScholarDigital Library
- Anand Paul, Awais Ahmad, M. Mazhar Rathore, Sohail Jabbar, "SmartBuddy: Defining Human Behaviors Using Big Data Analytics in Social Internet of Things" IEEE Wireless Communications, Pages 68--74, Volume: 23, Issue: 5, October 2016. Google ScholarDigital Library
- C. Wohlin, "Guidelines for snowballing in systematic literature studies and a replication in software engineering," in Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering - EASE '14, London, England, United Kingdom, 2014, pp. 1--10. Google ScholarDigital Library
- A. Shahrokni and R. Feldt, "A systematic review of software robustness," Information and Software Technology, vol. 55, no. 1, pp. 1--17, Jan. 2013. Google ScholarDigital Library
- C. Bartolini, A. Bertolino, E. Marchetti, and A. Polini, "WS-TAXI: A WSDL-based Testing Tool for Web Services," in 2009 International Conference on Software Testing Verification and Validation, Denver, CO, USA, 2009, pp. 326--335. Google ScholarDigital Library
- M. Palacios, J. García-Fanjul, J. Tuya, and G. Spanoudakis, "Automatic test case generation for WS-Agreements using combinatorial testing," Computer Standards & Interfaces, vol. 38, pp. 84--100, Feb. 2015. Google ScholarDigital Library
- A. Kattepur, S. Sen, B. Baudry, A. Benveniste, and C. Jard, "Pairwise testing of dynamic composite services," in Proceeding of the 6th international symposium on Software engineering for adaptive and self-managing systems -SEAMS '11, Waikiki, Honolulu, HI, USA, 2011, p. 138. Google ScholarDigital Library
- S. Noikajana and T. Suwannasart, "An Improved Test Case Generation Method for Web Service Testing from WSDL-S and OCL with Pair-Wise Testing Technique," in 2009 33rd Annual IEEE International Computer Software and Applications Conference, Seattle, Washington, USA, 2009, pp. 115--123. Google ScholarDigital Library
- C. Mao, "Towards a Hierarchical Testing and Evaluation Strategy for Web Services System," in 2009 Seventh ACIS International Conference on Software Engineering Research, Management and Applications, Haikou, China, 2009, pp. 245--252. Google ScholarDigital Library
- Sohail Jabbar, Murad Khan, Bhagya Nathali Silva, and Kijun Han, "REST based Industrial Web of Things' Framework for Smart Warehousing", The Journal of Supercomputing, Springer, Vol. 74, Issue 9, pp 4419--4433, September 2018. Google ScholarDigital Library
- Q. Li, J. Chen, Y. Zhan, C. Mao, and H. Wang, "Combinatorial Mutation Approach to Web Service Vulnerability Testing Based on SOAP Message Mutations," in 2012 IEEE Ninth International Conference on e-Business Engineering, Hangzhou, China, 2012, pp. 156--162. Google ScholarDigital Library
- W.-T. Tsai, J. Luo, G. Qi, and W. Wu, "Concurrent Test Algebra Execution with Combinatorial Testing," in 2014 IEEE 8th International Symposium on Service Oriented System Engineering, Oxford, United Kingdom, 2014, pp. 35--46. Google ScholarDigital Library
- Jinfu Chen, Huanhuan Wang, D. Towey, Chengying Mao, Rubing Huang, and Yongzhao Zhan, "Worst-input mutation approach to web services vulnerability testing based on SOAP messages," Tinshhua Sci. Technol., vol. 19, no. 5, pp. 429--441, Oct. 2014.Google ScholarCross Ref
- Sohail Jabbar, Kashif Naseer, Moneeb Gohar, Seungmin Rho, Hangbae Chang, "Trust model at service layer of cloud computing for educational institutes", Journal of Supercomputing, Pages 58--83, Volume 72, Issue 1, Springer US, 2016. Google ScholarDigital Library
- H. Yang, K. Ma, C. Deng, H. Liao, J. Yan, and J. Zhang, "Towards Conformance Testing of Choreography Based on Scenario," in 2013 International Symposium on Theoretical Aspects of Software Engineering, Birmingham, United Kingdom, 2013, pp. 59--62. Google ScholarDigital Library
- W. Hummer, O. Raz, O. Shehory, P. Leitner, and S. Dustdar, "Testing of data-centric and event-based dynamic service compositions: TESTING OF DATA-CENTRIC AND EVENT-BASED DYNAMIC SERVICE COMPOSITIONS," Softw. Test. Verif. Reliab., vol. 23, no. 6, pp. 465--497, Sep. 2013.Google ScholarCross Ref
- G. Qi, W.-T. Tsai, C. J. Colbourn, J. Luo, and Z. Zhu, "Test-Algebra-Based Fault Location Analysis for the Concurrent Combinatorial Testing," IEEE Trans. Rel., vol. 67, no. 3, pp. 802--831, Sep. 2018.Google ScholarCross Ref
- K. Z. Watkins, "Introducing fault-based combinatorial testing to web services," in Proceedings of the IEEE SoutheastCon 2010 (SoutheastCon), Concord, NC, USA, 2010, pp. 131--134.Google Scholar
- Combinatorial Testing of Web Services: A Systematic Mapping
Recommendations
Metamorphic Testing for Web Services: Framework and a Case Study
ICWS '11: Proceedings of the 2011 IEEE International Conference on Web ServicesService Oriented Architecture (SOA) has become a major application development paradigm. As a basic unit of SOA applications, Web services significantly affect the quality of the applications constructed from them. Since the development and consumption ...
Collaborative Testing of Web Services
Software testers are confronted with great challenges in testing Web Services (WS) especially when integrating to services owned by other vendors. They must deal with the diversity of implementation techniques used by the other services and to meet a ...
Prioritizing random combinatorial test suites
SAC '17: Proceedings of the Symposium on Applied ComputingThe behaviour of a system under test can be influenced by several factors, such as system configurations, user inputs, and so on. It has also been observed that many failures are caused by only a small number of factors. Combinatorial testing aims at ...
Comments