skip to main content
10.1145/1390832.1390834acmconferencesArticle/Chapter ViewAbstractPublication PagesisstaConference Proceedingsconference-collections
research-article

Empirical studies of a decentralized regression test selection framework for web services

Published: 21 July 2008 Publication History

Abstract

As Web services grow in popularity and use, it is becoming more important for organizations to verify their evolving services to ensure that they are providing a desired level of confidence and one of the most common ways to perform this verification is regression testing. Safe regression test selection techniques are often employed in conjunction with regression testing to reduce the associated costs of testing without reducing the level of confidence provided. In a previous work, a framework which automates the safe regression test selection and regression testing processes was developed in a decentralized, end-to-end manner. This paper reports an empirical study of the framework designed to compare the cost of performing the proposed approach and running the selected tests with the cost of running all tests without performing a selection step. The results indicate that the framework can be effective in reducing the costs of performing regression test selection.

References

[1]
Rothermel, G and Harrold, M. J., A Safe, Efficient Regression Test Selection Technique", ACM Transactions Software Engineering and Methodology Vol. 6, No. 2, pp. 173--210, April 1997
[2]
Ruth, M., et al, "Towards Automatic Regression Test Selection for Web Services", International Workshop on Testing Emerging Software Technology 2007 (TEST '07), Beijing, China, pp. 729--736, July 2007
[3]
Cheung, S. C, Kramer, J., Compositional Reachability Analysis of Finite-state Distributed Systems with User-Specified Constraints", SIGSOFT Software Engineering Notes 20, 4, 140--150, Oct. 1995
[4]
Harrold, M. J., et al, "Regression Test Selection for Java Software", Proceedings of ACM Conference on Object-Oriented Programming, Systems, Languages, and Applications, pp 312--326, Tampa Bay, FL, Oct. 2001
[5]
Rothermel, G., Harold, M. J., "Empirical Studies of a Safe Regression Test Selection Technique", IEEE Transactions on Software Engineering, Vol. 24, No. 6, pp.401--419, June 1998.
[6]
Graham, S., et al. Building Web Services with Java: Making Sense of XML, SOAP, WSDL, and UDDI, Second Edition, Sams, June 2004
[7]
Monson-Haefel, R., J2EE Web Services, First Edition, Addison-Wesley Professional, October 2003.
[8]
Ballinger, K., .NET Web Services: Architecture and Implementation with .NET, Addison-Wesley Professional, February 2003.
[9]
Tyagi, S., "Realizing Strategies for Document-Based Web Services With JAX-WS 2.0: Part 3 in a Series", http://java.sun.com/developer/technicalArticles/xml/jaxrpcpatterns3/, December 2005.
[10]
Tyagi, S., "RESTful Web Services", http://java.sun.com/developer/ technicalArticles/WebServices/restful/, August 2006.
[11]
Chappell, D., et al., Java Web Services, First Edition, O'Reilly Media, Inc., March 2002
[12]
Hohpe, G., Enterprise Integration Patterns: Designing, Building, and Deploying Messaging Solutions, Addison-Wesley Professional, October 2003.
[13]
Fou, J., Web Services and the Banking Industry, http://webservicesarchitect.com/content/articles/fou03.asp, February 2002.
[14]
McGovern J., et al., Java Web Services Architecture, Morgan Kaufmann, April 2003.
[15]
Balani, N., Model and build ESB SOA frameworks, http://www.128.ibm.com/developerworks/web/library/wa-soaesb/, March 2005
[16]
Hutchinson, B., et al., "SOA programming model for implementing Web services, Part 4: An introduction to the IBM Enterprise Service Bus", http://www.128.ibm.com/developerworks/library/ws-soa-progmode14/, July 2005
[17]
Endrei, M., et al., Patterns: Service-Oriented Architecture and Web Services, IBM Redbook, http://www.redbooks.ibm.com/redbooks/pdfs/sg246303.pdf, April 2004
[18]
Endrei, M., et al., Patterns: Direct Connections for Intra- and Inter-enterprise, IBM Redbook, http://www.redbooks.ibm.com/redbooks/pdfs/sg246933.pdf, February 2004
[19]
Ballinger, K., et al, Web Services Interoperability (WS-I) Basic Profile 1.3, http://www.ws-i.org/Profiles/BasicProfile-1.2.html, March 2007.
[20]
Glover, M., et al., Web Services Interopeability (WS-I) Sample Apps, http://www.wsi.org/deliverables/workinggroup.aspx?wg=sampleapps, June 2004

Cited By

View all
  • (2018)Web Services Regression Testing Through Automated ApproachProgress in Advanced Computing and Intelligent Engineering10.1007/978-981-13-0224-4_5(53-61)Online publication date: 10-Jul-2018
  • (2014)Regression Testing of Web Service: A Systematic Mapping StudyACM Computing Surveys10.1145/263168547:2(1-46)Online publication date: 25-Aug-2014
  • (2014)Empirical Studies of Privacy-Preserving Regression Test Selection Techniques for Web ServicesProceedings of the 2014 IEEE International Conference on Software Testing, Verification, and Validation Workshops10.1109/ICSTW.2014.36(322-331)Online publication date: 31-Mar-2014
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
TAV-WEB '08: Proceedings of the 2008 workshop on Testing, analysis, and verification of web services and applications
July 2008
49 pages
ISBN:9781605580531
DOI:10.1145/1390832
  • Editors:
  • Tevfik Bultan,
  • Tao Xie
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. control-flow graphs
  2. empirical studies
  3. selective retest
  4. software maintenance
  5. web services

Qualifiers

  • Research-article

Conference

ISSTA '08
Sponsor:

Upcoming Conference

ISSTA '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2018)Web Services Regression Testing Through Automated ApproachProgress in Advanced Computing and Intelligent Engineering10.1007/978-981-13-0224-4_5(53-61)Online publication date: 10-Jul-2018
  • (2014)Regression Testing of Web Service: A Systematic Mapping StudyACM Computing Surveys10.1145/263168547:2(1-46)Online publication date: 25-Aug-2014
  • (2014)Empirical Studies of Privacy-Preserving Regression Test Selection Techniques for Web ServicesProceedings of the 2014 IEEE International Conference on Software Testing, Verification, and Validation Workshops10.1109/ICSTW.2014.36(322-331)Online publication date: 31-Mar-2014
  • (2011)Employing Privacy-Preserving Techniques to Protect Control-Flow Graphs in a Decentralized, End-to-End Regression Test Selection Framework for Web ServicesProceedings of the 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops10.1109/ICSTW.2011.84(139-148)Online publication date: 21-Mar-2011

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media