skip to main content
10.1145/1755913.1755925acmconferencesArticle/Chapter ViewAbstractPublication PageseurosysConference Proceedingsconference-collections
research-article

Splitter: a proxy-based approach for post-migration testing of web applications

Published: 13 April 2010 Publication History

Abstract

The benefits of virtualized IT environments, such as compute clouds, have drawn interested enterprises to migrate their applications onto new platforms to gain the advantages of reduced hardware and energy costs, increased flexibility and deployment speed, and reduced management complexity. However, the process of migrating a complex application takes a considerable amount of effort, particularly when performing post-migration testing to verify that the application still functions correctly in the target environment. The traditional approach of test case generation and execution can take weeks and synthetic test cases may not adequately reflect actual application usage.
In this paper, we propose and evaluate a black-box approach for post-migration testing of Web applications without manually creating test cases. A Web proxy is put in front of the production application to intercept all requests from real users, and these requests are simultaneously sent to the production and migrated applications. Results generated by both applications are then compared, and mismatches due to migration problems can be easily detected and presented to testing teams for resolution. We implement this approach in Splitter, a software module that is deployed as a reverse Web proxy. Through our evaluation using a number of real applications, we show that it Splitter can effectively automate post-migration testing while also reduce the number of mismatches that must be manually inspected. Equally important, it imposes a relatively small performance overhead on the production environment.

References

[1]
AlertSite. Dejaclick by AlertSite. http://www.dejaclick.com.
[2]
Michael Benedikt, Juliana Freire, and Patrice Godefroid. VeriWeb: Automatically testing dynamic Web sites. In WWW '02, 2002.
[3]
BMC Software Inc. BMC discovery. http://www.bmc.com/products/offering/bmc-discovery.html.
[4]
Miguel Castro and Barbara Liskov. Practical byzantine fault tolerance. In OSDI '99, pages 173--186, 1999.
[5]
Sudarshan S. Chawathe, Anand Rajaraman, Hector Garcia-Molina, and Jennifer Widom. Change detection in hierarchically structured information. SIGMOD Rec., 25 (2): 493--504, 1996.
[6]
Gregory Cobena, Serge Abiteboul, and Amelie Marian. Detecting changes in XML documents. In ICDE '02, 2002.
[7]
Sebastian Elbaum, Srikanth Karre, and Gregg Rothermel. Improving web application testing with user session data. In ICSE '03, pages 49--59, 2003.
[8]
Indrani Ghatare. Using WebSphere DataStage with ibm DataMirror change data capture. http://www.ibm.com /developerworks/edu/dm-dw-dm-0805ghatare-i.html.
[9]
Hayes 2008 Brian Hayes. Cloud computing. Commun. ACM, 51 (7): 9--11, 2008.
[10]
IBM. Tivoli application dependency discovery manager. http://www-01.ibm.com/software/tivoli/products/taddm/.
[11]
IBM. Tivoli provisioning manager. http://www.ibm.com/software/tivoli/products/prov-mgr/.
[12]
Imad Khoury, Rami M. El-Mawas, Oussama El-Rawas, Elias F. Mounayar, and Hassan Artail. An efficient Web page change detection system based on an optimized hungarian algorithm. IEEE TKDE, 19 (5): 599--613, 2007.
[13]
Erwin Leonardi and Sourav S. Bhowmick. Detecting changes on unordered \mboxXML documents using relational databases: a schema-conscious approach. In CIKM '05, 2005.
[14]
Giuseppe A. Di Lucca, Anna Rita Fasolino, Francesco Faralli, and Ugo de Carlini. Testing Web applications. In ICSM '02, pages 310--319, 2002.
[15]
Morris Marden. An architectural evaluation of java TPC-W. In HPCA '01, page 229, 2001.
[16]
Kiran Nagaraja, Fábio Oliveira, Ricardo Bianchini, Richard P. Martin, and Thu D. Nguyen. Understanding and dealing with operator mistakes in internet services. In OSDI'04, 2004.
[17]
Novell Inc. PlateSpin migrate. http://www.novell.com/products/migrate/.
[18]
D. Ohst, M. Welle, and U. Kelter. Difference tools for analysis and design documents. In ICSM '03, 2003.
[19]
Fábio Oliveira, Kiran Nagaraja, Rekha Bachwani, Ricardo Bianchini, Richard P. Martin, and Thu D. Nguyen. Understanding and validating database system administration. In USENIX'06, 2006.
[20]
Filippo Ricca and Paolo Tonella. Analysis and testing of Web applications. In ICSE '01, pages 25--34, 2001.
[21]
Sreedevi Sampath, Valentin Mihaylov, Amie Souter, and Lori Pollock. Composing a framework to automate testing of operational Web-based software. In ICSM '04, Washington, DC, USA, 2004.
[22]
Squid Developers. Squid proxy cache. http://www.squid-cache.org/.
[23]
Y. Wang, D.J. DeWitt, and J.-Y. Cai. X-Diff: an effective change detection algorithm for XML documents. In ICDE '03, pages 519--530, 2003.
[24]
A. Williams, M. Arlitt, C. Williamson, and K. Barker. Web workload characterization: Ten years later. In Web Content Delivery, pages 3--21. Springer, 2005.
[25]
Lauren Wood, Vidur Apparao, Steve Byrne, Mike Champion, and Scott Isaacs. Document object model (DOM) level 1 specification (second edition), 2000. http://www.w3.org/TR/2000/WD-DOM-Level-1-20000929/.
[26]
Ian T. Young. Proof without prejudice: use of the kolmogorov-smirnov test for the analysis of histograms from flow systems and other sources. The Journal of Histochemistry and Cytochemistry, 25 (7): 935--941, 1977.
[27]
Wei Zheng, Ricardo Bianchini, G. John Janakiraman, J. Renato Santos, and Yoshio Turner. JustRunIt: Experiment-based management of virtualized data centers. In USENIX'09, June 2009.

Cited By

View all
  • (2022) ExVivoMicroTest : ExVivo Testing of Microservices Journal of Software: Evolution and Process10.1002/smr.245235:4Online publication date: 12-Apr-2022
  • (2018)Towards service continuity for transactional applications via diverse device driversInternational Journal of Information and Computer Security10.1504/IJICS.2016.0804288:4(382-400)Online publication date: 16-Dec-2018
  • (2018) P esto : Automated migration of DOM‐based Web tests towards the visual approach Software Testing, Verification and Reliability10.1002/stvr.166528:4Online publication date: 30-Mar-2018
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
EuroSys '10: Proceedings of the 5th European conference on Computer systems
April 2010
388 pages
ISBN:9781605585772
DOI:10.1145/1755913
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 April 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. cloud computing
  2. http
  3. migration
  4. testing
  5. web application

Qualifiers

  • Research-article

Conference

EuroSys '10
Sponsor:
EuroSys '10: Fifth EuroSys Conference 2010
April 13 - 16, 2010
Paris, France

Acceptance Rates

Overall Acceptance Rate 241 of 1,308 submissions, 18%

Upcoming Conference

EuroSys '25
Twentieth European Conference on Computer Systems
March 30 - April 3, 2025
Rotterdam , Netherlands

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)10
  • Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2022) ExVivoMicroTest : ExVivo Testing of Microservices Journal of Software: Evolution and Process10.1002/smr.245235:4Online publication date: 12-Apr-2022
  • (2018)Towards service continuity for transactional applications via diverse device driversInternational Journal of Information and Computer Security10.1504/IJICS.2016.0804288:4(382-400)Online publication date: 16-Dec-2018
  • (2018) P esto : Automated migration of DOM‐based Web tests towards the visual approach Software Testing, Verification and Reliability10.1002/stvr.166528:4Online publication date: 30-Mar-2018
  • (2017)Towards comprehensive protection for OpenFlow controllers2017 19th Asia-Pacific Network Operations and Management Symposium (APNOMS)10.1109/APNOMS.2017.8094183(82-87)Online publication date: Sep-2017
  • (2015)Automated generation of visual web tests from DOM-based web testsProceedings of the 30th Annual ACM Symposium on Applied Computing10.1145/2695664.2695847(775-782)Online publication date: 13-Apr-2015
  • (2012)Letting applications operate through attacks launched from compromised driversProceedings of the 7th ACM Symposium on Information, Computer and Communications Security10.1145/2414456.2414510(91-92)Online publication date: 2-May-2012
  • (2012)A Survey of Software Testing in the CloudProceedings of the 2012 IEEE Sixth International Conference on Software Security and Reliability Companion10.1109/SERE-C.2012.32(18-23)Online publication date: 20-Jun-2012
  • (2011)BLOCKProceedings of the 27th Annual Computer Security Applications Conference10.1145/2076732.2076767(247-256)Online publication date: 5-Dec-2011
  • (2011)Cloud software upgrades: Challenges and opportunities2011 International Workshop on the Maintenance and Evolution of Service-Oriented and Cloud-Based Systems10.1109/MESOCA.2011.6049037(1-10)Online publication date: Sep-2011
  • (2010)StoryboardProceedings of the Sixth international conference on Hot topics in system dependability10.5555/1924908.1924909(1-8)Online publication date: 3-Oct-2010

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media