skip to main content
10.1145/1390832.1390833acmconferencesArticle/Chapter ViewAbstractPublication PagesisstaConference Proceedingsconference-collections
research-article

Hybrid test of web applications with webtest

Published: 21 July 2008 Publication History

Abstract

In this paper, we present hybrid testing, a method that combines replay-testing (static testing) with automata learning techniques that generate models of black box systems (dynamic testing). This combination helps bridging the gap towards model based testing also for legacy systems. Webtest is an implementation of hybrid testing that builds on top of preexisting technology such as the LearnLib, a framework for automata learning, and the jABC, a framework for model-driven and service-oriented design, that we use here for modelling, executing, and managing test suites for and models of the web applications under analysis. In particular we intend to move towards Rich Internet Applications (RIAs), that include e.g. advanced client side capabilities and access to heavy resources (e.g. database access) over the Web.

References

[1]
Berg, T., Grinchtein, O., Jonsson, B., Leucker, M., Raffelt, H., Steffen, B.: On the correspondence between conformance testing and regular inference. Proc. FASE '05. LNCS 3442, Springer, pp. 175--189.
[2]
Dibernardo, M., Pottinger, R., Wilkinson, M.: Semi-automatic web service composition for the life sciences using the BioMoby semantic web framework. J Biomed Inform. 2008 Mar 4
[3]
Hörmann, M., Margaria, T., Mender, T., Nagel, R., Schuster, M., Steffen, B., Trinh, H.: The jABC approach to collaborative development of embedded applications. In: CCE '06, Int. Workshop on Challenges in Collaborative Engineering - State of the Art and Future Challenges on Collaborative Design. (April 2006) (Industry Day), Prag (CZ).
[4]
Kulvir Singh Bhoga: HttpUnit: A Civilized Way to Test Web Applications in WebSphere Studio. 2003 - http://www.ibm.com/developerworks/websphere/ library/techarticles/0303_bhogal/bhogal.html.
[5]
Hungar, H., Margaria, T., Steffen, B.: Test-based model generation for legacy systems. Proc. of 2003 International Test Conference (ITC 2003), Charlotte, NC, IEEE CS, pp. 971--980.
[6]
Jörges, S., Kubczak, C., Nagel, R., Margaria, T., Steffen, B.: Model-driven development with the jabc. Proc. of Haifa Verification Conference 2006, (HVC 2006). LNCS 4383, pp. 92--108, Springer
[7]
Karusseit, M., Margaria, T.: Feature-based modelling of a complex, online-reconfigurable decision support service. Electr. Notes Theor. Comput. Sci. Vol. 157(2) (2006) pp. 101--118
[8]
D. Lo, S. Maoz, S.-C. Khoo: Mining modal scenario-based specifications from execution traces of reactive systems. Proc. ASE 2007: 465--468.
[9]
Mantis bug tracker. http://www.mantisbt.org (seen Jun. 2007)
[10]
Margaria, T., Raffelt, H., Steffen, B.: Knowledge-based relevance filtering for efficient system-level test-based model generation. Innovations in Systems and Software Engineering 1(2) (September 2005) 147--156
[11]
Margaria, T., Steffen, B., Reitenspieß, M.: Service-oriented design: The Roots. Proc. ICSOC 2005, LNCS 3826, pp. 450--464, Springer Verlag.
[12]
Mariani, L., Pezze, M.: Behaviour capture and test for controlling the quality of component-based integrated systems. Proc. ESEC/FSE Worksh. on Tool Integration in System Development, Helsinki, 2003.
[13]
Mercury TestDirector. http://www.fronde.com/products_mercury.htm (seen April 2008)
[14]
Raffelt, H., Steffen, B., Berg, T.: Learnlib: A library for automata learning and experimentation. Proc. FMICS '05, Lisbon (P) ACM Press (2005) pp. 62--71.
[15]
Raffelt, H., Steffen, B., Margaria, T.: Dynamic Testing Via Automata Learning. Proc. Haifa Verification Conference 2007, LNCS 4899, pp. 136--152
[16]
Raffelt, H., Steffen, B., Berg, T., Margaria, T.: LearnLib: A library for automata learning and experimentation. Appears in STTT, Int. Journ. on Software Tools Technology Transfer.
[17]
Rational Unified Process. http://www-306.ibm.com/software/awdtools/rup/ (seen Jun. 2007)
[18]
Steffen, B., Narayan, P.: Full Life-Cycle Support for End-to-End Processes. Computer (2007), IEEE Computer Society Press, Los Alamitos, CA, USA
[19]
Testing Technologies: TTworkbench Basic http://testingtech.de/products/ttwb_basic.php
[20]
E. Torlak, D. Jackson. Kodkod: A Relational Model Finder, Proc. TACAS 2007.
[21]
S. Troschütz: Web Service Test Framework with TTCN-3, MSc. Thesis, Univ. Göttingen, June 2007, http://www.swe.informatik.uni-goettingen.de/publications/ST/WebServiceTestFrameworkWithTTCN-3.pdf
[22]
A. Vardhan, K. Sen, M. Viswanathan, G. Agha. Actively learning to verify safety for FIFO automata. Proc. FSTTCS '04, Chennai, India, LNCS 3328, pp. 494--505, 2004.
[23]
Watij User Guide http://watij.com/wiki:user_guide.
[24]
Willcock, C., T. Deiß, S. Tobies, S. Keil, F. Engler, S. Schulz: An Introduction to TTCN-3, First Edition, John Wiley & Sons Ltd, 2005.

Cited By

View all
  • (2024)DBInputs: Exploiting Persistent Data to Improve Automated GUI TestingIEEE Transactions on Software Engineering10.1109/TSE.2024.343900250:9(2412-2436)Online publication date: Sep-2024
  • (2024)Guess the State: Exploiting Determinism to Improve GUI Exploration EfficiencyIEEE Transactions on Software Engineering10.1109/TSE.2024.336658650:4(836-853)Online publication date: Apr-2024
  • (2022)A Passive Online Technique for Learning Hybrid Automata from Input/Output TracesACM Transactions on Embedded Computing Systems10.1145/355654322:1(1-24)Online publication date: 29-Oct-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
TAV-WEB '08: Proceedings of the 2008 workshop on Testing, analysis, and verification of web services and applications
July 2008
49 pages
ISBN:9781605580531
DOI:10.1145/1390832
  • Editors:
  • Tevfik Bultan,
  • Tao Xie
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. automata learning
  2. testing
  3. web applications

Qualifiers

  • Research-article

Conference

ISSTA '08
Sponsor:

Upcoming Conference

ISSTA '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)2
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)DBInputs: Exploiting Persistent Data to Improve Automated GUI TestingIEEE Transactions on Software Engineering10.1109/TSE.2024.343900250:9(2412-2436)Online publication date: Sep-2024
  • (2024)Guess the State: Exploiting Determinism to Improve GUI Exploration EfficiencyIEEE Transactions on Software Engineering10.1109/TSE.2024.336658650:4(836-853)Online publication date: Apr-2024
  • (2022)A Passive Online Technique for Learning Hybrid Automata from Input/Output TracesACM Transactions on Embedded Computing Systems10.1145/355654322:1(1-24)Online publication date: 29-Oct-2022
  • (2020)Plug the database & play with automatic testingProceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering10.1145/3324884.3416561(66-77)Online publication date: 21-Dec-2020
  • (2019)The Digital Thread in Industry 4.0Integrated Formal Methods10.1007/978-3-030-34968-4_1(3-24)Online publication date: 22-Nov-2019
  • (2018)Active Automata Learning in PracticeMachine Learning for Dynamic Software Analysis: Potentials and Limits10.1007/978-3-319-96562-8_5(123-148)Online publication date: 20-Jul-2018
  • (2018)Model Learning and Model-Based TestingMachine Learning for Dynamic Software Analysis: Potentials and Limits10.1007/978-3-319-96562-8_3(74-100)Online publication date: 20-Jul-2018
  • (2014)Back-To-Back Testing of Model-Based Code GeneratorsPart I of the Proceedings of the 6th International Symposium on Leveraging Applications of Formal Methods, Verification and Validation. Technologies for Mastering Change - Volume 880210.1007/978-3-662-45234-9_30(425-444)Online publication date: 8-Oct-2014
  • (2012)Automata Learning with On-the-Fly Direct Hypothesis ConstructionLeveraging Applications of Formal Methods, Verification, and Validation10.1007/978-3-642-34781-8_19(248-260)Online publication date: 2012
  • (2012)Automated inference of models for black box systems based on interface descriptionsProceedings of the 5th international conference on Leveraging Applications of Formal Methods, Verification and Validation: technologies for mastering change - Volume Part I10.1007/978-3-642-34026-0_7(79-96)Online publication date: 15-Oct-2012
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media