skip to main content
10.1145/2489300.2489335acmconferencesArticle/Chapter ViewAbstractPublication PagesisstaConference Proceedingsconference-collections
Article

Runtime testing framework for improving quality in dynamic service-based systems

Published: 15 July 2013 Publication History

Abstract

Service-based systems are operating in dynamic environments characterized by continual changes such as requirement evolution, service crash or service unavailability. In this context, improving the quality of these systems after such evolution is highly demanded. With the aim of checking their behaviors at runtime and detecting faults introduced after dynamic changes, a runtime testing approach is applied. An effective Runtime Testing Framework For Adaptable and Distributed Systems called RTF4ADS is then proposed. This framework is conceived in order to reduce runtime testing side effects as timing and resource usage costs, interference risks while improving its fault finding capabilities. To show the relevance of RTF4ADS prototype, a case study in the healthcare domain implemented in the OSGi platform is given.

References

[1]
S. Alhazbi and A. Jantan. Dependencies management in dynamically updateable component-based systems. Journal of Computer Science, 3(7):499–505, 2007.
[2]
X. Bai, D. Xu, G. Dai, W.-T. Tsai, and Y. Chen. Dynamic reconfigurable testing of service-oriented architecture. volume 1, pages 368 –378, july 2007.
[3]
C. Barreto, V. Bullard, T. Erl, J. Evdemon, D. Jordan, K. Kand, D. Knig, S. Moser, R. Stout, R. Ten-Hove, I. Trickovic, D. van der Rijn, and A. Yiu. Web Services Business Process Execution Language Version 2.0 Primer. OASIS, May 2007.
[4]
A. Bertolino, G. De Angelis, S. Kellomaki, and A. Polini. Enhancing service federation trustworthiness through online testing. Computer, 45(1):66–72, 2012.
[5]
U. Brandes, M. Eiglsperger, I. Herman, M. Himsolt, and M. S. Marshall. Graphml progress report. In Graph Drawing, page 501 ˝ U512, 2001.
[6]
D. Brenner, C. Atkinson, R. Malaka, M. Merdes, B. Paech, and D. Suliman. Reducing verification effort in component-based software engineering through built-in testing. Information Systems Frontiers, 9(2-3):151–162, 2007.
[7]
ETSI. Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 1: TTCN-3 Core Language.
[8]
A. Gonzalez, E. Piel, and H.-G. Gross. Architecture support for runtime integration and verification of component-based systems of systems. In L. M. H. M. A. P. O. S. Mauro Caporuscio, Antinisca Di Marco, editor, Automated Software Engineering - Workshops, 2008. ASE Workshops 2008. 23rd IEEE/ACM International Conference on, pages 41–48. IEEE Computer Society, sep 2008.
[9]
A. Gonzalez, E. Piel, H.-G. Gross, and M. Glandrup. Testing challenges of maritime safety and security systems-of-systems. In Proceedings of the Testing: Academic & Industrial Conference - Practice and Research Techniques, pages 35––39, Washington, DC, USA, 2008. IEEE Computer Society.
[10]
M. Greiler, H.-G. Gross, and A. van Deursen. Evaluation of Online Testing for Services ˝ U A Case Study. In 2nd International Workshop on Principles of Engineering Service-Oriented System, pages 36–42. ACM, 2010.
[11]
T. Gu, H. Pung, and D. Zhang. Toward an osgi-based infrastructure for context-aware applications. Pervasive Computing, IEEE, 3(4):66 – 74, oct.-dec. 2004.
[12]
N. Jussien, G. Rochart, and X. Lorca. Choco: an Open Source Java Constraint Programming Library. In CPAIOR’08 Workshop on Open-Source Software for Integer and Contraint Programming (OSSICP’08), pages 1–10, Paris, France, France, 2008.
[13]
N. Kavantzas, D. Burdett, G. Ritzinger, and Y. Lafon. Web Services Choreography Description Language Version 1.0.
[14]
T. M. King, A. A. Allen, R. Cruz, and P. J. Clarke. Safe runtime validation of behavioral adaptations in autonomic software. In J. M. A. Calero, L. T. Yang, F. G. Mármol, L. J. Garc´ıa-Villalba, X. A. Li, and Y. Wang, editors, ATC, volume 6906 of Lecture Notes in Computer Science, pages 31–46. Springer, 2011.
[15]
J. Kramer and J. Magee. Dynamic configuration for distributed systems. IEEE Trans. Software Eng., 11(4):424–436, 1985.
[16]
M. Lahami, F. Fakhfakh, M. Krichen, and M. Jmaiel. Towards a ttcn-3 test system for runtime testing of adaptable and distributed systems. In Nielsen and Weise {23}, pages 71–86.
[17]
M. Lahami, M. Krichen, M. Bouchakwa, and M. Jmaiel. Using knapsack problem model to design a resource aware test architecture for adaptable and distributed systems. In Nielsen and Weise {23}, pages 103–118.
[18]
M. Lahami, M. Krichen, and M. Jmaiel. A distributed test architecture for adaptable and distributed real-time systems. In the Journal of New technologies of Information (RNTI), CAL’2011, 2012.
[19]
B. Li. Managing dependencies in component-based systems based on matrix model. In Proc. Of Net.Object.Days 2003, pages 22–25, 2003.
[20]
M. Merdes, R. Malaka, D. Suliman, B. Paech, D. Brenner, and C. Atkinson. Ubiquitous RATs: how resource-aware run-time tests can improve ubiquitous software systems. In SEM ’06: Proceedings of the 6th international workshop on Software engineering and middleware, pages 55–62, New York, NY, USA, 2006. ACM.
[21]
C. Murphy, G. Kaiser, I. Vo, and M. Chu. Quality assurance of software applications using the in vivo testing approach. In Proceedings of the 2009 International Conference on Software Testing Verification and Validation, ICST ’09, pages 111–120, Washington, DC, USA, 2009. IEEE Computer Society.
[22]
D. Niebuhr and A. Rausch. Guaranteeing correctness of component bindings in dynamic adaptive systems based on runtime testing. In SIPE 09: Proceedings of the 4th international workshop on Services integration in pervasive environments, pages 7–12, New York, NY, USA, 2009. ACM.
[23]
B. Nielsen and C. Weise, editors. Testing Software and Systems - 24th IFIP WG 6.1 International Conference, ICTSS 2012, Aalborg, Denmark, November 19-21, 2012. Proceedings, volume 7641 of Lecture Notes in Computer Science. Springer, 2012.
[24]
Object Management Group (OMG)/Business Process Management Initiative (BPMI). Business Process Modeling Notation (BPMN) Version 1.2, January 2009.
[25]
Open Services Gateway Initiative. OSGi service gateway specification, Release 4, October 2005.
[26]
É. Piel and A. González-Sanchez. Data-flow integration testing adapted to runtime evolution in component-based systems. In Proceedings of the 2009 ESEC/FSE workshop on Software integration and evolution @ runtime, pages 3–10, New York, USA, 2009. Association for Computing Machinery.
[27]
É. Piel, A. González-Sanchez, and H.-G. Groß. Automating integration testing of large-scale publish/subscribe systems. In A. Hinze and A. P. Buchmann, editors, Principles and Applications of Distributed Event-Based Systems, pages 140–163. IGI Global, 2010.
[28]
D. Suliman, B. Paech, L. Borner, C. Atkinson, D. Brenner, M. Merdes, and R. Malaka. The MORABIT Approach to Runtime Component Testing. In Proceedings of the 30th Annual International Computer Software and Applications Conference - Volume 02, COMPSAC ’06, pages 171–176, Washington, DC, USA, 2006. IEEE Computer Society.
[29]
D. Tkachenko, N. Kornet, E. Andrievsky, A. Lagunov, D. Kravtsov, and A. Kurbanow. Management of ieee 1394 video devices in osgi networks. In Consumer Electronics, 2006. ISCE ’06. 2006 IEEE Tenth International Symposium on, pages 1 –6, 0-0 2006.
[30]
Y. Wang, G. King, D. Patel, S. Patel, and A. Dorling. On coping with real-time software dynamic inconsistency by built-in tests. Ann. Softw. Eng., 7(1-4):283–296, 1999.

Cited By

View all
  • (2024)Towards Life-long Software Self-validation in ProductionProceedings of the 15th Asia-Pacific Symposium on Internetware10.1145/3671016.3671382(357-366)Online publication date: 24-Jul-2024
  • (2021)A Survey of Field-based Testing TechniquesACM Computing Surveys10.1145/344724054:5(1-39)Online publication date: 25-May-2021
  • (2016)Safe and efficient runtime testing framework applied in dynamic and distributed systemsScience of Computer Programming10.1016/j.scico.2016.02.002122:C(1-28)Online publication date: 15-Jun-2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
QASBA 2013: Proceedings of the 2013 International Workshop on Quality Assurance for Service-based Applications
July 2013
28 pages
ISBN:9781450321822
DOI:10.1145/2489300
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 July 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Dynamic adaptations
  2. OSGi-based applications
  3. resource aware tests
  4. runtime testing
  5. test isolation

Qualifiers

  • Article

Conference

ISSTA '13
Sponsor:

Upcoming Conference

ISSTA '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Towards Life-long Software Self-validation in ProductionProceedings of the 15th Asia-Pacific Symposium on Internetware10.1145/3671016.3671382(357-366)Online publication date: 24-Jul-2024
  • (2021)A Survey of Field-based Testing TechniquesACM Computing Surveys10.1145/344724054:5(1-39)Online publication date: 25-May-2021
  • (2016)Safe and efficient runtime testing framework applied in dynamic and distributed systemsScience of Computer Programming10.1016/j.scico.2016.02.002122:C(1-28)Online publication date: 15-Jun-2016
  • (2015)Selective Test Generation Approach for Testing Dynamic Behavioral AdaptationsProceedings of the 27th IFIP WG 6.1 International Conference on Testing Software and Systems - Volume 944710.1007/978-3-319-25945-1_14(224-239)Online publication date: 23-Nov-2015

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media