skip to main content
10.1145/3361242.3361263acmotherconferencesArticle/Chapter ViewAbstractPublication PagesinternetwareConference Proceedingsconference-collections
short-paper

Generating Environmental Models for Testing Self-adaptive Systems

Published: 28 October 2019 Publication History

Abstract

Self-adaptive systems (a.k.a. SASs) are useful but error-prone. This stems from the complexity of the interaction between a self-adaptive system and its running environment. Therefore, a testing approach of self-adaptive system has to consider the system's running environment. However, due to their poor controllability and observability, neither the real environment nor the environmental simulators could support SAS-testing effectively and efficiently. In this paper, we propose a novel approach AutoModel to generate environmental models for testing self-adaptive systems effectively. Our key insight is that a self-adaptive system's execution traces naturally encode the behavior of its running environment, especially for the logic of how the environment interacts with the system. Based on the collected execution traces, our AutoModel approach synthesizes an environmental model and learns the model's reaction logic. The derived environmental model is able to imitate the real environment's behavior in program-environment iteration. Our primitive evaluation on real-world self-adaptive systems validates the effectiveness of our AutoModel approach. The average predictive R-squared value of the generated environmental model's prediction results is 55.0%.

References

[1]
W. Yang, C. Xu, Y. Liu, C. Cao, X. Ma, and J. Lu, "Verifying self-adaptive applications suffering uncertainty," in Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering, ser. ASE'14, 2014, pp. 199--210.
[2]
H. Jiang, S. Elbaum, and C. Detweiler, "Reducing failure rates of robotic systems though inferred invariants monitoring," in Proceedings of the 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, ser. IROS'13, 2013, pp. 1899--1906.
[3]
https://www.ald.softbankrobotics.com/en/cool-robots/nao.
[4]
M. Sama, S. Elbaum, F. Raimondi, D. S. Rosenblum, and Z. Wang, "Context-aware adaptive applications: Fault patterns and their automated identification," in IEEE Transactions on Software Engineering, vol. 36, no. 5, pp. 644C661, Sep. 2010.
[5]
C. Xu, S. C. Cheung, X. Ma, C. Cao, and J. Lu, "Adam: Identifying defects in context-aware adaptation," in Jounral of Systems and Software, vol. 85, no. 12, pp. 2812C2828, 2012.
[6]
https://www.tesla.com/.
[7]
https://waymo.com/.
[8]
California Department of Motor Vechiles, "Autonomous Vehicle Disengagement Reports 2016,".
[9]
Y. Qin, C. Xu, P. Yu and J. Lu, "SIT: Sampling-based interactive testing for self-adaptive apps," in Journal of Systems and Software, vol. 120, 2016, pp. 70--99.
[10]
Z. He, Y. Chen, E. Huang, Q. Wang, Y. Pei and H. Yuan, "A system identification based rracle for control-CPS software fault localization," in Proceedings of the 41st International Conference on Software Engineering, ser. ICSE'19, 2019.
[11]
Y. Qin, T. Xie, C. Xu, A. Astoga and J. Lu, "CoMID: context-based multi-invariant detection for monitoring cyber-physical software," in IEEE Transactions on Reliability, to be published, 2019.
[12]
A. J. Ramirez, A. C. Jensen, B. H. C. Cheng, and D. B. Knoester, "Automatically exploring how uncertainty impacts behavior of dynamically adaptive systems," in Proceedings of the 26th IEEE/ACM International Conference on Automated Software Engineering, ser. ASE'11, 2011, pp. 568--571.
[13]
Ester M, Kriegel H P, Sander J, et al, "Density-based spatial clustering of applications with noise," in Proceedings of International Conference on Knowledge Discovery and Data Mining, 1996, pp. 240--246.

Cited By

View all
  • (2022)Challenges of testing self-adaptive systemsProceedings of the 26th ACM International Systems and Software Product Line Conference - Volume B10.1145/3503229.3547048(224-228)Online publication date: 12-Sep-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
Internetware '19: Proceedings of the 11th Asia-Pacific Symposium on Internetware
October 2019
179 pages
ISBN:9781450377010
DOI:10.1145/3361242
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 October 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. environmental model
  2. program-environment interaction
  3. self-adaptive systems
  4. software testing

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Funding Sources

Conference

Internetware '19

Acceptance Rates

Internetware '19 Paper Acceptance Rate 20 of 35 submissions, 57%;
Overall Acceptance Rate 55 of 111 submissions, 50%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)1
Reflects downloads up to 27 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Challenges of testing self-adaptive systemsProceedings of the 26th ACM International Systems and Software Product Line Conference - Volume B10.1145/3503229.3547048(224-228)Online publication date: 12-Sep-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media