research-article

A framework for the analysis of adaptive systems using bayesian statistics

Authors:

Johann SchumannAuthors Info & Claims

SEAMS '20: Proceedings of the IEEE/ACM 15th International Symposium on Software Engineering for Adaptive and Self-Managing Systems

Pages 64 - 70

https://doi.org/10.1145/3387939.3391596

Published: 18 September 2020 Publication History

Abstract

Safety-critical adaptive software systems, as, for example, used in aircraft must ensure that system must remain in safe regions during adaptation in order to avoid catastrophic failures. We present a framework, which uses hierarchical statistical models and is based upon techniques from computer experiment design and active learning to characterize the boundaries between safe and unsafe regions with a minimal number of test cases. The boundaries are then represented as parametric geometric shapes that can provide easy to understand feedback to the system designer. We illustrate our framework using the NASA adaptive flight control system IFCS.

References

[1]

John Bosworth and Peggy Williams-Hayes. 2007. Flight Test Results from the NF-15B Intelligent Flight Control System (IFCS) Project with Adaptation to a Simulated Stabilator Failure. Technical Report NASA/TM-2007-214629. NASA.

[2]

A Calise and R Rysdyk. 1998. Nonlinear Adaptive Flight Control Using Neural Networks. IEEE Control Systems 21, 6 (1998), 14--26.

[3]

D. A. Cohn. 1996. Neural Network Exploration using Optimal Experimental Design. Advances in Neural Information Processing Systems 6, 9 (1996), 679--686.

[4]

R. Gramacy and N. Polson. 2011. Particle learning of Gaussian process models for sequential design and optimization. Journal of Computational and Graphical Statistics 20, 1 (2011), 467--478.

[5]

Robert B. Gramacy and Herbert K. H. Lee. 2007. Bayesian treed Gaussian process models with an application to computer modeling. arXiv:stat.ME/0710.4536

[6]

Warren He, Bo Li, and Dawn Song. 2018. Decision boundary analysis of adversarial examples. 6th International Conference on Learning Representations, ICLR 2018.

[7]

Yuning He. 2012. Variable-length Functional Output Prediction and Boundary Detection for an Adaptive Flight Control Simulator. Ph.D. Dissertation. University of California at Santa Cruz.

[8]

Yuning He. 2015. Online detection and modeling of safety boundaries for aerospace applications using active learning and Bayesian statistics. In 2015 International Joint Conference on Neural Networks, IJCNN 2015, Killarney, Ireland, July 12--17, 2015. IEEE, 1--8.

[9]

D. Jones, M. Schonlau, and W.J. Welch. 1998. Efficient Global Optimization of Expensive Black Box Functions. Journal of Global Optimization 13 (1998), 455--492.

Digital Library

[10]

Eugene Lavretsky and Kevin Wise. 2013. Robust and Adaptive Control with Aerospace Applications. Springer.

[11]

D. J. C. MacKay. 1992. Information-based Objective Functions for Active Data Selection. Neural Computation 4, 4 (1992), 589--603.

Digital Library

[12]

Pritam Ranjan, Derek Bingham, and George Michailidis. 2008. Sequential Experiment Design for Contour Estimation from Complex Computer Codes. Technometrics 50, 4 (2008), 527--541.

[13]

R Rysdyk and A Calise. 1999. Fault Tolerant Flight Control via Adaptive Neural Network Augmentation. AIAA-98-4483 (1999), 1722--1728.

[14]

Matthew A. Taddy, Robert B. Gramacy, and Nicholas G. Polson. 2011. Dynamic Trees for Learning and Design. J. Amer. Statist. Assoc. 106, 493 (2011), 109--123. http://EconPapers.repec.org/RePEc:bes:jnlasa:v:106:i:493:y:2011:p:109--123

[15]

Mike Wall. 2013. Robot Submarine on Jupiter Moon Europa is 'Holy Grail' Mission for Planetary Science. Space.com (2013). https://www.space.com/14997-jupiter-europa-ocean-submarine-robot.html

[16]

H. Wickham. 2008. Practical Tools for exploring data and models. Ph.D. Dissertation. Iowa State.

Cited By

Bonfanti SRiccobene EScandurra P(2023)A component framework for the runtime enforcement of safety propertiesJournal of Systems and Software10.1016/j.jss.2022.111605198:COnline publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1016/j.jss.2022.111605
Bonfanti SRiccobene EScandurra P(2021)A Runtime Safety Enforcement Approach by Monitoring and AdaptationSoftware Architecture10.1007/978-3-030-86044-8_2(20-36)Online publication date: 26-Aug-2021
https://doi.org/10.1007/978-3-030-86044-8_2

Index Terms

A framework for the analysis of adaptive systems using bayesian statistics

Index terms have been assigned to the content through auto-classification.

Recommendations

Using dynamic adaptive systems in safety-critical domains
SEAMS '16: Proceedings of the 11th International Symposium on Software Engineering for Adaptive and Self-Managing Systems

The development of safety-critical Cyber-Physical Systems (CPS) is expanding due to the Internet of Things' promise to make high-integrity applications and services part of everyday life. This expansion is seen in the dependencies some connected ...
Integrated Design Framework for Facilitating Systems-Theoretic Process Analysis
Computer Security. ESORICS 2021 International Workshops
Abstract
Systems-Theoretic Process Analysis (STPA) helps mitigate identified safety hazards leading to unfortunate situations. Usually, a systematic step-by-step approach is followed by safety experts irrespective of any software based tool-support, but ...
A Safety Engineering Framework for Open Adaptive Systems
SASO '11: Proceedings of the 2011 IEEE Fifth International Conference on Self-Adaptive and Self-Organizing Systems

In recent years it has become more and more evident that openness and adaptivity are key characteristics of next generation distributed systems. The reason for that is not least the advent of computing trends like Ubiquitous Computing, Ambient ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SEAMS '20: Proceedings of the IEEE/ACM 15th International Symposium on Software Engineering for Adaptive and Self-Managing Systems

June 2020

211 pages

ISBN:9781450379625

DOI:10.1145/3387939

General Chair:
Shinichi Honiden
Waseda University/National Institute of Informatics, Japan
,
Program Chairs:
Elisabetta Di Nitto
Politecnico di Milano, Italy
,
Radu Calinescu
University of York, UK

Copyright © 2020 ACM.

© 2020 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the United States Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

In-Cooperation

IEEE CS

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SEAMS '20

Sponsor:

SIGSOFT

SEAMS '20: IEEE/ACM 15th International Symposium on Software Engineering for Adaptive and Self-Managing Systems

June 29 - July 3, 2020

Seoul, Republic of Korea

Acceptance Rates

Overall Acceptance Rate 17 of 31 submissions, 55%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
93
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bonfanti SRiccobene EScandurra P(2023)A component framework for the runtime enforcement of safety propertiesJournal of Systems and Software10.1016/j.jss.2022.111605198:COnline publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1016/j.jss.2022.111605
Bonfanti SRiccobene EScandurra P(2021)A Runtime Safety Enforcement Approach by Monitoring and AdaptationSoftware Architecture10.1007/978-3-030-86044-8_2(20-36)Online publication date: 26-Aug-2021
https://doi.org/10.1007/978-3-030-86044-8_2

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten