Abstract
Rigorous Verification and Validation (V& V) techniques are essential for high assurance systems. Lately, the performance of some of these systems is enhanced by embedded adaptive components in order to cope with environmental changes. Although the ability of adapting is appealing, it actually poses a problem in terms of V&V. Since uncertainties induced by environmental changes have a significant impact on system behavior, the applicability of conventional V& V techniques is limited. In safety-critical applications such as flight control system, the mechanisms of change must be observed, diagnosed, accommodated and well understood prior to deployment.
In this paper, we propose a non-conventional V&V approach suitable for online adaptive systems. We apply our approach to an intelligent flight control system that employs a particular type of Neural Networks (NN) as the adaptive learning paradigm. Presented methodology consists of a novelty detection technique and online stability monitoring tools. The novelty detection technique is based on Support Vector Data Description that detects novel (abnormal) data patterns. The Online Stability Monitoring tools based on Lyapunov’s Stability Theory detect unstable learning behavior in neural networks. Cases studies based on a high fidelity simulator of NASA’s Intelligent Flight Control System demonstrate a successful application of the presented V&V methodology.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
The Boeing Company, Intelligent flight control: advanced concept program, Technical report (1999)
Jorgensen, C.C.: Feedback linearized aircraft control using dynamic cell structures, World Automation Congress (ISSCI), Alaska, pp. 050.1–050.6 (1991)
Napolitano, M., Neppach, C.D., Casdorph, V., Naylor, S., Innocenti, M.: A neural network-based scheme for sensor failure detection, identification and accomodation. AIAA Journal of Control and Dynamics 18(6), 1280–1286 (1995)
Institute of Software Reseach. Dynamic cell structure neural network report for the intelligent flight control system, Technical report, Document ID: IFC-DCSRD002- UNCLASS-010401 (January 2001)
Schumann, J., Nelson, S.: Towards V&V of neural network based controllers. In: Workshop on Self-Healing Systems (2002)
Mackall, D., Nelson, S., Schumann, J.: Verification validation of neural networks of aerospace applications, Technical report, CR-211409, NASA (2002)
Boyd, M.A., Schumann, J., Brat, G., Giannakopoulou, D., Cukic, B., Mili, A.: Validation and verification process guide for software and neural nets, Technical report, NASA Ames Research Center (September 2001)
Liu, Y., Yerramalla, S., Fuller, E., Cukic, B., Gururajan, S.: Adaptive Control Software: Can We Guarantee Safety? In: Proc. of the 28th International Computer Software and Applications Conference, workshop on Software Cybernetics, Hong Kong (September 2004)
Yerramalla, S., Fuller, E., Mladenovski, M., Cukic, B.: Lyapunov Analysis of Neural Network Stability in an Adaptive Flight Control System. In: Huang, S.-T., Herman, T. (eds.) SSS 2003, vol. 2704, pp. 77–91. Springer, Heidelberg (2003)
Vapnik, V.N.: Statistical learning theory. Wiley, Chichester (1998)
Tax, D.M.J., Duin, R.P.W.: Outliers and data descriptions. In: Proc. ASCI 2001, 7th Annual Conf. of the Advanced School for Computing and Imaging, Heijen, NL,ASCI, Delft, May 30-June 1, pp. 234–241 (2001)
Tax, D.M.J., Duin, R.P.W.: Support vector domain description. Pattern Recognition Letters 20(11-13), 1191–1199 (1999)
Tax, D.M.J., Duin, R.P.W.: Data domain description using support vectors. In: Proc. European Symposium on Artificial Neural Networks, Bruges, D-Facto, Brussels, April 21-23 (1999), pp. 251–257 (1999)
Tax, D.M.J., Ypma, A., Duin, R.P.W.: Support vector data description applied to machine vibration analysis. In: Proc. 5th Annual Conference of the Advanced School for Computing and Imaging, Heijen, NL, ASCI, Delft, June 15-17, pp. 398–405 (1999)
Kohonen, T.: The self-organizing map. Proc. of the IEEE 78(9), 1464–1480 (1990)
Zubov, V.I.: Methods of A. M. Lyapunov and their applications. U.S. Atomic Energy Commission (1957)
Fritzke, B.: Growing cell structures - a self-organizing network for unsupervised and supervised learning. Neural Networks 7(9), 1441–1460 (1993)
Martinetz, T., Schulten, K.: Topology representing networks. Neural Networks 7(3), 507–522 (1994)
Bruske, J., Sommer, G.: Dynamic cell structure learns perfectly topology preserving map. Neural Computation 7(4), 845–865 (1995)
Rouche, N., Habets, P., Laloy, M.: Stability theory by Liapunov’s direct method. Springer, New York Inc. (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yerramalla, S., Liu, Y., Fuller, E., Cukic, B., Gururajan, S. (2004). An Approach to V&V of Embedded Adaptive Systems. In: Hinchey, M.G., Rash, J.L., Truszkowski, W.F., Rouff, C.A. (eds) Formal Approaches to Agent-Based Systems. FAABS 2004. Lecture Notes in Computer Science(), vol 3228. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30960-4_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-30960-4_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24422-6
Online ISBN: 978-3-540-30960-4
eBook Packages: Computer ScienceComputer Science (R0)