Skip to main content
Springer Nature Link
Log in

Application of Neural Networks in High Assurance Systems: A Survey

  • Chapter
Applications of Neural Networks in High Assurance Systems

Part of the book series: Studies in Computational Intelligence ((SCI,volume 268))

  • 1361 Accesses

Abstract

Artificial Neural Networks (ANNs) are employed in many areas of industry such as pattern recognition, robotics, controls, medicine, and defence. Their learning and generalization capabilities make them highly desirable solutions for complex problems. However, they are commonly perceived as black boxes since their behavior is typically scattered around its elements with little meaning to an observer. The primary concern in safety critical systems development and assurance is the identification and management of hazards. The application of neural networks in systems where their failure can result in loss of life or property must be backed up with techniques to minimize these undesirable effects. Furthermore, to meet the requirements of many statutory bodies such as FAA, such a system must be certified. There is a growing concern in validation of such learning paradigms as continual changes induce uncertainty that limits the applicability of conventional validation techniques to assure a reliable system performance. In this paper, we survey the application of neural networks in high assurance systems that have emerged in various fields, which include flight control, chemical engineering, power plants, automotive control, medical systems, and other systems that require autonomy. More importantly, we provide an overview of assurance issues and challenges with the neural network model based control scheme. Methods and approaches that have been proposed to validate the performance of the neural networks are outlined and discussed after a comparative examination.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. American Power Conference. Proceesings of the American Power Conference 1998, vol. 60, 2 vol. set (1998)

    Google Scholar 

  2. American National Standards. Software Engineering Standards. IEEE, Wiley and Sons (1984)

    Google Scholar 

  3. Astrom, K.J., Wittenmark, B.: Adaptive Control. Addison-Wesley, Reading (1994)

    Google Scholar 

  4. Bansal, R.C.: Overview and literature survey of artificial neural networks applications to power systems (1992–2004). Journal - Institution of Engineers India. Electrical Engineering Division (86), 282–296 (2006)

    Google Scholar 

  5. The Boeing Company. Intelligent Flight Control: Advanced Concept Program. Technical Report (1999)

    Google Scholar 

  6. Boyd, M.A., Schumann, J., Brat, G., Giannakopoulou, D., Cukic, B., Mili, A.: Validation and verification process guide for software and neural nets. Technical report, NASA Ames Research Center (2001)

    Google Scholar 

  7. Calise, A., Rysdyk, R.: Nonlinear adaptive flight control using neural networks. IEEE Control Systems Magazine 21(6), 14–26 (1998)

    Article  Google Scholar 

  8. DO-178B: Software Considerations in Airborne Systems and Equipment Certification (1992), http://www.rtca.org

  9. DTI. DTI final report: Evaluation of parallel processing and neural computing application programmes. Assessment Paper 38 URN 99/922 (1999)

    Google Scholar 

  10. Ebert, C., Parro, C.H., Suttels, R., Kolarczyk, H.: Improving Validation Activities in a Global Software Development. In: Proc. ICSE 2001, p. 545. IEEE, Los Alamitos (2001)

    Google Scholar 

  11. Fu, L.: Neural Networks in Computer Intelligence. McGraw Hill, New York (1994)

    Google Scholar 

  12. Getman, A., Zhou, H., Jammalamadaka, S.: An automated network for detecting diesel engine misfire. In: Proc. IJCNN 2007, pp. 3017–3021. IEEE, Los Alamitos (2007)

    Google Scholar 

  13. Ghosh, D., Sharman, R., Rao, R.H., Upadhyaya, S.: Self-healing systems — survey and synthesis. Decision Support Systems 42(4), 2164–2185 (2007)

    Article  Google Scholar 

  14. Grossberg, S.: Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors. Biological Cybernetics 23, 121–134 (1976); Reprinted in Anderson and Rosenfeld (1988)

    Google Scholar 

  15. Grossberg, S.: Competitive learning: From interactive activation to adaptive resonance. Cognitive Science 11(1), 23–63 (1987)

    Article  MathSciNet  Google Scholar 

  16. Gupta, P., Guenther, K., Hodgkinson, J., Jacklin, S., Richard, M., Schumann, J., Soares, F.: Performance Monitoring and Assessment of Neuro-Adaptive Controllers for Aerospace Applications Using a Bayesian Approach. In: Guidance, Navigation and Control (GNC) Conference, AIAA 2005-6451 (2005)

    Google Scholar 

  17. Gusikhin, O., Rychtyckyj, N., Filev, D.: Intelligent systems in the automotive industry: Applications and trends. Knowl. Inf. Syst. 12(2), 147–168 (2007)

    Article  Google Scholar 

  18. Tarafdar Haque, M., Kashtiban, A.M.: Application of neural networks in power systems: A Review. Transaction on Engineering, Computing and Technology (6), 53–56 (2005)

    Google Scholar 

  19. Hornik, K.M., Stinchcombe, M., White, H.: Multilayer Feedforward Networks are Universal Approximators. Neural Networks 2, 359–366 (1989)

    Article  Google Scholar 

  20. Hrycej, T.: Neural-network-based car drive train control. In: Proc. 42nd IEEE Vehicular Technology Conference, vol. 2, pp. 1042–1045 (1992)

    Google Scholar 

  21. Hunt, K.J., Sbabaro, D., Zbikowski, R., Gawthrop, P.J.: Neural Networks for Control Systems—A Survey. Automatica 28(6), 1707–1712 (1996)

    Google Scholar 

  22. Hutchison, W.R., Stephens, K.R.: The airline marketing tactician (AMT): A commercial application of adaptive networking. In: Proc. First IEEE International Conference on Neural Networks, vol. 2, pp. 753–756. IEEE, Los Alamitos (1987)

    Google Scholar 

  23. Irwin, D.: The industrial Electronics Handbook. Technology & Engineering (1997)

    Google Scholar 

  24. Jorgensen, C.: Feedback linearized aircraft control using dynamic cell structures. In: World Automation Congress (ISSCI), Alaska, pp. 050.1-050.6 (1991)

    Google Scholar 

  25. Knaus, W.A., Draper, E.A., Wagner, D.P., Zimmerman, J.E.: Apache II: a Severity of Disease Classification System. Critical Care Medicine 13, 813–829 (1985)

    Article  Google Scholar 

  26. Lawrence, S., Tsoi, A.C., Back, A.D.: Function approximation with neural networks and local methods: Bias, variance and smoothness. In: Australian Conference on Neural Networks, pp. 16–21 (1996)

    Google Scholar 

  27. Leonard, J.A., Kramer, M.A., Ungar, L.H.: Using radial basis functions to approximate a function and its error bounds. IEEE Transactions on Neural Networks 3(4), 624–627 (1992)

    Article  Google Scholar 

  28. Lisboa, P. (ed.): Current Applications of Neural Networks. Chapman and Hall, Boca Raton (1992)

    Google Scholar 

  29. Lisboa, P., Vellido, A., Edisbury, B. (eds.): Neural Network Applications in Business. World Scientific, Singapore (2000)

    Google Scholar 

  30. Lisboa, P., Ifeachfor, E., Szczepaniak, P. (eds.): Artifical Neural Networks in Biomedicine. Springer, Heidelberg (2000)

    Google Scholar 

  31. Lisboa, P.: Industrial use of safety-related artificial neural networks. Contract Research Report 327/2001, Liverpool John Moores University, Liverpool (2001)

    Google Scholar 

  32. Liu, Y., Yerramalla, S., Fuller, E., Cukic, B., Gururajan, S.: Adaptive Control Software: Can we guarantee safety? In: Proc. of the 28th International Computer Software and Applications Conference; Workshop on Software Cybernetics (2004)

    Google Scholar 

  33. Liu, Y., Cukic, B., Jiang, M., Xu, Z.: Predicting with Confidence—An Improved Dynamic Cell Structure. In: Advances in Neural Computation, vol. 1, pp. 750–759. Springer, Heidelberg (2005)

    Google Scholar 

  34. Liu, Y.: Validating A Neural Network-based Online Adaptive System. PhD thesis, West Virginia University, Morgantown (2005)

    Google Scholar 

  35. Marshall, L.F., Tool, B.M., Bowers, S.A.: The National Traumatic Coma Data Bank Part 2: Patients who talk and deteriorate: Implications for treatment. Journal of Neurosurgery 59(2) (1983)

    Google Scholar 

  36. Mathur, A., et al.: Turbine Back Pressure Identification and Optimization with Learning Neural Networks. Advances in Instrumentation and Control (45): 1, 229–236 (1990)

    Google Scholar 

  37. Ramírez Mendoza, R.A., Morales-Menéndez, R., Cantú-Ortiz, F.J.: Neural nets modelling for automotive welding process. In: Hamza, M.H. (ed.) Modelling and Simulation. Acta Press (2005)

    Google Scholar 

  38. Neumann, P.G.: Computer Related Risks. ACM Press, New York (1995)

    Google Scholar 

  39. Ng, A., Jin Kim, H.: Stable adaptive control with online learning. In: Proceedings of NIPS, vol. 17 (2005)

    Google Scholar 

  40. Norgaard, M., Ravn, O., Poulsen, N.K., Hansen, L.K.: Neural Networks for Modeling and Control of Dynamic Systems. Springer, Heidelberg (2002)

    Google Scholar 

  41. Peterson, G.E.: A foundation for neural network verification and validation. In: SPIE Science of Artificial Neural Networks II, vol. 1966, pp. 196–207 (1993)

    Google Scholar 

  42. Pressman, R.: Software Engineering: A Practitioner’s Approach. McGraw-Hill, New York (1999)

    Google Scholar 

  43. Prokhorov, D.: Toyota Prius HEV Neurocontrol and Diagnostics. Neural Networks 21(2-3), 458–465 (2008)

    Article  Google Scholar 

  44. Pullum, L., Taylor, B., Darrah, M.: Guidance for the Verification and Validation of Neural Networks. Emerging Technologies. Wiley-IEEE Computer Society Press (2007)

    Google Scholar 

  45. Ruha, P., Peura, P., Oyj, R., Jansen, M.: Using Neural Networks in Steel Strip Rolling. In: Steels and Materials for Power Plants, pp. 51–56. Wiley, Chichester (2006)

    Google Scholar 

  46. Rushby, J.: Runtime Certification. In: Leucker, M. (ed.) RV 2008. LNCS, vol. 5289, pp. 21–35. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  47. Rysdyk, R., Calise, A.: Fault tolerant flight control via adaptive neural network augmentation. AIAA American Institute of Aeronautics and Astronautics, AIAA-98-4483, pp. 1722–1728 (1998)

    Google Scholar 

  48. Smith, S.D.G., Escobedo, R., Anderson, M., Caudell, T.P.: A deployed engineering design retrieval system using neural networks. IEEE Trans. on Neural Networks 8(4), 847–851 (1997)

    Article  Google Scholar 

  49. Santoso, N., Petsche, T.: A Method for Blade Temperatrue Estimation in a Steam Turbine. European Patent, No EP0944866 (2001)

    Google Scholar 

  50. Sastry, A., Bodson, M.: Adaptive Control: Stability, Convergence and Robustness. Prentice Hall, Englewood Cliffs (1994), http://www.ece.utah.edu/~bodson/acscr

    Google Scholar 

  51. Schumann, J., Gupta, P.: Monitoring the performance of a neuro-adaptive controller. In: Proc. of the 24th Intl. Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (2004)

    Google Scholar 

  52. Schumann, J., Liu, Y.: Performance Estimation of a Neural Network-based Controller. In: Wang, J., Yi, Z., Żurada, J.M., Lu, B.-L., Yin, H. (eds.) ISNN 2006. LNCS, vol. 3972, pp. 981–990. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  53. Schumann, J., Liu, Y.: Tools and Methods for the Verification and Validation of Adaptive Aircraft Control Systems. In: IEEE Aerospace Conference. IEEE Press, Los Alamitos (2007)

    Google Scholar 

  54. Tarassenko, L.: LogiCook and QUESTAR: two case studies in successful technology transfer. IEE Digest 1997(14) (1997)

    Google Scholar 

  55. Tibshirani, R.: Bias, Variance and Prediction Error for Classification Rule. Technical Report, Statistics Department, University of Toronto (1996)

    Google Scholar 

  56. Yerramalla, S., Cukic, B., Fuller, E.: Lyapunov Stability Analysis of Quantization Error for DCS Neural Networks. In: Proc. Intl. Joint Conference on Neural Networks, IJCNN 2003 (2003)

    Google Scholar 

  57. Yerramalla, S., Fuller, E., Cukic, B.: Lyapunov Analysis of neural network stability in an adaptive flight control system. In: Huang, S.-T., Herman, T. (eds.) SSS 2003. LNCS, vol. 2704, pp. 77–91. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

Download references

Authors
  1. Johann Schumann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pramod Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. RIACS/USRA, NASA Ames Research Center, M/S 269-3, 94035, Moffett Field, CA, USA

    Johann Schumann

  2. Motorola Autonomic Networking Labs, 1301 East Algonquin Road, 60193, Schaumburg, IL, USA

    Yan Liu

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Schumann, J., Gupta, P., Liu, Y. (2010). Application of Neural Networks in High Assurance Systems: A Survey. In: Schumann, J., Liu, Y. (eds) Applications of Neural Networks in High Assurance Systems. Studies in Computational Intelligence, vol 268. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10690-3_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-10690-3_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-10689-7

  • Online ISBN: 978-3-642-10690-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics