Abstract
A neural network based optimal control synthesis is presented for solving optimal control problems with control and state constraints. The optimal control problem is transcribed into nonlinear programming problem which is implemented with adaptive critic neural network. The proposed simulation methods is illustrated by the optimal control problem of feeding adaptation of filter feeders of Daphnia. Results show that adaptive critic based systematic approach holds promise for obtaining the optimal control with control and state constraints.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Buskens, C., Maurer, H.: SQP-Methods for Solving Optimal Control Problems with Control and State Constraints: Adjoint Variable, Sensitivity Analysis and Real-Time Control. J. Comp. Appl. Math. 120, 85–108 (2000)
Dierks, T., Thumati, B., Jagannathan, S.: Optimal Control of Unknown Affine Nonlinear Discrete-Time Systems Using Offline-Trained Neural Networks with Proof of Convergence. Neural Netw. 22, 851–860 (2009)
Dierks, T., Jagannathan, S.: Optimal Control of Affine Nonlinear Continuous-Time Systems Using an Online Hamilton-Jacobi-Isaacs Formulation. In: Proceedings of the IEEE Conference on Decision and Control, pp. 3048–3053. IEEE Press, New York (2010)
Hornik, M., Stichcombe, M., White, H.: Multilayer Feed Forward Networks are Universal Approximators. Neural Netw. 3, 256–366 (1989)
Kirk, D.E.: Optimal Control Theory: An Introduction. Dover Publications, New York (1989)
Kmet, T.: Neural Network Simulation of Nitrogen Transformation Cycle. In: 23th European Conference on Modelling and Simulation, pp. 352–358. ECMS, Madrid (2009)
Kmet, T., Straskraba, M.: Feeding Adaptation of Filter Feeders: Daphnia. Ecol. Modell. 178, 313–327 (2004)
Padhi, R., Unnikrishnan, N., Wang, X., Balakrishnan, S.N.: Adaptive-Critic Based Optimal Control Synthesis for Distributed Parameter Systems. Automatica 37, 1223–1234 (2001)
Padhi, R., Balakrishnan, S.N., Randoltph, T.: A Single Network Adaptive Critic (SNAC) Architecture for Optimal Control Synthesis for a Class of Nonlinear Systems. Neural Netw. 19, 1648–1660 (2006)
Polak, E.: Optimization Algorithms and Consistent Approximation. Springer, Heidelberg (1997)
Pontryagin, L.S., Boltyanskii, V.G., Gamkrelidze, R.V., Mischenko, E.F.: The Mathematical Theory of Optimal Process. Nauka, Moscow (1983)
Rumelhart, D.F., Hinton, G.E., Wiliams, R.J.: Learning Internal Representation by Error Propagation. In: Parallel Distributed Processing: Foundation, pp. 318–362. The MIT Press, Cambrige (1987)
Straškraba, M., Gnauck, P.: Freshwater Ecosystems, Modelling and Simulation, Developments in Environmental Modelling. Elsevier, Amsterdam (1985)
Smith, H.L., Waltman, P.: The Theory of the Chemostat. Cambride Univ. Press, Cambrige (1995)
Werbos, P.J.: Approximate Dynamic Programming for Real-Time Control and Neural Modeling. In: Handbook of Inteligent Control, pp. 493–525. Multiscience Press, New York (1992)
Xia, Y., Feng, G.: A New Neural Network for Solving Nonlinear Projection Equations. Neural Netw. 20, 577–589 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kmet, T. (2011). Neural Network Solution of Optimal Control Problem with Control and State Constraints. In: Honkela, T., Duch, W., Girolami, M., Kaski, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2011. ICANN 2011. Lecture Notes in Computer Science, vol 6792. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21738-8_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-21738-8_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21737-1
Online ISBN: 978-3-642-21738-8
eBook Packages: Computer ScienceComputer Science (R0)