Abstract
In this paper, solution of generalized matrix Riccati differential equation (GMRDE) for indefinite stochastic linear quadratic singular fuzzy system with cross-term is obtained using neural networks. The goal is to provide optimal control with reduced calculus effort by comparing the solutions of GMRDE obtained from well-known traditional Runge Kutta (RK) method and nontraditional neural network method. To obtain the optimal control, the solution of GMRDE is computed by feed forward neural network (FFNN). Accuracy of the solution of the neural network approach to this problem is qualitatively better. The advantage of the proposed approach is that, once the network is trained, it allows instantaneous evaluation of solution at any desired number of points spending negligible computing time and memory. The computation time of the proposed method is shorter than the traditional RK method. An illustrative numerical example is presented for the proposed method.
Similar content being viewed by others
References
Athens M (1971) Special issues on linear quadratic Gaussian problem. IEEE Automat Control AC-16:527–869
Balasubramaniam P, Abdul Samath J, Kumaresan N, Vincent Antony Kumar A (2006) Solution of matrix Riccati differential equation for the linear quadratic singular system using neural networks. Appl Math Comput 182:1832–1839
Balasubramaniam P, Abdul Samath J, Kumaresan N (2007) Optimal control for nonlinear singular systems with quadratic performance using neural networks. Appl Math Comput 187:1535–1543
Bensoussan A (1983) Lecture on stochastic control part I. In: Nonlinear and stochastic control, lecture notes in math. No. 972. Springer, Berlin, pp 1–39
Bucci F, Pandolfi L (2000) The regulator problem with indefinite quadratic cost for boundary control systems: the finite horizon case. Syst Control Lett 39:79–86
Campbell SL (1980) Singular systems of differential equations. Pitman, Marshfield
Campbell SL (1982) Singular systems of differential equations II. Pitman, Marshfield
Chen SP, Li XJ, Zho XY (1998) Stochastic linear quadratic regulators with indefinite control weight costs. SIAM J Control Optim 36(5):1685–1702
Chengxin Luo, Enmin Feng (2004) Generalized differential Riccati equation and indefinite stochastic linear quadratic control with cross term. Appl Math Comput 155:121–135
Choi Chiu H (1990) A survey of numerical methods for solving matrix Riccati differential equation. IEEE Proc Southeastcon 696–700
Da Prato G, Ichikawa A (1988) Quadratic control for linear periodic systems. Appl Math Optim 18:39–66
Davis MHA (1977) Linear estimation and stochastic control. Chapman and Hall, London
Ellacott SW (1994) Aspects of the numerical analysis of neural networks. Acta Numer 5:145–202
Hagan MT, Menhaj M (1994) Training feedforward networks with the Marquardt algorithm. IEEE Trans Neural Netw 5(6):989–993
Ham FM, Collins EG (1996) A neurocomputing approach for solving the algebraic matrix Riccati equation. Proc IEEE Int Conf Neural Netw 1:617–622
Karakasoglu A, Sudharsanan SL, Sundareshan MK (1993) Identification and decentralized adaptive control using neural networks with application to robotic manipulators. IEEE Trans Neural Netw 4:919–930
Kumaresan N, Balasubramaniam P (2008) Optimal control for stochastic nonlinear singular system using neural networks. Comput Math Appl 5(9):2145–2154
Kumaresan N, Balasubramaniam P (2009) Optimal control for stochastic linear singular systems using neural networks. J Process Control 19:482-488
Kumaresan N, Balasubramaniam P (2008) Optimal control for stochastic linear singular system with indefinite cost and cross term using neural networks. Neural Parallel Sci Comput 16:467–480
Lagaris IE, Likas A, Fotiadis DI (1998) Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans Neural Netw 9:987–1000
Lewis FL (1986) A survey of linear singular systems. Circ Syst Sig Proc 5(1):3–36
Narendra KS, Parathasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1:4–27
Nguyen D, Widrow B (1990) Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights. Proc Int Joint Conf Neural Netw III:21–26
Paplinski AP (2004) Lecture notes on feedforward multilayer neural networks NNet(L.5)
Wang LX (1998) Stable and optimal fuzzy control of linear systems. IEEE Trans Fuzzy Syst 6(1):137–143
Wang J, Wu G (1998) A multilayer recurrent neural network for solving continuous time algebraic Riccati equations. Neural Netw 11:939–950
Wilde P De (1997) Neural network models, 2nd edn. Springer, London
Wonham WM (1968) On a matrix Riccati equation of stochastic control. SIAM J Control Optim 6:681–697
Wu SJ, Chiang HH, Lin HT, Lee TT (2005) Neural network based optimal fuzzy controller design for nonlinear systems. Fuzzy Set Syst 154:182–207
Zadeh LA (1975) The concept of a linguistic variable and its application to approximate reasoning. Inform Sci Part I(8):199–249
Zadeh LA (1975) The concept of a linguistic variable and its application to approximate reasoning. Inform Sci Part II(8):301–357
Zadeh LA (1975) The concept of a linguistic variable and its application to approximate reasoning. Inform Sci Part III(9):43–80
Zhu J, Li K (2003) An iterative method for solving stochastic Riccati differential equations for the stochastic LQR problem. Optim Methods Softw 18:721–732
Acknowledgments
The author is very much thankful to the referees for their valuable comments and suggestions for improving this manuscript. The funding of this work by the UMRG grant (Account No: RG099/10AFR) is gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kumaresan, N. Solution of generalized matrix Riccati differential equation for indefinite stochastic linear quadratic singular fuzzy system with cross-term using neural networks. Neural Comput & Applic 21, 497–503 (2012). https://doi.org/10.1007/s00521-010-0431-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-010-0431-3