Abstract
Echo State Networks (ESNs) have been shown to be effective for a number of tasks, including motor control, dynamic time series prediction, and memorising musical sequences. In this paper, we propose a new task of ESNs in order to solve distributed optimal control problems for systems governed by parabolic differential equations with discrete time delay using an adaptive critic designs. The optimal control problems are discretised by using a finite element method in time and space, then transcribed into a nonlinear programming problems. To find optimal controls and optimal trajectories ESNs adaptive critic designs are used to approximate co-state equations. The efficiency of our approach is demonstrated for a SIR distributed system to control the spread of diseases.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Brauer, F., Castillo-Chavez, C.: Mathematical Models in Population Biology and Epidemiology. Springer, New York (2001)
Borzi, A.: Multigrid methods for parabolic distributed optimal control problems. J. Comput. Appl. Math. 157, 365–382 (2003)
Chryssoverghi, I.: Discretization methods for semilinear parabolic optimal control problems. Int. J. Numer. Anal. Model. 3, 437–458 (2006)
Clever, D., Lang, J., Ulbrich, S., Ziems, J.C.: Combination of an adaptive multilevel SQP method and a space-time adaptive PDAE solver for optimal control problems. Procedia Comput. Sci. 1, 1435–1443 (2012)
Gollman, L., Kern, D., Mauer, H.: Optimal control problem with delays in state and control variables subject to mixed control-state constraints. Optim. Control Appl. Meth. 30, 341–365 (2009)
Forys, U., Marciniak-Czochra, A.: Logistic equations in tumor growth modelling. Int. J. Appl. Math. Comput. Sci. 13, 317–325 (2003)
Jaeger, H.: The “Echo State” Approach to Analysing and Training Recurrent Neural Networks. Technical report GMD 148, German National Research Institute for Computer Science (2001)
Jaeger, H.: Short Term Memory in Echo State Networks. Technical report GMD 152, German National Research Institute for Computer Science (2002)
Jaeger, H., Haas, H.: Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304, 7880 (2004)
Kar, T.K., Batabyal, A.: Stability analysis and optimal control of an SIR epidemic model with vaccination. BioSystems Sci. 104, 127–135 (2011)
Kmet, T., Kmetova, M.: Neural networks simulation of distributed control problems with state and control constraints. In: Villa, A.E.P., Masulli, P., Pons Rivero, A.J. (eds.) ICANN 2016. LNCS, vol. 9886, pp. 468–477. Springer, Cham (2016). doi:10.1007/978-3-319-44778-0_55
Knowles, G.: Finite element approximation of parabolic time optimal control problems. SIAM J. Control Optim. 20, 414–427 (1982)
Mittelmann, H.D.: Solving elliptic control problems with interior point and SQP methods: control and state constraints. J. Comput. Appl. Math. 120, 175–195 (2000)
Murray, J.D.: Mathematical Biology. Springer, Berlin (1993)
Ongenae, F., Van Looy, S., Verstraeten, D., Verplancke, T., Decruyenaere, J.: Time series classification for the prediction of dialysis in critically ill patients using echo state networks. Eng. Appl. Artif. Intell. 26, 984–996 (2013)
Padhi, R., Unnikrishnan, N., Wang, X., Balakrishnan, S.N.: Adaptive-critic based optimal control synthesis for distributed parameter systems. Automatica 37, 1223–1234 (2001)
Verstraeten, D., Schrauwen, B., D’Haene, M., Stroobandt, D.: An experimental unification of reservoir computing methods. Neural Networks 20(3), 414–423 (2007)
Werbos, P.J.: Approximate dynamic programming for real-time control and neural modelling. In: White, D.A., Sofge, D.A. (eds.) Handbook of Intelligent Control: Neural Fuzzy, and Adaptive Approaches, pp. 493–525 (1992)
Yoshida, N., Hara, T.: Global stability of a delayed SIR epidemic model with density dependent birth and death rates. J. Comput. Appl. Math. 201, 339–347 (2007)
Zaman, G., Kang, Y.H., Jung, I.H.: Optimal treatment of an SIR epidemic model with time delay. BioSystems 98, 43–50 (2009)
Acknowledgment
The paper was worked out as a part of the solution of the scientific project KEGA 010UJS-4/2014.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Kmet, T., Kmetova, M. (2017). Echo State Networks Simulation of SIR Distributed Control. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L., Zurada, J. (eds) Artificial Intelligence and Soft Computing. ICAISC 2017. Lecture Notes in Computer Science(), vol 10245. Springer, Cham. https://doi.org/10.1007/978-3-319-59063-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-59063-9_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-59062-2
Online ISBN: 978-3-319-59063-9
eBook Packages: Computer ScienceComputer Science (R0)