Abstract
The paper presents a numerical method for solving a class of high-dimensional stochastic control systems based on tensor decomposition and parallel computing. The HJB solution provides a globally optimal controller to the associated dynamical system. Variable substitution is used to simplify the nonlinear HJB equation. The curse of dimensionality is avoided by representing the HJB equation using separated representation. Alternating least squares (ALS) is used to reduced the separation rank. The experiment is conducted and the numerical solution is obtained. A high-performance algorithm is designed to reduce the separation rank in the parallel environment, solving the high-dimensional HJB equation with high efficiency.
Similar content being viewed by others
References
Zhou S Z and Zhan W P, A new domain decomposition method for an HJB equation, Journal of Computational and Applied Mathematics, 2003, 159(1): 195–204.
Peyrl H, Herzog F, and Geering H P, Numerical solution of the hamilton-jacobi-bellman equation for stochastic optimal control problems, International Conference on Dynamical Systems and Control (DSC), 2005 33rd Chinese, IEEE, 2005, 2614–2617.
Arash F, Touzi N, and Warin X, A probabilistic numerical method for fully nonlinear parabolic PDEs, Annals of Applied Probability, 2011, 21(4): 1322–1364.
Boulbrachene M, Finite Element Methods for HJB Equations, World Scientific, Singapore, 2011.
Alwardi H, Wang S, Jennings L S, et al., An adaptive least-squares collocation radial basis function method for the HJB equation, Journal of Global Optimization, 2012, 52(2): 305–322.
Zhang K and Yang X Q, A power penalty method for discrete HJB equations, Optimization Letters, 2019, 12(1): 12–18.
Sharifi E and Damaren C J, A numerical approach to hybrid nonlinear optimal control, International Journal of Control, 2020, 15(1): 1–14.
Boris N and Khoroms J, Tensors-structured numerical methods in scientific computing: Survey on recent advances, Chemometrics and Intelligent Laboratory Systems, 2012, 110(1): 1–19.
Kolda T G and Bader B W, Tensor decompositions and applications, SIAM Review, 2009, 51(3): 455–500.
Grasedyck L, Kressner D, and Tobler C, A literature survey of low-rank tensor approximation techniques, Gamm-Mitteilungen, 2013, 36(1): 13–23.
Andrzej C, Danilo M, and Huy A P, Tensor decompositions for signal processing applications: From two-way to multiway component analysis, IEEE Signal Processing Magazine, 2015, 32(2): 145–163.
Ballani J and Grasedyck L, A projection method to solve linear systems in tensor format, Numerical Linear Algebra with Applications, 2012, 12(1): 112–122.
Vo H and Sidje R B, An adaptive solution to the chemical master equation using tensors, Journal of Chemical Physics, 2017, 147(4): 44–102.
Sun Y F and Kumar M, A tensor decomposition approach to high dimensional stationary fokker-planck equations, Computers and Mathematics with Applications, 2014, 14(1): 4500–4505.
Sun Y F and Kumar M, Numerical solution of high dimensional stationary fokker-planck equations via tensor decomposition and chebyshev spectral differentiation, Computers and Mathematics with Applications, 2014, 67(10): 1960–1977.
Horowitz M B, Damle A, and Burdick J W, Linear hamilton jacobi bellman equations in high dimensions, Proceedings of the IEEE Conference on Decision and Control (CDC), 2014, 5880–5887.
Li Y and Wang Z, An adaptive cross approximation-based method for robust nonlinear feedback control problems, 2018 Annual American Control Conference (ACC), American, 2018.
Zhang S G and Bi X C, Minimizing the risk of absolute ruin under a diffusion approximation model with reinsurance and investment, Journal of Systems Science and Complexity, 2015, 28(1): 144.
Mohlenkamp M J, Algorithms for numerical analysis in high dimensions, Journal on Scientific Computing, 2005, 26(6): 2133–2159.
Zhao H and Rong X M, On the constant elasticity of variance model for the utility maximization problem with multiple risky assets, Journal of Management Mathematics, 2017, 28(2): 299–320.
Author information
Authors and Affiliations
Corresponding authors
Additional information
This research was supported by the National Natural Science Foundation of China under Grant No. 61873254.
This paper was recommended for publication by Editor ZHAO Yanlong.
Rights and permissions
About this article
Cite this article
Chen, Y., Lu, Z. Tensor Decomposition and High-Performance Computing for Solving High-Dimensional Stochastic Control System Numerically. J Syst Sci Complex 35, 123–136 (2022). https://doi.org/10.1007/s11424-021-0126-0
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-021-0126-0