Abstract
Optimization methods in cyber-physical systems do not involve parameter uncertainties in most existing literature. This paper considers adaptive optimization problems in which searching for optimal solutions and identifying unknown parameters must be performed simultaneously. Due to the dual roles of the input signals on achieving optimization and providing persistent excitation for identification, a fundamental conflict arises. In this paper, a method of adding a small deterministic periodic dither signal to the input is deployed to resolve this conflict and provide sufficient excitation for estimating the unknown parameters. The designing principle of the dither is discussed. Under dithered inputs, the authors show that simultaneous convergence of parameter estimation and optimization can be achieved. Convergence properties and convergence rates of parameter estimation and optimization variable updates are presented under the scenarios of uncertainty-free observations and systems with noisy observation and unmodeled components. The fundamental relationships and trade-off among updating step sizes, dither magnitudes, parameter estimation errors, optimization accuracy, and convergence rates are further investigated.
Similar content being viewed by others
References
Ruszczyński A P, Nonlinear Optimization, Princeton University Press, New Jersey, 2006.
Bertsekas D P, Convex Optimization Algorithms, Athena Scientific, Belmont, MA, USA, 2015.
Nesterov Y, Lectures on Convex Optimization, Springer, New York, 2018.
Bottou L, Curtis F E, and Nocedal J, Optimization methods for large-scale machine learning, SIAM Review, 2018, 60(2): 223–311.
Nedić A and Ozdaglar A, Distributed subgradient methods for multiagent optimization, IEEE Trans. Automatic Control, 2009, 54(1): 48–61.
Johansson B, Rabi M, and Johansson M, A randomized incremental subgradient method for distributed optimization in networked systems, SIAM Journal on Optimization, 2010, 20(3): 1157–1170.
Zhang Y, Deng Z, and Hong Y, Distributed optimal coordination for multiple heterogeneous Euler-Lagrangian systems, Automatica, 2017, 79: 207–213.
Liang S and Yin G, Distributed smooth convex optimization with coupled constraints, IEEE Trans. Automatic Control, 2019, 65(1): 347–353.
Yang T, Yi X, Wu J, et al., A survey of distributed optimization, Annual Reviews in Control, 2019, 47: 278–305.
Mo L, Liu X, Cao X, et al., Distributed second-order continuous-time optimization via adaptive algorithm with nonuniform gradient gains, Journal of Systems Science and Complexity, 2020, 33(6): 1914–1932.
Yi P and Li L, Distributed nonsmooth convex optimization over Markovian switching random networks with two step-sizes, Journal of Systems Science and Complexity, 2021, https://doi.org/10.1007/s11424-020-0071-3.
Bertsimas D, Brown D B, and Caramanis C, Theory and applications of robust optimization, SIAM Review, 2011, 53(3): 464–501.
Ben-Tal A, Den Hertog D, De Waegenaere A, et al., Robust solutions of optimization problems affected by uncertain probabilities, Management Science, 2013, 59(2): 341–357.
Kosmatopoulos E B, Adaptive control design based on adaptive optimization principles, IEEE Trans. Automatic Control, 2008, 53(11): 2680–2685.
Duchi J, Hazan E, and Singer Y, Adaptive subgradient methods for online learning and stochastic optimization, Journal of Machine Learning Research, 2011, 12(7): 2121–2159.
Xie S Y, Liang S, Wang L Y, et al., Stochastic adaptive optimization with dithers, IEEE Trans. Automatic Control, 2021, DOI: https://doi.org/10.1109/TAC.2021.3050438.
Ljung L, System Identification: Theory for the User, Prentice-Hall, Englewood Cliffs, 1987.
Wang L Y, Yin G, Zhang J F, et al., System Identification with Quantized Observations, Boston, MA, Birkhäuser, 2010 (ISBN: 978-0-8176-4955-5).
Chen H F and Guo L, Identification and Stochastic Adaptive Control, Birkhäuser, Boston, 1991.
Haykin S, Adaptive Filter Theory, Prentice Hall, Englewood Cliffs, NJ, USA, 1996.
Macchi O, Adaptive Processing: The Least Mean Squares Approach with Applications in Transmission, Wiley, New York, NY, USA, 1995.
Guo L, Stability of recursive stochastic tracking algorithms, SIAM Journal on Control and Optimization, 1994, 32(5): 1195–1225.
Author information
Authors and Affiliations
Corresponding authors
Additional information
This research was supported in part by the Air Force Office of Scientific Research under Grant No. FA9550-18-1-0268.
Rights and permissions
About this article
Cite this article
Xie, S., Wang, L.Y. Adaptive Optimization with Periodic Dither Signals. J Syst Sci Complex 34, 1766–1781 (2021). https://doi.org/10.1007/s11424-021-1211-0
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-021-1211-0