Abstract
Zeroing dynamics (ZD) has shown great performance to solve various time-varying problems. In this paper, the problem of time-varying Sylvester-transpose matrix inequality is first investigated. Since it is difficult to solve a matrix inequality with a matrix variable and its transpose by traditional methods, this paper proposes a continuous ZD (CZD) model by employing ZD design formula and JMP function array to solve this challenging problem. Furthermore, for better implementation on digital computers, three discrete ZD (DZD) models are proposed by using three different discretization formulas with different precision, i.e., the Euler-forward formula, the 6-instant Zhang et al discretization (ZeaD) formula and the 7-instant ZeaD formula. What is more, theoretical truncation error analyses and numerical experiments substantiate the convergence, efficacy and superiority of the DZD models for solving time-varying Sylvester-transpose matrix inequality.
Similar content being viewed by others
References
Chesi, G.: LMI techniques for optimization over polynomials in control: a survey. IEEE Trans. Autom. Control 55(11), 2500–2510 (2010)
Jing, X.: Robust adaptive learning of feedforward neural networks via LMI optimizations. Neural Netw. 31, 33–45 (2012)
Lakshmanan, S., Lim, C.P., Prakash, M., Nahavandi, S., Balasubramaniam, P.: Neutral-type of delayed inertial neural networks and their stability analysis using the LMI approach. Neurocomputing 230, 243–250 (2017)
Wang, Z., Zhang, H., Jiang, B.: LMI-based approach for global asymptotic stability analysis of recurrent neural networks with various delays and structures. IEEE Trans. Neural Netw. 22(7), 1032–1045 (2011)
Zhang, Y.: A set of nonlinear equations and inequalities arising in robotics and its online solution via a primal neural network. Neurocomputing 70(1–3), 513–524 (2006)
Li, J., Huang, N.: Image space analysis for vector variational inequalities with matrix inequality constraints and applications. J. Optim. Theory Appl. 145(3), 459–477 (2010)
Guo, D., Zhang, Y.: Zhang neural network for online solution of time-varying linear matrix inequality aided with an equality conversion. IEEE Trans. Neural Netw. Learn. Syst. 25(2), 370–382 (2014)
Lei, Y.: The inexact fixed matrix iteration for solving large linear inequalities in a least squares sense. Numer. Algorithms 69(1), 227–251 (2015)
Dax, A.: A hybrid algorithm for solving linear inequalities in a least squares sense. Numer. Algorithms 50(2), 97–114 (2009)
Zhang, Z., Zhang, Y.: Variable joint-velocity limits of redundant robot manipulators handled by quadratic programming. IEEE/ASME Trans. Mechatron. 18(2), 674–686 (2013)
Guo, D., Zhang, Y.: A new inequality-based obstacle-avoidance MVN scheme and its application to redundant robot manipulators. IEEE Trans. Syst. Man Cybern. Part C-Appl. Rev. 42(6), 1326–1340 (2012)
Yang, K., Murty, K.G.: New iterative methods for linear inequalities. J. Optim. Theory Appl. 72(1), 163–185 (1992)
Cichocki, A., Bargiela, A.: Neural networks for solving linear inequality systems. Parallel Comput. 22(11), 1455–1475 (1997)
Lin, C., Lai, C., Huang, T.: A neural network for linear matrix inequality problems. IEEE Trans. Neural Netw. 11(5), 1078–1092 (2000)
Cheng, L., Hou, Z., Tan, M.: A simplified neural network for linear matrix inequality problems. Neural Process. Lett. 29(3), 213–230 (2009)
Hajarian, M.: Matrix iterative methods for solving the Sylvester-transpose and periodic Sylvester matrix equations. J. Frankl. Inst. 350(10), 3328–3341 (2013)
Hajarian, M.: Extending the GPBiCG algorithm for solving the generalized Sylvester-transpose matrix equation. Int. J. Control Autom. Syst. 12 (6), 1362–1365 (2014)
Li, S., He, J., Li, Y., Rafique, M.U.: Distributed recurrent neural networks for cooperative control of manipulators: a game-theoretic perspective. IEEE Trans. Neural Netw. Learn. Syst. 28(2), 415–426 (2017)
Misra, J., Saha, I.: Artificial neural networks in hardware: a survey of two decades of progress. Neurocomputing 74(1–3), 239–255 (2010)
Liu, L., Shao, H., Nan, D.: Recurrent neural network model for computing largest and smallest generalized eigenvalue. Neurocomputing 71(16–18), 3589–3594 (2008)
Zhang, Y., Ma, W., Li, X., Tan, H., Chen, K.: MATLAB Simulink modeling and simulation of LVI-based primal-dual neural network for solving linear and quadratic programs. Neurocomputing 71(7–9), 1679–1687 (2009)
Zhao, H., Zhang, J.: Nonlinear dynamic system identification using pipelined functional link artificial recurrent neural network. Neurocomputing 72 (13–15), 3046–3054 (2009)
Li, S., Zhang, Y., Jin, L.: Kinematic control of redundant manipulators using neural networks. IEEE Trans. Neural Netw. Learn. Syst. 28(10), 2243–2254 (2017)
Chen, M.: Constrained control allocation for overactuated aircraft using a neurodynamic model. IEEE Trans. Syst. Man Cybern. Part A-Syst. Hum. 46(12), 1630–1641 (2016)
Jin, L., Zhang, Y.: Continuous and discrete Zhang dynamics for real-time varying nonlinear optimization. Numer. Algorithms 73(1), 115–140 (2016)
Guo, D., Lin, X., Su, Z., Sun, S., Huang, Z.: Design and analysis of two discrete-time ZD algorithms for time-varying nonlinear minimization. Numer. Algorithms 77(1), 23–36 (2018)
Zhang, Y., Li, Z., Guo, D., Ke, Z., Chen, P.: Discrete-time ZD, GD and NI for solving nonlinear timevarying equations. Numer. Algorithms 64(4), 721–740 (2013)
Zhang, Y., Ge, S.: Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans. Neural Netw. 16 (6), 1477–1490 (2005)
Zhang, Y., Jiang, D., Wang, J.: A recurrent neural network for solving Sylvester equation with timevarying coefficients. IEEE Trans. Neural Netw. 16 (5), 1053–1063 (2002)
Zhang, Z., Zheng, L., Weng, J., Mao, Y., Lu, W., Xiao, L.: A new varying-parameter recurrent neural-network for online solution of time-varying Sylvester equation. IEEE Trans. Cybern. 48(11), 3135–3148 (2018)
Xiao, L., Liao, B., Li, S., Zhang, Z., Ding, L., Jin, L.: Design and analysis of FTZNN applied to real-time solution of nonstationary Lyapunov equation and tracking control of wheeled mobile manipulator. IEEE Trans. Ind. Inform. 48(1), 98–105 (2018)
Xiao, L., Liao, B.: A convergence-accelerated Zhang neural network and its solution application to Lyapunov equation. Neurocomputing 193, 213–218 (2016)
Li, X., Yu, J., Li, S., Ni, L.: A nonlinear and noise-tolerant ZNN model solving for time-varying linear matrix equation. Neurocomputing 317, 70–78 (2018)
Zhang, Y.: Revisit the analog computer and gradient-based neural system for matrix inversion. In: Proceedings of IEEE International Symposium on Intelligent Control, pp. 1411–1416 (2005)
Miao, P., Shen, Y., Huang, Y., Wang, Y.: Solving time-varying quadratic programs based on finite-time Zhang neural networks and their application to robot tracking. Neural Comput. Appl. 26(3), 693–703 (2015)
Xiao, L.: A nonlinearly activated neural dynamics and its finite-time solution to time-varying nonlinear equation. Neurocomputing 173, 1983–1988 (2016)
Xiao, L., Zhang, Y.: Zhang neural network versus gradient neural network for solving time-varying linear inequalities. IEEE Trans. Neural Netw. 22 (10), 1676–1684 (2011)
Hajarian, M.: Extending the CGLS algorithm for least squares solutions of the generalized Sylvester-transpose matrix equations. J. Frankl. Inst. 353 (5), 1168–1185 (2016)
Hajarian, M.: Extending LSQR methods to solve the generalized Sylvester-transpose and periodic Sylvester matrix equations. Math. Meth. Appl. Sci. 37(13), 2017–2028 (2013)
Hajarian, M.: Developing BiCOR and CORS methods for coupled Sylvester-transpose and periodic Sylvester matrix equations. Appl. Math. Model. 39(19), 6073–6084 (2015)
Xiao, L., Zhang, Y.: Different Zhang functions resulting in different ZNN models demonstrated via time-varying linear matrix-vector inequalities solving. Neurocomputing 121, 140–149 (2013)
Zhang, Y., Yang, M., Huang, H., Xiao, M., Hu, H.: New discrete solution model for solving future different-level linear inequality and equality with robot manipulator control. IEEE Trans. Ind. Inform. 15(4), 1975–1984 (2019)
Jin, L., Li, S., Liao, B., Zhang, Z.: Zeroing neural networks: a survey. Neurocomputing 267, 597–604 (2017)
Zhang, Y., Qi, Z., Li, J., Qiu, B., Yang, M.: Stepsize domain confirmation and optimum of ZeaD formula for future optimization. Numer. Algorithms 81(2), 561–574 (2019)
Li, J., Mao, M., Uhlig, F., Zhang, Y.: A 5-instant finite difference formula to find discrete time-varying generalized matrix inverses, matrix inverses, and scalar reciprocals. Numer. Algorithms 81(2), 609–629 (2019)
Qiu, B., Zhang, Y., Guo, J., Yang, Z., Li, X.: New five-step DTZD algorithm for future nonlinear minimization with quartic steady-state error pattern. Numer. Algorithms 81(3), 1043–1065 (2019)
Qiu, B., Zhang, Y.: Two new discrete-time neurodynamic algorithms applied to online future matrix inversion with nonsingular or sometimes-singular coefficient. IEEE Trans. Cybern. 49(6), 2032–2045 (2019)
Hajarian, M.: Matrix iterative methods for solving the Sylvester-transpose and periodic Sylvester matrix equations. J. Frankl. Inst.-Eng. Appl. Math. 350(10), 3328–3341 (2013)
Zhang, Y., Yi, C.: Zhang Neural Networks and Neural-Dynamic Method. Nova Science Publishers, New York (2011)
Horn, R.A., Johnson, C.R.: Matrix Analysis. Cambridge University Press, Cambridge (2012)
Cormen, T.T., Leiserson, C.E., Rivest, R.L.: Introduction to Algorithms. MIT Press, Cambridge (1990)
Liao, B., Zhang, Y.: From different ZFs to different ZNN models accelerated via Li activation functions to finite-time convergence for time-varying matrix pseudoinversion. Neurocomputing 133, 512–522 (2014)
Zhang, Y., Yang, Y., Tan, N., Cai, B.: Zhang neural network solving for time-varying full-rank matrix Moore-Penrose inverse. Computing 92(2), 97–121 (2011)
Zhang, Y., Li, J., Li, S., Chen, D., He, L.: Optimal zeroing dynamics with applications to control of serial and parallel manipulators. Optim. Control Appl. Methods 39(4), 1393–1406 (2018)
Li, J., Zhang, Y., Li, S., Mao, M.: New discretization-formula-based zeroing dynamics for real-time tracking control of serial and parallel manipulators. IEEE Trans. Ind. Inform. 14(8), 3416–3425 (2018)
Mathews, J.H., Fink, K.D.: Numerical Methods Using Matlab. Prentice-Hall, Upper Saddle River (2004)
Suli, E., Mayers, D.F.: An Introduction to Numerical Analysis. Cambridge University Press, Cambridge (2003)
Griffiths, D.F., Higham, D.J.: Numerical Methods for Ordinary Differential Equations: Initial Value Problems. Springer, London (2010)
Funding
This work is supported by the National Natural Science Foundation of China (with number 61976230) and also by the Shenzhen Science and Technology Plan Project (with number JCYJ20170818154936083).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix:
Appendix:
As for an N-step algorithm, the following four lemmas [57, 58] are presented as general concepts and theoretical results for ZD research.
Lemma 2
An N-step method depicted by \(\sum \nolimits _{j = 0}^{N} {\alpha _{j} x_{k + j}}=g\sum \nolimits _{j = 0}^{N} {\upbeta }_{j} \delta _{k + j}\) can be checked for its 0-stability by determining the roots of its characteristic polynomial \(\varphi (\varsigma ) = \sum \nolimits _{j = 0}^{N} \alpha _{j} \varsigma ^{j}\). If all roots of φ(ς) = 0 satisfy |ς|≤ 1 with |ς| = 1 being unique, then the N-step method is 0-stable (i.e., has 0-stability).
Lemma 3
If the truncation error for the exact solution is of order O(gp) with p > 0 defined, an N-step method is said to be consistent of order p.
Lemma 4
For all t ∈ [0,tf], as \(g \rightarrow 0\), if and only if the method is 0-stable and consistent, an N-step method is convergent, i.e., \(x_{[t/g]}\rightarrow x^{*}(t)\). That is, 0-stability plus consistency means convergence, which is also known as Dahlquist equivalence theorem.
Lemma 5
If an N-step method is 0-stable and consistent, the N-step method is convergent, with the order of its truncation error.
Rights and permissions
About this article
Cite this article
Zhang, Y., Liu, X., Ling, Y. et al. Continuous and discrete zeroing dynamics models using JMP function array and design formula for solving time-varying Sylvester-transpose matrix inequality. Numer Algor 86, 1591–1614 (2021). https://doi.org/10.1007/s11075-020-00946-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11075-020-00946-1