Passivity and stability analysis of neural networks with time-varying delays via extended free-weighting matrices integral inequality
Introduction
The stability of neural networks has received a great attention during the last decades owing to their excellent extensions in many scientific and engineering fields such as parallel computing, pattern recognition, associative memories, image processing, secure communication, and other scientific areas. For details, see Kwon, Park, Lee, Park, and Cha (2013), Zhang, He, Jiang, and Wu (2016) and Zhang, Wang, and Liu (2014) and reference therein.
It is well known that time-delay is a natural phenomenon but very important factor that should be considered in mathematical modeling of physical systems because of their occurrence caused by the finite switching speed of amplifiers and signal propagation. Time-delays are often a source of performance degradation such as oscillation and divergence. Since the dynamic behavior of equilibrium points has a major influence on the application of neural networks, considerable time and efforts have been concentrated on stability analysis for dynamic systems with time-delay by many researchers Fu et al. (2010), Gu (1997), Kwon, Park, Park et al. (2014), Kwon et al. (2016a), Kwon et al. (2016b), Kwon, Park, Park, Lee et al. (2014), Lee et al. (2013), Li and Cao (2017), Li and Song (2017), Liu et al. (2006), Park, Kwon et al. (2015), Park et al. (2018a), Park et al. (2018b), Park et al. (2011), Park, Lee et al. (2015), Park et al. (2016), Seuret and Gouaisbaut (2013), Velmurugan et al. (2017), Zeng, He, Wu et al. (2015), Zhang and Han (2011). Especially, with the use of Lyapunov–Krasovskii theorem and some mathematical techniques, delay-dependent stability conditions are derived within the framework of tractable LMIs of which the solutions can be easily found by various algorithms. In developing delay-dependent stability criteria for systems with time-delays, one of the main issue is how to increase maximum delay bounds ensuring the asymptotic stability since the maximum value of upper bounds of time-varying delay has been recognized as one of the key demonstration for the superiority and less conservatism of developed stability criteria.
Roughly speaking, there are two major methods to enhance the feasible region: (1) more tighter estimation of the quadratic integral terms coming out from the time-derivative of LKF and (2) the construction of Lyapunov–Krasovskiifunctional (LKF). Since Seuret & Gouaisbaut (2013) have introduced Wirtinger-based integral inequality(WBII) which breaks the conservatism of Jensen inequality, some remarkable methods for bounding integral inequality have emerged as such a rapid pace. Some representative integral inequalities for estimating tight lower bound of integral terms are Wirtinger-based double integral inequality (Park, Kwon et al., 2015), auxiliary function-based integral inequality Park, Lee et al. (2015), Park et al. (2016), free-matrix-based integral inequality (Zeng, He, Wu et al., 2015), generalized free-weighting-matrix integral inequality (Zhang et al., 2017), generalized integral inequality (Park et al., 2018b), and so on. Other well known techniques for reducing the conservatism are delay-partitioning (Gu, 1997), reciprocally convex optimization (Park et al., 2011), zero equality (Kim et al., 2010), and so on. Some recent progress in stability and stabilization of dynamic systems with time-delays can be found in Mahmoud (2017).
Another key point to increase the feasible region of stability criteria is how to construct LKF and choose augmented vectors to derive negative definite conditions of the time-derivative of LKF in the form of quadratic forms. In Kwon, Park, Park, Lee et al. (2014), the authors showed the importance and superiority of augmented LKF by comparing the results with and without augmented LKFs. Since then, by constructing the following form of LKF, where denotes time, means a maximum admissible delay bound, is a state vector, and is a positive definite matrix with an appropriate dimension, stability criteria which provide significant improved results have been derived in various problems such as performance analysis and stability of linear systems with interval time-varying delay (Kwon et al., 2016a), stability and stabilization of Takagi–Sugeno fuzzy systems with time-varying delays (Kwon et al., 2016b), and linear systems with various kinds of constraints on the derivative of time-delays (Park et al., 2018a). Thus, it can be seen that the utilization of LKF (1) plays a leading role in increasing delay bounds.
The basic concept of dissipativity is that the increase in storage over a time interval cannot exceed the supply delivered to the system during this time-interval (Willems, 2007). A dissipative system with a particular form of supply rate function such as an inner produce of system and output vectors is a passive system. Passivity theory which is known as part of a general theory of dissipativity has been received a great attention since 1970s due to its advantage in stability analysis for nonlinear systems, high-order systems, and so on. The application of passivity theory can be found in various problems such as synchronization, chaos control, passive control, and so on. Also, owing to the rapid development of integral inequality and mathematical techniques mentioned before, many noticeable results in passivity and dissipativity analysis for neural networks with time-varying delays can be found in Chen, Li, & Bi (2009) Chen, Li, Lin, & Zhou (2009) Chen, Wang, Zhong, & Yang (2017) Chen, Xia, & Zhuang (2016) Fu, Zhang, Ma, & Zhang (2010) Kwon, Lee, & Park (2012) Kwon, Park, Lee et al. (2013), Kwon, Park, Park et al. (2013) Manivannan, Mahendrakumar, Samidurai, Cao, & Alsaedi (2017) Manivannan, Mahendrakumar et al. (2017), Manivannan, Samidurai et al. (2017) Manivannan, Samidurai, & Zhu (2017) Shu, Liu, Qiu, & Wang (2017) Thuan, Trinh, & Hien (2016) Wu, Park, Su, & Chu (2012) Xiao, Lian, Zeng, Chen, & Zheng (2017) Zeng, He, Shi, Wu, & Xiao (2015) Zeng et al. (2011), Zeng et al. (2014) Zeng, Park, & Shen (2015) Zeng, Park, & Xia (2015). For neural networks with randomly uncertain neural networks and time-varying delays, passivity analysis was conducted in Zeng, Park, and Xia (2015) as a special case of dissipativity by utilizing free-matrix-based integral inequality and reciprocally convex optimization. Thuan et al. (2016) investigated passivity for neural networks with interval time-varying delays by proposing refined two integral inequalities for single and double integral terms and applying these inequalities to estimate the integral terms calculated by LKFs. In Xiao et al. (2017), Wirtinger-based integral inequality (Seuret & Gouaisbaut, 2013), auxiliary function-based integral inequality Park, Lee et al. (2015), Park et al. (2016) and free-matrix-based integral inequality (Zhang et al., 2017) were simultaneously utilized in studying passivity for uncertain neural networks with time-varying delays. However, most of the previous results concerned to passivity for neural networks have utilized only one state in double integral form of LKF. Therefore, there are still a spare space to lift up passivity criteria.
In this paper, passivity analysis for neural networks with time-varying delays is revisited. Here, norm-bounded parameter uncertainties are considered to reflect the real situation caused by unidentified dynamics, external errors, and some noises. In order to achieve that, the followings are performed:
-
Based on generalized free-weighting-matrix integral inequality (Zhang et al., 2017), a further extended generalized free-weighting-matrix integral inequality is introduced in Lemma 2 by utilizing orthogonal polynomials.
-
Unlike the previous results such as Thuan et al. (2016) and Xiao et al. (2017), a triple integral form of LKF is not utilized in this paper. Instead, by constructing LKF including the double integral form introduced in Kwon, Park, Lee et al. (2013) and utilizing the proposed Lemma 2, a significantly improved passivity criterion is introduced in Theorem 1 with the framework of tractable LMIs.
-
Based on Theorem 1, a passivity condition for neural networks without uncertainties is presented in Theorem 2.
-
To show the superiority of the proposed conditions introduced in Theorem 1, Theorem 2 more clearly, a stability criterion for the concerned network is introduced without modifying LKFs utilized in Theorem 1, Theorem 2.
By comparing maximum delay bounds with the previous results, the superiority and less conservatism of the developed passivity and stability criteria presented in this paper will be shown.
Notation: Throughout this paper, the used notations are standard. and denote the -dimensional Euclidean space with the Euclidean vector norm and the set of all real matrices, respectively. , and are the sets of symmetric, positive definite and positive diagonal matrices, respectively. means the identity matrix with dimension. denotes the zero matrix with dimension. () means symmetric positive (negative) definite matrix. denotes a basis for the null-space of . , , and stand for, respectively, the (block) diagonal matrix, the sum of and , the column vector with the vectors , and the set of the elements . The symmetric terms in symmetric matrices and in quadratic forms will be denoted by (This is used if necessary.). means the sum of a constant matrix and a linear matrix for all real scalars ; i.e., .
Section snippets
Problem statements
Consider the following neural networks : where is the neuron state vector, is the input vector, is the output vector, is the activation function, is the positive diagonal matrix, and are given real matrices, are the interconnection weight matrices. means time-varying delays which satisfy and
Main results
To simplify matrix and vector representations of proposed results, block entry matrices, and which will be used in Theorem 1 are defined. For an example, . The other notations are defined as
Numerical examples
In this section, three numerical examples will be provided to illustrate the effectiveness of the proposed stability criteria. The system parameters are as follows.
Example 1 Consider the uncertain neural networks (2) with the parameters
In Table 1, the results of maximum delay bounds obtained by Theorem 1 are shown and some recent results
Conclusions
The passivity and stability of neural networks have been investigated in this paper. In Lemma 2, inspired by the work of Zhang et al. (2017), the further extended generalized free-matrix-based integral inequality has been proposed. By constructing the suitable LKFs which partially include new terms, the passivity condition for uncertain neural networks has been proposed in Theorem 1. Based on the result of Theorem 1, the passivity condition for nominal neural network has been presented in
Acknowledgments
This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (NRF-2016R1D1A1A09917886) and by the Brain Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (NRF-2017M3C7A1044815). This work was also supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government
References (55)
- et al.
Passivity analysis for uncertain neural networks with discrete and distributed time-varying delays
Physics Letters A
(2009) - et al.
Improved delay-dependent robust passivity criteria for uncertain neural networks with discrete and distributed delays
Chaos, Solitons & Fractals
(2017) - et al.
Delay-dependent stability and dissipativity analysis of generalized neural networks with Markovian jump parameters and two delay components
Journal of the Franklin Institute
(2016) - et al.
Stability criterion for delayed neural networks via Wirtinger-based multiple integral inequality
Neucomputing
(2016) - et al.
On passivity analysis for stochastic neural networks with interval time-varying delay
Neurocomputing
(2010) - et al.
Analysis on delay-dependent stablity for neural networks with time-varying delays
Neurocomputing
(2013) - et al.
Improvement on the feasible region of performance and stability for systems with interval time-varying delays via augmented Lyapunov-Krasovskii functional
Journal of the Franklin Institute
(2016) - et al.
Stability and stabilization of T-S fuzzy systems with time-varying delays via augmented Lyapunov-Krasovskii functionals
Information Sciences
(2016) - et al.
Improved results on stability of linear systems with time-varying delays via Wirtinger-based integral inequality
Journal of the Franklin Institute
(2014) - et al.
Stochastic sampled-data control for state estimation of time-varying delayed neural networks
Neural Networks
(2013)
Stability of nonlinear differential systems with state-dependent delayed impulses
Automatica
Global exponential stability of generalized recurrent neural networks with discrete and distributed delays
Neural Networks
Exponential stability and extended dissipativity criteria for generalized neural networks with interval time-varying delay signals
Journal of the Franklin Institute
Global exponential stability and dissipativity of generalized neural networks with time-varying delay signals
Neural Networks
Design of extended dissipativity state estimation for generalized neural networks with mixed time-varying delay signals
Information Sciences
Further improved results on stability and dissipativity analysis of static impulsive neural networks with interval time-varying delays
Journal of the Franklin Institute
Stability of time-delay systems via Wirtinger-based double integral inequality
Automatica
Advanced stability criteria for linear systems with time-varying delays
Journal of the Franklin Institute
Generalizd integral inequality: application to time-delay systems
Applied Mathematics Letters
Reciprocally convex approach to stability of systems with time-varying delays
Automatica
Auxiliary function-based integral inequalities for quadratic functions and their applications to time-delaysystems
Journal of the Franklin Institute
Wirtinger-based integral inequality: Application to time-delay systems
Automatica
Hierarchy of LMI conditions for the stability analysis of time delay systems
Systems & Control Letters
New stability results for delayed neural networks
Applied Mathematics and Computation
New inequality-based approach to passivity analysis of neural networks with interval time-varying delay
Neurocomputing
Dissipativity and stability analysis of fractional-order complex-valued neural networks with time delay
Neural Networks
Dissipative dynamical systems
Europan Journal of Control
Cited by (51)
Synchronization sampled-data control of uncertain neural networks under an asymmetric Lyapunov–Krasovskii functional method
2024, Expert Systems with ApplicationsNovel inequality-based functions for the stability of time-varying delay systems
2023, Journal of the Franklin InstituteNovel stability analysis methods for generalized neural networks with interval time-varying delay
2023, Information SciencesFinite-time mixed H<inf>∞</inf> and passivity analysis for Takagi–Sugeno fuzzy system with time-varying delays and actuator faults
2023, Communications in Nonlinear Science and Numerical SimulationCitation Excerpt :For the LKF approach, several approaches have been thought to derive tighter boundary inequalities to reduce the conservatism. So far, various approaches have been formulated, including Jensen’s inequality [28], free-weighting matrices technique [29], auxiliary function-based inequality [30], Bessel–Legendre inequality [31], extended Wirtinger’s inequality [32], and extended reciprocally convex inequality technique [33] and so on. Apart from boundary technologies, the selection by LKF is also crucial.