Elsevier

Neurocomputing

Volume 108, 2 May 2013, Pages 84-92
Neurocomputing

Synchronization stability in complex interconnected neural networks with nonsymmetric coupling

https://doi.org/10.1016/j.neucom.2012.11.014Get rights and content

Abstract

Some global stability criteria for arrays of linearly coupled delayed neural networks with nonsymmetric coupling are established on the basis of linear matrix inequality (LMI) method, in which the coupling configuration matrix may be arbitrary matrix with appropriate dimensions. Meanwhile, the relations of coupling matrix to stability and synchronization are discussed in detail, and some analysis methods to the synchronization stability of complex networks are also argued. The difficulty arising from the nonsymmetry of the coupling matrix has been overcome in this work. Numerical simulation is also given to verify the effectiveness of the theoretical results.

Introduction

There exists increasing interest in the study of dynamical properties of delayed recurrent neural networks due to its potential applications in various fields, including online optimization, pattern recognition, signal and image processing, and associative memories [1], [2], [3]. Most of the previous studies mainly concentrated on stability analysis, periodic or almost periodic attractors, and dissipativity of recurrent neural networks with or without delays [4], [5], [6], [7], [8], [17], [18]. Since it has been reported that there are synchronization phenomena in many real systems, such as in an array composing of identical delayed neural networks, it is important to study the synchronization problem in coupled networks and systems in engineering applications, such as secure communication and signal generators design [9], [10], [11], [12], [13], [14], [16]. Therefore, the study of synchronization of coupled neural networks is an important step for both understanding brain science and designing coupled neural networks for practical use.

Nowadays, there are mainly two kinds of coupling matrix structure to study the synchronization in an array composing of identical delayed neural networks:

(1) Symmetric coupling matrix G=(Gij)RN×N, which means that for two connected nodes the influences to each other are the same. That is, Gij=Gji0 for ij and Gii=j=1,jiNGij.

(2) Nonsymmetric coupling matrix, Gij0 for ij and Gii=j=1,jiNGij, i,j=1,,N, N is the number of coupling term, G=(Gij)RN×N is an irreducible coupling matrix.

For the case of symmetric coupling matrix, the synchronization problems have been investigated in [9], [15], [16], [19], [20], [22], [23], [24], and some synchronization criteria have been derived based on LMI method or other methods. All the LMI-based synchronization results are on the basis of Kronecker product expression, in which the symmetric and irreducible feature of coupling matrix plays an important role in the derivation.

For the case of nonsymmetric coupling matrix, the synchronization problems have been studied in [25], [26], [27], [28], [29], [30], [31], in which the coupling matrix G is irreducible. In [26], the coupling matrix elements Gij0 for ij, and Gii=j=1,jiGij, and G is irreducible. The methods in [27], [28], [29] are to use the Jacobian matrix of nonlinear function at synchronization state, which can only ensure the local synchronization. Meanwhile, all the results in [27], [28], [29], [30] are in the Kronecker form, which enhance the difficulty to check. The results in [31] are on the basis of eigenvalue approach, in which some relations between the coupling matrix of linear couplig term and the parameters of isolated system are established.

In this paper, we will extend the requirement condition of the coupling matrix G=(Gij), and study an array of linearly delay coupled system consisting of N identical delayed neural networks with each network being an n-dimensional dynamical system. Synchronization stability problem of the coupled interconnected large-scale system is first studied on the basis of LMI, and some discussions on the coupling matrix G are compared with the synchronization problem of the existing complex networks.

The main contributions of the paper are as follows: (1) Without the requirement of symmetric and irreducible conditions on coupling matrix G, some global asymptotical synchronization stability criteria are established for an array of linearly delay coupled neural networks, which make the synchronization criteria of complex networks more flexible. (2) The relations between the stability of isolated neural networks and the synchronization of an array of linearly delay coupled neural networks are discussed, which present a deep insight into the research on the dynamics of complex systems. (3) Some discussions are made on the coordinate transformation method in dealing with synchronization problem of complex networks, which reveal the necessity of the uniqueness assumption on the equilibrium point as required in [19].

The paper is organized as follows. Section 2 presents some problem formulations and preliminaries. Some discussions on the different requirement of coupling matrix G are presented. Meanwhile, some remarks are also made on the coordinate transformation method in dealing with synchronization problem of complex networks. Section 3 presents the main results and some remarks on the relations between the stability of isolated neural networks and the synchronization of an array of linearly delay coupled neural networks are made. Section 4 presents some simulations with different kinds of coupling matrix G to verify the effectiveness of the proposed results, and conclusions are drawn in Section 5.

Section snippets

Problem formulation and preliminaries

We consider an array of linearly coupled system consisting of N identical delayed neural networks with each isolated node network being an n-dimensional dynamical system as follows:dxi(t)dt=Dxi(t)+Ag(xi(t))+Bg(xi(tτ1))+a1j=1NGijCxj(t)+a2j=1NGijΓxj(tτ2)+U,with isolated node networksdxi(t)dt=Dxi(t)+Ag(xi(t))+Bg(xi(tτ1))+U,where xi(t)=(xi,1(t),,xi,n(t))TRn denotes the state vector of the neurons in the ith neural networks, g(xi(t))=(g1(xi,1(t)),,gn(xi,n(t)))T, i=1,,N, D=diag(d1,,dn)>0,

Main results

Now we are in a position to state the main results of the research.

Theorem 3.1

Under Assumption2.1, if there exist positive definite diagonal matrices Pi=diag(p1i,p2i,,pni), Ri=diag(r1i,r2i,,rni), P¯j=diag(pj1,pj2,,pjN), Q¯j=diag(qj1,qj2,,qjN), positive diagonal matrices Q1i and Q2i, such that the following linear matrix inequalities hold simultaneously:Ψ1i=ΨiPiA+ΔQ1iPiB02Q1i002Q2iΔQ2iRi<0,Ψ2j=Q¯jdjP¯j+2a1cjP¯jGa2γjP¯jGQ¯j<0,then the coupled system (4) is globally stable, where Ψi=Ri0.5(Pi

Simulation example

In this section, we will use an illustrative example to show the effectiveness of the obtained result.

Example 4.1

Let us consider the following recurrent neural networks:dy(t)dt=Dy(t)+Ag(y(t))+Bg(y(tτ1))+I,where y(t)=(y1(t),y2(t))T is the state vector of neural networks, g(yi(t))=tanh(yi(t)) is the activation function, I=(10,10)T is the external input vector, D=120012, A=250.13., B=1.50.20.12.5.

Since M=D|A|Δ|B|Δ is an M-matrix, according to the stability result of Theorem 2 in [18], the

Conclusions

In this paper, we have established the global stability criteria for arrays of linearly coupled delayed neural networks with nonsymmetric coupling on the basis of LMI method. The derived results are two separate conditions, one is for the dynamics of the node networks and the other is for the coupling configuration. The outstanding feature of the proposed stability results is to bridge the gap of stability theory of recurrent neural networks and the synchronization stability of complex networks

Zhanshan Wang (M'09) received the M.S. degree in control theory and control engineering from Fushun Petroleum Institute (now Liaoning Shihua University), Fushun, China, in 2001. He received the Ph.D. degree in control theory and control engineering from Northeastern University, Shenyang, China, in 2006.

He is now a Professor in Northeastern University. His research interests include stability analysis of recurrent neural networks, fault diagnosis, fault tolerant control and nonlinear control.

References (47)

  • J. Wu et al.

    Synchronization in complex dynamical networks with nonsymmetric coupling

    Physica D

    (2008)
  • J. Wu et al.

    Observer-based synchronization in complex dynamical networks with nonsymmetric coupling

    Physica A

    (2007)
  • H. Gao et al.

    New criteria for synchronization stability of general complex dynamical networks with coupling delays

    Phys. Lett. A

    (2006)
  • K. Li et al.

    Synchronization stability of general complex dynamical networks with time-varying delays

    Phys. Lett. A

    (2008)
  • D. Yue et al.

    Synchronization stability of continuous/discrete complex dynamical networks with interval time-varying delays

    Neurocomputing

    (2010)
  • X. Nie et al.

    Multistability of competitive neural networks with time-varying and distributed delays

    Nonlinear AnalysisReal World Applications

    (2009)
  • C. Cheng et al.

    Multistability and convergence in delayed neural networks

    Physica D

    (2007)
  • J. Cao et al.

    Multistability and multiperiodicity of delayed Cohen–Grossberg neural networks with a general class of activation functions

    Physica D

    (2008)
  • J. Cao et al.

    Synchronization in an array of linearly stochastically coupled networks with time delays

    Physica A

    (2007)
  • J. Lu et al.

    Chaos synchronization of general complex dynamical networks

    Physica A

    (2004)
  • V. Perez-Munuzuri et al.

    Autowaves for image processing on a two-dimensional CNN array of excitable nonlinear circuitsflat and wrinkled labyrinths

    IEEE Trans. Circuits Syst. I

    (1993)
  • F. Hoppensteadt et al.

    Pattern recognition via synchronization in phase-locked loop neural networks

    IEEE Trans. Neural Networks

    (2000)
  • G. Chen et al.

    Global synchronization of coupled delayed neural networks and applications to chaos CNN models

    Int. J. Bifur. Chaos

    (2004)
  • Cited by (0)

    Zhanshan Wang (M'09) received the M.S. degree in control theory and control engineering from Fushun Petroleum Institute (now Liaoning Shihua University), Fushun, China, in 2001. He received the Ph.D. degree in control theory and control engineering from Northeastern University, Shenyang, China, in 2006.

    He is now a Professor in Northeastern University. His research interests include stability analysis of recurrent neural networks, fault diagnosis, fault tolerant control and nonlinear control.

    Huaguang Zhang (SM'04) received the B.S. degree and the M.S. degree in control engineering from Northeast Dianli University of China, Jilin City, China, in 1982 and 1985, respectively. He received the Ph.D. degree in thermal power engineering and automation from Southeast University, Nanjing, China, in 1991.

    He joined the Department of Automatic Control, Northeastern University, Shenyang, China, in 1992, as a Postdoctoral Fellow for 2 yr. Since 1994, he has been a Professor and Head of the Institute of Electric Automation, School of Information Science and Engineering, Northeastern University, Shenyang, China. His main research interests are neural networks based control, fuzzy control, stochastic system control, nonlinear control, and their applications.

    This work is supported by the National Natural Science Foundation of China under Grants 61074073 and 61034005, Program for New Century Excellent Talents in University of China under Grant NCET-10-0306, and the Fundamental Research Funds for the Central Universities under Grants N110504001 and N100104102.

    View full text