Elsevier

Automatica

Volume 45, Issue 10, October 2009, Pages 2358-2367
Automatica

Brief paper
Hopf bifurcation and oscillations in a communication network with heterogeneous delays

https://doi.org/10.1016/j.automatica.2009.06.012Get rights and content

Abstract

In this paper, we investigate stability, bifurcation and oscillations arising in a single-link communication network model with a large number of heterogeneous users adopting a Transmission Control Protocol (TCP)-like rate control scheme with an Active Queue Management (AQM) router. In the system considered, different user delays are known and fixed but taken from a given distribution. It is shown that for any given distribution of delays, there exists a critical amount of feedback (due to AQM) at which the equilibrium loses stability and a limit cycling solution develops via a Hopf bifurcation. The nature (criticality) of the bifurcation is investigated with the aid of Lyapunov–Schmidt perturbation method. The results of the analysis are numerically verified and provide valuable insights into dynamics of the AQM control system.

Introduction

This paper is concerned with stability, bifurcation and oscillations arising in the model of a single-link communication network with heterogeneous users adopting a Transmission Control Protocol (TCP)-like rate control scheme and a single Active Queue Management (AQM) router. Each user is assumed to follow a TCP-like additive-increase multiplicative-decrease (AIMD) flow control scheme, ẋi(t)=κ[1diβxi(t)xi(tdi)p(tdi)], where xiR+[0,) denotes the flow-rate for the ith-user, 0p1 is the observed rate of marking of its packets, di is the user specific delay and β is a non-negative parameter. The delay parameters di are assumed to be known and fixed but taken from a given distribution g(d). We refer to Srikant (2004) for a detailed discussion and justification of the model considered in this paper.

The packet marking occurs at the link whose dynamics are next described. If the aggregate sending rate of users exceeds the capacity C of the link, then the arriving packets are queued in the buffer q of the link. The non-negative queue size evolves according to the ODE q̇(t)={i=1Mxi(t)Cif 0<q<Qmax,min(0,i=1Mxi(t)C)if q=Qmax,max(0,i=1Mxi(t)C)if q=0, where we assume a maximum buffer size of Qmax at which the queue saturates. Any incoming packet after this point is dropped; cf. Hollot, Misra, Towsley, and Gong (2002). p() in (1) is set by the AQM control and takes the general form p=f(q), where f is a given monotonic function of queue length with the range [0,1].

In recent years, several studies have considered the issues of stability and bifurcation in simulations and models of communication networks (Firoiu and Borden, 2000, Raina et al., 2005, Ranjan et al., 2004, Veres and Boda, 2000). With simple fluid models, analytical methods including linear stability theory (Hollot et al., 2002), describing function methods (Han et al., 2005, Korkut, 2006), center manifold reduction (Ranjan & Abed, 2002), and normal form techniques (LI, Chen, Liao, & Yu, 2004) have been employed to investigate instability and bifurcation. Using these methods, a variety of bifurcation including Hopf bifurcation (Li et al., 2004, Raina, 2005, Ranjan and Abed, 2002), period doubling, and border-collision bifurcation (Ranjan and Abed, 2002, Ranjan et al., 2004) have been shown in models. Closely related to the topic of this paper is the work of Raina (2005), where local bifurcation results for a nonlinear delay differential equation model of communication network with a single discrete delay are described. Also related is Han et al. (2005) and Korkut (2006), where synchronization of TCP flows is studied by using a weakly coupled oscillator analogy.

The goal of this paper is to investigate the existence of an equilibrium and its bifurcation to non-equilibrium behavior vis-a-vis two important but complementary factors: (1) network delay and (2) network feedback. The heterogeneous user delays are modeled using distribution g(d) with spread (or variance proportional to) γ, and the parameter β is used to model the strength of feedback due to AQM queue. The stability and bifurcation results are described in the parameter space (β,γ).

The main analytical technique employed in this paper is to model user flow-rates xi(t) by functions x(t,di) of the delay parameter di. For a large number of users, the delays are taken from a continuous distribution g(d) and gives continuous approximation x(t,d) of the user flow-rates. For modeling purposes, the communication network model is expressed in terms of such a continuous approximation. There are three kinds of analysis reported here: (1) analysis of the equilibrium solution, (2) analysis of stability properties of the equilibrium solution via linearization of the dynamic model, and (3) analysis of bifurcation and subsequent nonlinear oscillations via the method of Lyapunov–Schmidt.

The linear analysis entails consideration of both the discrete and the continuous spectrum in terms of the problem parameters. It is shown that the continuous spectrum always lies in the left half complex plane so stability can be analyzed by examining only the discrete spectrum. Numerical analysis of discrete spectrum shows that a complex eigenvalue pair crosses the imaginary axis as the feedback strength parameter β is increased beyond a critical value. This suggests appearance of oscillations via a classical Hopf bifurcation and provides motivation for the nonlinear analysis.

The nonlinear analysis entails an analytic series expansion of the nonlinear oscillation solutions in terms of a small parameter ϵ. The unknown coefficients of the series are evaluated via a perturbation method based on Lyapunov–Schmidt reduction; cf., Ioose and Joseph (1980) and Kielhöfer (2003). The analysis leads to determination of the criticality of the Hopf bifurcation in terms of sign of a certain (Landau) coefficient. Validation results for both linear and the nonlinear analysis are presented using numerical simulations with the ODE model (1)–(2).

The remainder of the paper is organized as follows. Section 2 presents a summary of the numerical results with fluid model. These numerical results are explained with the aid of linear and nonlinear analysis presented in Sections 3 System equilibrium and stability, 4 Nonlinear analysis via a perturbation method, respectively. Section 5 presents an application of the methodology to investigate the effect of user delay distributions on instability in a single-link network. The conclusions appear in Section 6.

Section snippets

Numerical results

In this section, we summarize the results on the numerical study of Eqs. (1), (2). The delay parameters di are taken from a uniform distribution with support on [a(1γ),a(1+γ)], where a is the average value of the parameter, γ[0,1], and p(t) is taken to be a linear function of q. The simulations were carried out in MATLAB for parameter values given in Table 1; these values are consistent with earlier papers (see Alpcan, Wang, Mehta, and Basar (2008)). Numerically, there were two kinds of

System equilibrium and stability

In this section, we introduce the continuous approximation, obtain a formula for equilibrium, and study its stability via spectral analysis. The analysis shows that the equilibrium looses stability at a critical value of parameter β=β0. At the crossover point, the eigenvalue is imaginary suggesting the presence of Hopf bifurcation. This is pursued in detail in the following section.

Nonlinear analysis via a perturbation method

In this section, we present a perturbation method to obtain the oscillation solutions at and past the onset of instability. The method allows one to investigate the effect of parameters such as β and γ on the post-bifurcation behavior.

Network analysis

Fig. 5 depicts the results of nonlinear analysis–values of β2 and ω2–as a function of the network heterogeneity parameter γ; for parameter values in Table 1. The plots show that there is a qualitative change in bifurcation type (from supercritical to subcritical) as γ increases. Even in the supercritical regime, the small values of β2 indicate that there will be an abrupt transition to oscillations as is also confirmed by numerical results presented in Section 2.

Conclusion

The methodology presented in this paper allows one to quickly carry out a systematic study of dynamic behavior in a single-link network with a large number of users with heterogeneous delays. The results of nonlinear analysis, as a function of the network heterogeneity parameter γ, show that there is a qualitative change in bifurcation type (from supercritical to subcritical) as the parameter increases. Even in the supercritical regime, the small values of the Landau coefficient β2 indicates

Acknowledgements

The continuous approximation is inspired by the work of Joel Ariaratnam and Steve Strogatz who used such approximations in their study of large coupled oscillator networks (Ariaratnam & Strogatz, 2001). We are grateful to Tamer Basar for many useful discussions. Comments of an anonymous reviewer helped to improve this paper.

Huibing Yin received the B.E. degree in Automatic Control from the University of Science and Technology of China in 2003. He then went to study at Shanghai Institute of Technical Physics, Chinese Academy of Sciences and obtained the M.E. in Signal and Information Processing in 2006. He is now a Ph.D. student in the Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign. His research interests are in the analysis of nonlinear dynamics and optimization of

References (18)

  • T. Alpcan et al.

    A non-equilibrium analysis and control framework for active queue management

    Automatica

    (2008)
  • C. Li et al.

    Hopf bifurcation in an internet congestion control model

    Chaos, Solitons, and Fractals

    (2004)
  • Ariaratnam, J. (2002). Collective dynamics of the winfree model of coupled nonlinear oscillators. Ph.D. dissertation....
  • J.T. Ariaratnam et al.

    Phase diagram for the winfree model of coupled nonlinear oscillators

    Physical Review Letters

    (2001)
  • Firoiu, V., & Borden, M. (2000). A study of active queue management for congestion control. In Proc. IEEE...
  • J. Hale
  • Han, H., Hollot, C., Towsley, D., & Chait, Y. (2005). Synchronization of TCP flows in networks with small droptail...
  • C.V. Hollot et al.

    Analysis and design of controllers for AQM routers supporting TCP flows

    IEEE Transactions on Automatic Control

    (2002)
  • G. Iooss et al.
There are more references available in the full text version of this article.

Cited by (7)

  • Stability and Hopf bifurcation analysis of a TCP/RAQM network with ISMC procedure

    2019, Chaos, Solitons and Fractals
    Citation Excerpt :

    Furthermore, Hopf bifurcation is analyzed in queueing networks [25], Phase-Locked-Loop networks [26], wireless sensor networks [27], and bio-inspired neural networks with five neurons and discrete delays [28] or with three neurons in two layers [29] are made under consideration for Hopf bifurcation analysis. Many papers such as [14,30–33] and [34] have considered bifurcation in TCP/AQM networks with proportional controllers. They focused on the RTT value as the bifurcation parameter and demonstrated that when RTT is more than a critical value, the network is unstable.

  • An active queue management algorithm based on model effectiveness evaluation

    2019, Kongzhi Lilun Yu Yingyong/Control Theory and Applications
View all citing articles on Scopus

Huibing Yin received the B.E. degree in Automatic Control from the University of Science and Technology of China in 2003. He then went to study at Shanghai Institute of Technical Physics, Chinese Academy of Sciences and obtained the M.E. in Signal and Information Processing in 2006. He is now a Ph.D. student in the Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign. His research interests are in the analysis of nonlinear dynamics and optimization of interconnected and multiagent systems.

Paul Wang is currently working at IBM Corporation. He completed his Masters of Science and Bachelors of Science at the University of Illinois at Urbana-Champaign in 2007. His research interest involve non-equilibrium queue management. During his time at UIUC, he was also the recipient of the Lisle Abbott Rose Award (2007) from UIUC College of Engineering and the Pi Tau Sigma Sophomore Award (2005) from UIUC Department of Mechanical Science and Engineering. At IBM, he was the recipient of the Service Excellence Award of 2008.

Tansu Alpcan received the B.S. degree in electrical engineering from Bogazici University, Istanbul, Turkey in 1998. He received the M.S. and Ph.D. degrees in electrical and computer engineering from the University of Illinois at Urbana-Champaign (UIUC) in 2001 and 2006, respectively. His research interests include network security, game theory, control and optimization of wired and wireless communication networks, and resource allocation. He has received Fulbright scholarship in 1999 and best student paper award in IEEE Conference on Control Applications in 2003. Tansu has authored more than 60 journal and conference articles. He was an associate editor for IEEE Conference on Control Applications (CCA) in 2005 and has been a TPC member of several conferences including IEEE Infocom in 2007–2009. He has received Robert T. Chien Research Award from the UIUC Department of Electrical and Computer Engineering and Ross J. Martin Research Award from the UIUC College of Engineering in 2006. He cochaired the Workshop on Game Theory in Communication Networks (GameComm) in 2008 and was the publicity chair of GameNets 2009 conference. Tansu Alpcan has been a member of IEEE since 1998. He is currently a senior research scientist in Deutsche Telekom Laboratories, which is affiliated with Technische Universitat Berlin, Germany.

Prashant G. Mehta is an Assistant Professor at the Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign. He received his Ph.D. in Applied Mathematics from Cornell University in 2004. Prior to joining UIUC, he was a research engineer at the United Technologies Research Center (UTRC). At UTRC, he was recognized with an outstanding achievement award for his contributions in developing dynamical systems methods to obtain practical solutions to problems in aero-engines. His research interests are in dynamical systems and control including stochastic modeling and control of network problems, fundamental limitations in the control of non-equilibrium dynamic behavior, and multi-scale and symmetry-aided analyses of interconnected systems.

The material in this paper was partially presented at International Federation of Control (IFAC) World Congress, Seoul, Korea, July 2008. This paper was recommended for publication in revised form by Associate Editor Hideaki Ishii under the direction of Editor Ian R. Petersen.

1

Tel.: +49 30 8353 58452, +49 175 267 5169 (M); fax: +49 30 8353 58409.

View full text