Skip to main content

Advertisement

Log in

On the stability radii of continuous-time infinite Markov jump linear systems

  • Original Article
  • Published:
Mathematics of Control, Signals, and Systems Aims and scope Submit manuscript

Abstract

In this paper we introduce the subject of stability radii for continuous-time infinite Markov jump linear systems (MJLS) with respect to unstructured perturbations. By means of the small-gain approach, a lower bound for the complex radius is derived along with a linear matrix inequality (LMI) optimization method which is new in this context. In this regard, we propose an algorithm to solve the optimization problem, based on a bisectional procedure, which is tailored in such a way that avoids the issue of scaling optimization. In addition, an easily computable upper bound for the real and complex stability radii is devised, with the aid of a spectral characterization of the problem. This seems to be a novel approach to the problem of robust stability, even when restricted to the finite case, which in turn allows us to obtain explicit formulas for the stability radii of two-mode scalar MJLS. We also introduce a connection between stability radii and a certain margin of stability with respect to perturbations on the transition rates of the Markov process. The applicability of the main results is illustrated with some numerical examples.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Boukas EK, Shi P, Benjelloun K (1999) On stabilization of uncertain linear systems with jump parameters. Int J Control 72(9): 842–850

    Article  MATH  MathSciNet  Google Scholar 

  2. Brewer JW (1978) Kronecker products and matrix calculus in system theory. IEEE Trans Circuits Syst 25(9): 772–781

    Article  MATH  MathSciNet  Google Scholar 

  3. Costa OLV, Fragoso MD, Marques RP (2005) Discrete-time Markov jump linear systems. Probability and its applications. Springer, New York

    Google Scholar 

  4. Dragan V, Morozan T (2002) Stability and robust stabilization to linear stochastic systems described by differential equations with Markovian jumping and multiplicative noise. Stoch Anal Appl 20(1): 33–92

    Article  MATH  MathSciNet  Google Scholar 

  5. El Bouhtouri A, El Hadri K (2000) Robust stabilization of jump linear systems subject to structured uncertainties in the state and input matrices. IMA J Math Control Inform 17: 281–293

    Article  MATH  MathSciNet  Google Scholar 

  6. El Bouhtouri A, El Hadri K (2003) Robust stabilization of jump linear systems with multiplicative noise. IMA J Math Control Inform 20(1): 1–19

    Article  MATH  MathSciNet  Google Scholar 

  7. El Bouhtouri A, El Hadri K (2006) Robust stabilization of discrete-time jump linear systems with multiplicative noise. IMA J Math Control Inform 23(4): 447–462

    Article  MATH  MathSciNet  Google Scholar 

  8. El Ghaoui L, Rami MA (1996) Robust state-feedback stabilization of jump linear systems via LMIs. Int J Robust Nonlinear Control 6(9/10): 1015–1022

    Article  MATH  MathSciNet  Google Scholar 

  9. Fragoso MD, Baczynski J (2001) Optimal control for continuous-time linear quadratic problems with infinite Markov jump parameters. SIAM J Control Optim 40: 270–297

    Article  MATH  MathSciNet  Google Scholar 

  10. Fragoso MD, Costa OLV (2005) A unified approach for stochastic and mean square stability of continuous-time linear systems with Markovian jumping parameters and additive disturbances. SIAM J Control Optim 44(4): 1165–1191

    Article  MATH  MathSciNet  Google Scholar 

  11. Hinrichsen D, Pritchard AJ (1986) Stability radii for linear systems. Syst Control Lett 7: 1–10

    Article  MATH  MathSciNet  Google Scholar 

  12. Hinrichsen D, Pritchard AJ (1990) Real and complex stability radii: a survey. In: Hinrichsen D, Mårtensson B (eds) Control of uncertain systems. Progress in system and control theory, vol 6. Springer, Basel, pp 119–162

    Google Scholar 

  13. Hinrichsen D, Pritchard AJ (1996) Stability radii of systems with stochastic uncertainty and their optimization by output feedback. SIAM J Control Optim 34: 1972–1998

    Article  MATH  MathSciNet  Google Scholar 

  14. Hinrichsen D, Pritchard AJ (2005) Mathematical systems theory I: modelling, state space analysis, stability and robustness. Texts in applied mathematics, vol 48. Springer, New York

    Google Scholar 

  15. Karan M, Shi P, Kaya CY (2006) Transition probability bounds for the stochastic stability robustness of continuous- and discrete-time Markovian jump linear systems. Automatica 42: 2159–2168

    Article  MATH  MathSciNet  Google Scholar 

  16. Morozan T (1998) Parametrized Riccati equations for controlled linear differential systems with jump Markov perturbations. Stoch Anal Appl 16(4): 661–682

    Article  MATH  MathSciNet  Google Scholar 

  17. Todorov MG, Fragoso MD (2007) Infinite Markov jump bounded real lemma. In: Proceedings of the 2007 American Control Conference, New York, USA, pp 317–322

  18. Todorov MG, Fragoso MD (2007) Output feedback robust stabilization of continuous-time infinite Markov jump linear systems. In: Proceedings of the 46th IEEE Conference on Decision & Control, New Orleans, USA, pp 3685–3690

  19. Todorov MG, Fragoso MD (2008) Infinite Markov jump bounded real lemma. Systems Control Lett 57(1): 64–70

    Article  MATH  MathSciNet  Google Scholar 

  20. Todorov MG, Fragoso MD (2008) On the stability radii of continuous-time Markov jump linear systems. In: Proceedings of the 2008 American Control Conference, Seattle, USA, pp 4621–4626

  21. Todorov MG, Fragoso MD (2008) Output feedback H control of continuous-time infinite Markovian jump linear systems via LMI methods. SIAM J Control Optim 47(2): 950–974

    Article  MATH  MathSciNet  Google Scholar 

  22. Van Loan C (1985) How near is a stable matrix to an unstable matrix?. Contemp Math 47: 465–478

    MathSciNet  Google Scholar 

  23. Xiong J, Lam J, Gao H, Ho DWC (2005) On robust stabilization of Markovian jump systems with uncertain switching probabilities. Automatica 41(5): 897–903

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marcelo Dutra Fragoso.

Additional information

A preliminary version of this paper was presented at the 2008 American Control Conference.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Todorov, M.G., Fragoso, M.D. On the stability radii of continuous-time infinite Markov jump linear systems. Math. Control Signals Syst. 22, 23–38 (2010). https://doi.org/10.1007/s00498-010-0046-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00498-010-0046-3

Keywords

Navigation