Skip to main content

Indefinite LQ Optimal Control for Systems with Multiplicative Noises: The Incomplete Information Case

  • Conference paper

Part of the book series: Advances in Intelligent and Soft Computing ((AINSC,volume 104))

Abstract

The finite horizon indefinite LQ optimal output feedback control based on anti-noise materials for discrete time stochastic systems with state and control dependent multiplicative noises is considered. In the case of no standard Separation Theorem, a separation property in suboptimal sense holds as long as a generalized difference Riccati equation (GDRE) admits a solution. Then, the optimal output feedback control can be computed iteratively via a state feedback control problem and an estimation problem optimal with respect to each other. A completion of squares technique was used to derive the linear output feedback control, and an equivalent system transformation approach and the Kalman filter design method were used to obtain the recursive linear optimal state estimation algorithm.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   259.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kalman, R.E.: Contribution to the theory of optimal control. Bol. Soc. Mat. Mexicana (1960)

    Google Scholar 

  2. Anderson, B.D.O., Moore, J.B.: Optimal control: linear quadratic method. Prentice-Hall, Englewood Cliffs (1989)

    Google Scholar 

  3. Gerson, E., Shaked, U., Yaesh, I.: H ∞control and estimation of state-multiplicative linear system. LNCIS. Springer, London (2005)

    Google Scholar 

  4. EI Ghaoui, L.: State-feedback control of systems with multiplicative noise via Linear Matrix Inequalities, System and Control Letters. Elsevier, Amsterdam (2008)

    Google Scholar 

  5. Wonham, W.M.: Optimal stationary control of a linear system with state dependent noise. SIAM J. Control 5(3), 486–500 (1967)

    Article  MathSciNet  MATH  Google Scholar 

  6. Kleinman, D.L.: Optimal stationary control of a linear system with control dependent noise. IEEE Transaction on Automatic Control 14(6), 673–677 (1969)

    Article  MathSciNet  Google Scholar 

  7. Maclane, P.J.: Optimal stochastic control of linear systems with state and control dependent noises. IEEE Transaction on Automatic Control 16(6), 793–798 (1971)

    Article  Google Scholar 

  8. Todorov, E.: Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system. Neural computation (2005)

    Google Scholar 

  9. Chen, S., Li, X., Zhou, X.: Stochastic linear quadratic regulators with indefinite control weight costs. SIAM J. Control Optim. 36(5), 1685–1702 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  10. Chen, S., Yong, J.: Stochastic linear quadratic optimal control problems. In: Applied Mathematics & Optimization, vol. 43, pp. 21–45. Springer, Heidelberg (2001)

    Google Scholar 

  11. Hassibi, B., Sayed, A.H., Kailath, T.: Indefinite-quadratic estimation and control: a unified approach to H2 and H ∞ theories. SIAM, Philadelphia (1999)

    Google Scholar 

  12. Moore, J.B., Zhou, X.Y., Lim, A.E.B.: Discrete Time LQG Controls with Control Dependent Noise. System & Control Letters, 199–206 (1999)

    Google Scholar 

  13. Rami, M.A., Zhou, X.Y.: Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls. IEEE Transaction on Automatic Control 45(6), 1131–1143 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  14. Rami, M.A., Chen, X., Zhou, X.Y.: Discrete-time indefinite LQ control with state and control dependent noises. Journal of Global Optimization 23, 245–265 (2002)

    Article  MATH  Google Scholar 

  15. Wonham, W.M.: On the separation theorem of stochastic control. SIAM J Control 6(2), 312–326 (1968)

    Article  MathSciNet  MATH  Google Scholar 

  16. Davis, M.H.: Linear estimation and stochastic control. Chapman & Hall, London (1977)

    MATH  Google Scholar 

  17. Carravetta, F., Mavelli, G.: Suboptimal stochastic linear feedback control of linear systems with state-and control-dependent noise-the: incomplete information case. Automatica 43, 751–757 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  18. Anderson, B., Moore, J.B., Eslami, M.: Optimal filtering. Prentice-Hall, Englewood Cliffs (1979)

    MATH  Google Scholar 

  19. Joshi, S.M.: On optimal control of linear systems in the presence of multiplicative noise. IEEE Transaction on Aerospace and Electronic Systems, 80-85 (1976)

    Google Scholar 

  20. Carravetta, F., Germani, A., Raimondi, M.: Polynomial Filtering for Linear Discrete Time Non-Gaussian Systems. SIAM Journal on Control and Optimization 34(5), 1666–1690 (1996)

    Article  MathSciNet  MATH  Google Scholar 

  21. Carravetta, F., Germani, A., Shuakayev, M.K.: A new suboptimal approach to the filtering problem for bilinear stochastic differential systems. SIAM J. Control Optim. 28, 966–979 (1990)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Xing, G., Zhang, C., Cui, P., Zhao, H. (2011). Indefinite LQ Optimal Control for Systems with Multiplicative Noises: The Incomplete Information Case. In: Jin, D., Lin, S. (eds) Advances in Computer Science, Intelligent System and Environment. Advances in Intelligent and Soft Computing, vol 104. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23777-5_60

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-23777-5_60

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-23776-8

  • Online ISBN: 978-3-642-23777-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics