Skip to main content

A Reinforcement Learning Modular Control Architecture for Fully Automated Vehicles

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 6928))

Abstract

This paper proposes a modular and generic architecture to deal with Global Chassis Control. Reinforcement learning is coupled with intelligent PID controllers and an optimal tire effort allocation algorithm to obtain a general, robust, adaptable, efficient and safe control architecture for any kind of automated wheeled vehicle.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Chou, H., D’Andréa-Novel, B.: Global vehicle control using differential braking torques and active suspension forces. Vehicle System Dynamics 43(4), 261–284 (2005)

    Article  Google Scholar 

  2. Fliess, M., Join, C.: Intelligent PID Controllers. In: Proc. of 16th Mediterrean Conf. on Control and Automation, Ajaccio, France (2008)

    Google Scholar 

  3. Ono, E., Hattoria, Y., Muragishia, Y., Koibuchi, K.: Vehicle dynamics integrated control for four-wheel-distributed steering and four-wheel-distributed traction/braking systems. Vehicle System Dynamics 44(2), 139–151 (2006)

    Article  Google Scholar 

  4. Poussot-Vassal, C., Sename, O., Dugard, L.: A LPV/H ∞  Global Chassis Controller for handling improvements involving braking and steering systems. In: IEEE 47th Conference on Decision and Control, pp. 5366–5371 (2008)

    Google Scholar 

  5. Suzumura, M., Fukatani, K., Asada, H.: Current State of and Prospects for the Vehicle Dynamics Integrated Management System (VDIM). Toyota Technical Review 55(222) (2007)

    Google Scholar 

  6. Svendenius, J., Gäfvert, M.: A semi-empirical dynamic tire model for combined-slip forces. Vehicle System Dynamics 44(2), 189–208 (2006)

    Article  Google Scholar 

  7. Tondel, P., Johansen, T.A.: Control allocation for yaw stabilization in automotive vehicles using multiparametric nonlinear programming. In: Proc. of the American Control Conference, June 8-10, pp. 453–458 (2005)

    Google Scholar 

  8. Villagra, J., d’Andrea-Novel, B., Mounier, H., Pengov, M.: Flatness-Based Vehicle Steering Control Strategy With SDRE Feedback Gains Tuned Via a Sensitivity Approach. IEEE Transactions on Control Systems Technology 15(3), 554–565 (2007)

    Article  Google Scholar 

  9. Villagra, J., Milanes, V., Pérez, J., de Pedro, T.: Control basado en pid inteligentes: Aplicación al control de crucero de un vehículo a bajas velocidades. Revista Iberoamericana de Automática e Informática Industrial 7(4), 44–52 (2010)

    Google Scholar 

  10. Wang, X.S., Cheng, Y.H., Sun, W.: A Proposal of Adaptive PID Controller Based on Reinforcement Learning. Journal of China University of Mining and Technology 17(1), 40–44 (2007)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Roberto Moreno-Díaz Franz Pichler Alexis Quesada-Arencibia

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Villagrá, J. et al. (2012). A Reinforcement Learning Modular Control Architecture for Fully Automated Vehicles. In: Moreno-Díaz, R., Pichler, F., Quesada-Arencibia, A. (eds) Computer Aided Systems Theory – EUROCAST 2011. EUROCAST 2011. Lecture Notes in Computer Science, vol 6928. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27579-1_50

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-27579-1_50

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-27578-4

  • Online ISBN: 978-3-642-27579-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics