Skip to main content
Springer Nature Link
Log in

Stochastic DP Based on Trained Database for Sub-optimal Energy Management of Hybrid Electric Vehicles

  • Conference paper
  • First Online:
Informatics in Control, Automation and Robotics (ICINCO 2017)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 495))

  • 1039 Accesses

Abstract

This paper presents a sub-optimal energy management strategy, based on Stochastic Dynamic Programming (SDP), for efficient powersplit of a Hybrid Electric Vehicle (HEV). An optimal energy management strategy is proposed, permitting to have simultaneous speed profile and powersplit optimization of the HEV. Formulated as a multi-objective optimization problem, an \(\epsilon \)-constraint method has been used to find the Pareto front of the energy optimization task. Traffic conditions and driver behavior could be assimilated to a stochastic nature, thus, it is proposed in this paper to address the vehicle power as Markov Decision Process. A Stochastic Database is used to store Transition Probability and Reward Matrices, corresponding to suitable vehicle actions w.r.t. specific states. They are used afterwards to calculate sub-optimal powersplit policy for the vehicle via an infinite-horizon SDP approach. Simulation results demonstrate the effectiveness of the proposed approach compared to a deterministic strategy given in [1]. The present work is conducted on a dedicated high-fidelity model of the HEV that was developed on MATLAB/TruckMaker software.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    http://www.businova.com

References

  1. Abdrakhmanov, R., Adouane, L.: Dynamic programming resolution and database knowledge for online predictive energy management of hybrid vehicles. In: International Conference on Informatics in Control, Automation and Robotics (ICINCO), Madrid-Spain (2017)

    Google Scholar 

  2. Abdrakhmanov, R., Adouane, L.: Efficient ACC with stop and go maneuvers for hybrid vehicle with online sub-optimal energy management. In: RoMoCo’17, 11th International Workshop on Robot Motion and Control, Wasowo-Poland, 3–5 July 2017

    Google Scholar 

  3. Angkititrakul, P., Miyajima, C., Takeda, K.: An improved driver-behavior model with combined individual and general driving characteristics. In: 2012 IEEE Intelligent Vehicles Symposium (IV), pp. 426–431. IEEE (2012)

    Google Scholar 

  4. Bayindir, K.Ç., Gözüküçük, M.A., Teke, A.: A comprehensive overview of hybrid electric vehicle: powertrain configurations, powertrain control techniques and electronic control units. Energy Convers. Manag. 52(2), 1305–1313 (2011)

    Google Scholar 

  5. Broussely, M., et al.: Main aging mechanisms in LI ion batteries. J. Power Sources 146(1), 90–96 (2005)

    Article  Google Scholar 

  6. Chen, B.C., Wu, Y.Y., Tsai, H.C.: Design and analysis of power management strategy for range extended electric vehicle using dynamic programming. Appl. Energy 113, 1764–1774 (2014)

    Article  Google Scholar 

  7. Cheng, Y., Lataire, P., et al.: Research and test platform for hybrid electric vehicle with the super capacitor based energy storage. In: 2007 European Conference on Power Electronics and Applications, pp. 1–10. IEEE (2007)

    Google Scholar 

  8. Choi, S.S., Lim, H.S.: Factors that affect cycle-life and possible degradation mechanisms of a LI-ion cell based on LICoO\(_{2}\). J. Power Sources 111(1), 130–136 (2002)

    Google Scholar 

  9. Dib, W., Chasse, A., Moulin, P., Sciarretta, A., Corde, G.: Optimal energy management for an electric vehicle in eco-driving applications. Control. Eng. Pract. 29, 299–307 (2014)

    Article  Google Scholar 

  10. Elbert, P., Widmer, M., Gisler, H.J., Onder, C.: Stochastic dynamic programming for the energy management of a serial hybrid electric bus. Int. J. Veh. Des. 69(1–4), 88–112 (2015)

    Article  Google Scholar 

  11. Haimes, Y.Y.: On a bicriterion formulation of the problems of integrated system identification and system optimization. IEEE Trans. Syst. Man Cybern. 1(3), 296–297 (1971)

    Google Scholar 

  12. Heppeler, G., Sonntag, M., Wohlhaupter, U., Sawodny, O.: Predictive planning of optimal velocity and state of charge trajectories for hybrid electric vehicles. Control. Eng. Pract. 61 (2016)

    Article  Google Scholar 

  13. Johannesson, L., Asbogard, M., Egardt, B.: Assessing the potential of predictive control for hybrid vehicle powertrains using stochastic dynamic programming. IEEE Trans. Intell. Transp. Syst. 8(1), 71–83 (2007)

    Article  Google Scholar 

  14. Kamal, E., Adouane, L., Abdrakhmanov, R., Ouddah, N.: Hierarchical and adaptive neuro-fuzzy control for intelligent energy management in hybrid electric vehicles. In: IFAC World Congress. Toulouse-France (2017)

    Google Scholar 

  15. Kim, T.S., Manzie, C., Sharma, R.: Model predictive control of velocity and torque split in a parallel hybrid vehicle. In: 2009 IEEE International Conference on Systems, Man and Cybernetics, SMC 2009, pp. 2014–2019. IEEE (2009)

    Google Scholar 

  16. Kitayama, S., Saikyo, M., Nishio, Y., Tsutsumi, K.: Torque control strategy and optimization for fuel consumption and emission reduction in parallel hybrid electric vehicles. Struct. Multidiscip. Optim. 52(3), 595–611 (2015)

    Article  Google Scholar 

  17. Larsson, H., Ericsson, E.: The effects of an acceleration advisory tool in vehicles for reduced fuel consumption and emissions. Transp. Res. Part D Transp. Environ. 14(2), 141–146 (2009)

    Article  Google Scholar 

  18. Li, L., Yang, C., Zhang, Y., Zhang, L., Song, J.: Correctional DP-based energy management strategy of plug-in hybrid electric bus for city-bus route. IEEE Trans. Veh. Technol. 64(7), 2792–2803 (2015)

    Article  Google Scholar 

  19. Lin, C.C., Peng, H., Grizzle, J.: A stochastic control strategy for hybrid electric vehicles. In: Proceedings of the 2004 American Control Conference, 2004, vol. 5, pp. 4710–4715. IEEE (2004)

    Google Scholar 

  20. Murphey, Y.L.: Intelligent vehicle power management: an overview. Computational Intelligence in Automotive Applications, pp. 169–190. Springer, Berlin (2008)

    Google Scholar 

  21. Ouddah, N., Adouane, L., Abdrakhmanov, R., Kamal, E.: Optimal energy management strategy of plug-in hybrid electric bus in urban conditions. In: International Conference on Informatics in Control, Automation and Robotics (ICINCO), Madrid-Spain (2017)

    Google Scholar 

  22. Ozatay, E., et al.: Cloud-based velocity profile optimization for everyday driving: a dynamic-programming-based solution. IEEE Trans. Intell. Transp. Syst. 15(6), 2491–2505 (2014)

    Article  Google Scholar 

  23. Pei, D., Leamy, M.J.: Dynamic programming-informed equivalent cost minimization control strategies for hybrid-electric vehicles. J. Dyn. Syst. Meas. Control. 135(5), 051,013 (2013)

    Article  Google Scholar 

  24. Puterman, M.L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, New Jersey (2014)

    Google Scholar 

  25. Romaus, C., Gathmann, K., Böcker, J.: Optimal energy management for a hybrid energy storage system for electric vehicles based on stochastic dynamic programming. In: 2010 IEEE Vehicle Power and Propulsion Conference (VPPC), pp. 1–6. IEEE (2010)

    Google Scholar 

  26. Rousseau, G.: Véhicule hybride et commande optimale. Ph.D. thesis, École Nationale Supérieure des Mines de Paris (2008)

    Google Scholar 

  27. Shen, D., Bensch, V., Miiller, S.: Model predictive energy management for a range extender hybrid vehicle using map information. IFAC-PapersOnLine 48(15), 263–270 (2015)

    Article  Google Scholar 

  28. Song, Z., Hofmann, H., Li, J., Han, X., Ouyang, M.: Optimization for a hybrid energy storage system in electric vehicles using dynamic programing approach. Appl. Energy 139, 151–162 (2015)

    Article  Google Scholar 

  29. Sun, C., Sun, F., Hu, X., Hedrick, J.K., Moura, S.: Integrating traffic velocity data into predictive energy management of plug-in hybrid electric vehicles. In: 2015 American Control Conference (ACC), pp. 3267–3272. IEEE (2015)

    Google Scholar 

  30. Tang, L., Rizzoni, G., Onori, S.: Energy management strategy for hevs including battery life optimization. IEEE Trans. Transp. Electrification 1(3), 211–222 (2015)

    Article  Google Scholar 

  31. Tian, H., Wang, X., Lu, Z., Huang, Y., Tian, G.: Adaptive fuzzy logic energy management strategy based on reasonable SOC reference curve for online control of plug-in hybrid electric city bus. IEEE Trans. Intell. Transp. Syst. (2017)

    Google Scholar 

  32. Tokekar, P., Karnad, N., Isler, V.: Energy-optimal trajectory planning for car-like robots. Auton. Robot. 37(3), 279–300 (2014)

    Article  Google Scholar 

  33. Tulpule, P., Marano, V., Rizzoni, G.: Effects of different phev control strategies on vehicle performance. In: 2009 American Control Conference, ACC’09, pp. 3950–3955. IEEE (2009)

    Google Scholar 

  34. Van Keulen, T., de Jager, B., Foster, D., Steinbuch, M.: Velocity trajectory optimization in hybrid electric trucks. In: Proceedings of the 2010 American Control Conference, pp. 5074–5079. IEEE (2010)

    Google Scholar 

  35. Van Keulen, T., de Jager, B., Kessels, J., Steinbuch, M.: Energy management in hybrid electric vehicles: benefit of prediction. IFAC Proc. Vol. 43(7), 264–269 (2010)

    Google Scholar 

  36. White, H.: Maximum likelihood estimation of misspecified models. Econ. J. Econ. Soc. 50(1), 1–25 (1982)

    Article  MathSciNet  Google Scholar 

  37. Zeng, X., Wang, J.: A stochastic driver pedal behavior model incorporating road information. IEEE Trans. Hum. Mach. Syst. 47(5), 614 (2017)

    Article  Google Scholar 

  38. Zhang, Y., Jiao, X., Li, L., Yang, C., Zhang, L., Song, J.: A hybrid dynamic programming-rule based algorithm for real-time energy optimization of plug-in hybrid electric bus. Sci. China Technol. Sci. 57(12), 2542–2550 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institut Pascal/IMobS3, UCA/SIGMA UMR CNRS 6602, Clermont-Ferrand, France

    Rustem Abdrakhmanov & Lounis Adouane

Authors
  1. Rustem Abdrakhmanov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lounis Adouane
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rustem Abdrakhmanov .

Editor information

Editors and Affiliations

  1. Ford Research and Advanced Engineering, Dearborn, MI, USA

    Oleg Gusikhin

  2. University of Paris-EST Créteil (UPEC), Vitry sur Seine, France

    Kurosh Madani

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Abdrakhmanov, R., Adouane, L. (2020). Stochastic DP Based on Trained Database for Sub-optimal Energy Management of Hybrid Electric Vehicles. In: Gusikhin, O., Madani, K. (eds) Informatics in Control, Automation and Robotics . ICINCO 2017. Lecture Notes in Electrical Engineering, vol 495. Springer, Cham. https://doi.org/10.1007/978-3-030-11292-9_12

Download citation

Publish with us

Policies and ethics