To read this content please select one of the options below:

Research on decision-making of autonomous vehicle following based on reinforcement learning method

Hongbo Gao (State Key Laboratory of Automotive Safety and Energy, Tsinghua University, Beijing, China)
Guanya Shi (California Institute of Technology, Pasadena, California, USA)
Kelong Wang (Beijing Green Steam Technology Co., Ltd, Beijing, China)
Guotao Xie (Hunan University, Changsha, Hunan, China)
Yuchao Liu (Tsinghua University, Beijing, China)

Industrial Robot

ISSN: 0143-991x

Article publication date: 3 May 2019

Issue publication date: 5 August 2019

550

Abstract

Purpose

Over the past decades, there has been significant research effort dedicated to the development of autonomous vehicles. The decision-making system, which is responsible for driving safety, is one of the most important technologies for autonomous vehicles. The purpose of this study is the use of an intensive learning method combined with car-following data by a driving simulator to obtain an explanatory learning following algorithm and establish an anthropomorphic car-following model.

Design/methodology/approach

This paper proposed car-following method based on reinforcement learning for autonomous vehicles decision-making. An approximator is used to approximate the value function by determining state space, action space and state transition relationship. A gradient descent method is used to solve the parameter.

Findings

The effect of car-following on certain driving styles is initially achieved through the simulation of step conditions. The effect of car-following initially proves that the reinforcement learning system is more adaptive to car following and that it has certain explanatory and stability based on the explicit calculation of R.

Originality/value

The simulation results show that the car-following method based on reinforcement learning for autonomous vehicle decision-making realizes reliable car-following decision-making and has the advantages of simple sample, small amount of data, simple algorithm and good robustness.

Keywords

Acknowledgements

This work was supported by China Postdoctoral Science Foundation Special Funded Projects under Grant No. 2018T110095, Project funded by China Postdoctoral Science Foundation under Grant No. 2017M620765, National Key Research and Development Program of China under Grant No. 2017YFB0102603, the Joint Funds of the National Natural Science Foundation of China under Grant No. U1804161, and Junior Fellowships for Advanced Innovation Think-tank Program of China Association for Science and Technology under Grant No.DXB-ZKQN-2017-035.

Citation

Gao, H., Shi, G., Wang, K., Xie, G. and Liu, Y. (2019), "Research on decision-making of autonomous vehicle following based on reinforcement learning method", Industrial Robot, Vol. 46 No. 3, pp. 444-452. https://doi.org/10.1108/IR-07-2018-0154

Publisher

:

Emerald Publishing Limited

Copyright © 2019, Emerald Publishing Limited

Related articles