Abstract
This article explores the development of a Deep Reinforcement Learning (DRL) -based agent able to perform both path planning and trajectory execution, processing sensor perception information and directly controlling the steering wheel and the acceleration, like a normal driver. As a preliminary investigation, we limit our research to low-speed manoeuvers, in a challenging narrow drivable area. The vehicle’s agent completely relies on the real-time information from the sensors, thus avoiding the need of a map. We show the validity of the proposed system in a simulated car parking test, in which the agent has been able to achieve high target reach rates, with a limited number of manoeuvers (gear inversion rate), outperforming the well-established Hybrid A-Star path planning algorithm in both the metrics. Further research is needed for improving the generalization ability of the agent and its application in more dynamic driving environments.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Claussmann, L., Revilloud, M., Gruyer, D., Glaser, S.: A review of motion planning for highway autonomous driving. IEEE Trans. Intell. Transp. Syst. 21, 1826–1848 (2020). https://doi.org/10.1109/TITS.2019.2913998
Unity Technologies: Unity Real-Time Development Platform | 3D, 2D VR & AR Engine. https://unity.com/. Accessed 30 May 2022
Juliani, A., et al.: Unity: a general platform for intelligent agents (2020). http://arxiv.org/abs/1809.02627
Haarnoja, T., Zhou, A., Abbeel, P., Levine, S.: Soft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor. In: Proceedings of the 35th International Conference on Machine Learning, pp. 1861–1870. PMLR (2018)
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O.: Proximal policy optimization algorithms (2017). http://arxiv.org/abs/1707.06347
K, R.: Autonomous Car Parking using ML-Agents. https://medium.com/xrpractices/autonomous-car-parking-using-ml-agents-d780a366fe46. Accessed 27 May 2022
ShrineToLoud: Chevrolet Corvette 1980 Different colours. https://sketchfab.com/3d-models/chevrolet-corvette-1980-different-colours-7e428bdb3ab54b4e9ac610e545fd9d03. Accessed 30 May 2022
Bengio, Y., Louradour, J., Collobert, R., Weston, J.: Curriculum learning. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 41–48. Association for Computing Machinery, New York (2009). https://doi.org/10.1145/1553374.1553380
Nordeus, E.: Self Driving Vehicle. https://github.com/Habrador/Self-driving-vehicle. Accessed 10 June 2022
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lazzaroni, L., Bellotti, F., Capello, A., Cossu, M., De Gloria, A., Berta, R. (2023). Deep Reinforcement Learning for Automated Car Parking. In: Berta, R., De Gloria, A. (eds) Applications in Electronics Pervading Industry, Environment and Society. ApplePies 2022. Lecture Notes in Electrical Engineering, vol 1036. Springer, Cham. https://doi.org/10.1007/978-3-031-30333-3_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-30333-3_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-30332-6
Online ISBN: 978-3-031-30333-3
eBook Packages: EngineeringEngineering (R0)