Abstract
One of the essential tasks for Autonomous Driving and Driving Assistance systems is the detection and tracking of Vulnerable Road Users (VRU) and traffic objects. Many recent developments in this area have been leveraging Deep Learning techniques. However, these Deep Learning models require heavy computational power. For this reason, optimising software components coupled with adequate hardware choices is crucial in the development of a system that can infer in real-time. This paper proposes solutions for object detection and tracking in an Autonomous Driving scenario by comparing and exploring the applicability of different State-of-the-art object detectors trained on the BDD100K dataset, namely YOLOv5, Scaled-YOLOv4 and YOLOR. In addition, the paper explores the deployment of these algorithms on Edge Devices, more specifically, the NVIDIA Jetson AGX Xavier. Furthermore, it examines the use of the DeepStream technology for real-time inference by comparing different object trackers, such as NvDCF and DeepSORT, in the KITTI tracking dataset. The proposed solution considers a YOLOR-CSP architecture with a DeepSORT tracker running at 33.3 FPS with a detection interval of one and 17 FPS with an interval of one.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Akyol, G., Kantarcı, A., Çelik, A.E., Cihan Ak, A.: Deep learning based, real-time object detection for autonomous driving. In: 2020 28th Signal Processing and Communications Applications Conference (SIU), pp. 1–4 (2020)
Baradaran Khalkhali, M., Vahedian, A., Sadoghi Yazdi, H.: Vehicle tracking with kalman filter using online situation assessment. Robot. Auton. Syst. 131, 103596 (2020)
Bernardin, K., Elbs, A., Stiefelhagen, R.: Multiple object tracking performance metrics and evaluation in a smart room environment. In: Sixth IEEE International Workshop on Visual Surveillance, in conjunction with ECCV, vol. 90(91). Citeseer (2006)
Bewley, A., Ge, Z., Ott, L., Ramos, F., Upcroft, B.: Simple online and realtime tracking. In: 2016 IEEE International Conference on Image Processing (ICIP). IEEE, Sep 2016
Jonathon Luiten, A.H.: Trackeval (2020). https://github.com/JonathonLuiten/TrackEval
Luiten, J., et al.: HOTA: A higher order metric for evaluating multi-object tracking. Int. J. Comput. Vision 129(2), 548–578 (2020)
Kavitha, R., Nivetha, S.: Pothole and object detection for an autonomous vehicle using yolo. In: 2021 5th International Conference on Intelligent Computing and Control Systems (ICICCS), pp. 1585–1589 (2021)
Sarda, A., Dixit, S., Bhan, A.: Object detection for autonomous driving using yolo [you only look once] algorithm. In: 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), pp. 1370–1374 (2021)
Wang, C.-Y., Bochkovskiy, A., Liao, H.-Y.M.: Scaled-yolov4: Scaling cross stage partial network. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 13029–13038, Jun 2021
Wang, C.-Y., Yeh, I.-H., Liao, H.-Y.M:. You only learn one representation: Unified network for multiple tasks. arXiv preprint arXiv:2105.04206 (2021)
Wang, Y., Yang, H.: Multi-target pedestrian tracking based on yolov5 and deepsort. In: 2022 IEEE Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC), pp. 508–514 (2022)
Wojke, N., Bewley, A., Paulus, D.: Simple online and realtime tracking with a deep association metric. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3645–3649 (2017)
Xiao, B., Guo, J., He, Z.: Real-time object detection algorithm of autonomous vehicles based on improved yolov5s. In: 2021 5th CAA International Conference on Vehicular Control and Intelligence (CVCI), pp. 1–6 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Azevedo, P., Santos, V. (2023). YOLO-Based Object Detection and Tracking for Autonomous Vehicles Using Edge Devices. In: Tardioli, D., Matellán, V., Heredia, G., Silva, M.F., Marques, L. (eds) ROBOT2022: Fifth Iberian Robotics Conference. ROBOT 2022. Lecture Notes in Networks and Systems, vol 589. Springer, Cham. https://doi.org/10.1007/978-3-031-21065-5_25
Download citation
DOI: https://doi.org/10.1007/978-3-031-21065-5_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-21064-8
Online ISBN: 978-3-031-21065-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)