Abstract
With live street videos posted online, the Macao Government provides means to the general public to assess the latest road traffic conditions. After reviewing over these videos, a person may decide to change the travel route from the one he or she initially plans to take. To let road users make decisions better and faster, it would be desirable to design an automated software, being a component of an Intelligent Transport System, which offers proper suggestions to the users instantly upon analyzing all available live videos. In this paper, we propose to create a real-time road traffic condition estimation system. Its design is based on a combination of deep learning algorithms: the YOLOv5, DeepSORT, and the Non-Maximum Suppression algorithms. Putting together the YOLOv5 with our proposed two-stage NMS strategy, the improvement on the efficiency of object detection on live videos is noticeable. Our two-stage strategy removes the requirement to manually tune the NMS parameters continuously. With DeepSORT, we are able to track moving vehicles, and create motion trajectories, which we can use filtering strategy to assess the latest road traffic conditions. Since different lanes on a road may have different traffic situations, we separate the lanes based on angles and propose to use a lane status score independently for each lane. Through the experimental results, our system design could estimate the traffic status in real-time without requiring any manual parametric adjustments.
The work was supported by The Science and Technology Development Fund, Macao SAR (File no. 0001/2018/AFJ).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Macao Transport Bureau: General traffic and land transport policy of MACAU (2011). http://www.dsat.gov.mo/ptt/pt/index.html. Accessed 30 May 2021
Macao Transport Bureau: Real-time road traffic videos (2021). http://www.dsat.gov.mo/dsat/realtime.aspx. Accessed 30 May 2021
Jocher, G., et al.: ultralytics/yolov5: v5.0 - YOLOv5-P6 1280 models, AWS, Supervisely and YouTube integrations (2021). https://doi.org/10.5281/zenodo.4679653
Lam, C., Gao, H., Ng, B.: A real-time traffic congestion detection system using on-line images. In: 2017 IEEE 17th International Conference on Communication Technology (ICCT), pp. 1548–1552 (2017)
Lam, C., Ng, B., Pun, I.: Analysis of traffic status using on-line traffic maps and real-time information of parking spaces. In: 2018 IEEE 18th International Conference on Communication Technology (ICCT), pp. 483–487 (2018)
Lam, C., Ng, B., Wang Chan, C.: Real-time traffic status detection from on-line images using generic object detection system with deep learning. In: 2019 IEEE 19th International Conference on Communication Technology (ICCT), pp. 1506–1510 (2019)
Redmon, J., Farhadi, A.: Yolov3: an incremental improvement. ArXiv abs/1804. 02767 (2018)
Bui, K.H.N., Yi, H., Cho, J.: A multi-class multi-movement vehicle counting framework for traffic analysis in complex areas using CCTV systems. Energies (2020)
Datondji, S.R.E., Dupuis, Y., Subirats, P., Vasseur, P.: A survey of vision-based traffic monitoring of road intersections. IEEE Trans. Intell. Transp. Syst. 17, 2681–2698 (2016)
Bochkovskiy, A., Wang, C.Y., Liao, H.: Yolov4: optimal speed and accuracy of object detection. ArXiv abs/2004.10934 (2020)
Redmon, J., Divvala, S., Girshick, R.B., Farhadi, A.: You only look once: unified, real-time object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 779–788 (2016)
Wojke, N., Bewley, A., Paulus, D.: Simple online and realtime tracking with a deep association metric. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3645–3649. IEEE (2017). https://doi.org/10.1109/ICIP.2017.8296962
Liu, S., Huang, D., Wang, Y.: Adaptive NMS: refining pedestrian detection in a crowd. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6452–6461 (2019)
Wojke, N., Bewley, A., Paulus, D.: Simple online and real-time tracking with a deep association metric. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3645–3649 (2017)
Bewley, A., Ge, Z., Ott, L., Ramos, F., Upcroft, B.: Simple online and real-time tracking. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3464–3468 (2016). https://doi.org/10.1109/ICIP.2016.7533003
Milan, A., Leal-Taixé, L., Reid, I., Roth, S., Schindler, K.: Mot16: a benchmark for multi-object tracking. ArXiv abs/1603.00831 (2016)
Zou, Z., Shi, Z., Guo, Y., Ye, J.: Object detection in 20 years: a survey. ArXiv abs/1905.05055 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Wang, L., Lam, C.T., Law, K.L.E., Ng, B., Ke, W., Im, M. (2022). Real-Time Traffic Monitoring and Status Detection with a Multi-vehicle Tracking System. In: Martins, A.L., Ferreira, J.C., Kocian, A. (eds) Intelligent Transport Systems. INTSYS 2021. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 426. Springer, Cham. https://doi.org/10.1007/978-3-030-97603-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-97603-3_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-97602-6
Online ISBN: 978-3-030-97603-3
eBook Packages: Computer ScienceComputer Science (R0)