Huy Khanh Hua
ABSTRACT
One of the most significant uses of autonomous cars in recent years is the detection of traffic light signals. Deep learning technology, which has a number of benefits including high detection accuracy and quick response to changes, is supporting the development of traffic light recognition under various environmental situations. In this paper, we use two methods to improve the traffic light detection and recognition method. First, we speed up training time by using the K-means clustering algorithm to compress image data. Second, a real time traffic light signal (red, yellow, green) identity based on the You Only Look Once (Yolov5) model is introduced. We utilised a variety of datasets including a freely available Roboflow dataset, a set of data obtained from Gazebo simulator, and a traffic light of CanTho city dataset to train and evaluate the proposed system. Furthermore, our algorithm was validated on a vehicle model in a simulated environment Gazebo of Robot Operating System 2 (ROS2).
- W.-C. S. Cheng-Chin, Ming-Che Ho, “Detecting and recognizing traffic lights by genetic approximate ellipse detection and spatial texture layouts,” ICIC 2011, 2011.Google Scholar
- T. H.-P. Tran, C. C. Pham, T. P. Nguyen, T. T. Duong, and J. W. Jeon, “Real-time traffic light detection using color density,” in 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia). IEEE, pp. 1–4, 2016.Google ScholarCross Ref
- J. Levinson, J. Askeland, J. Dolson, and S. Thrun, “Traffic light mapping, localization, and state detection for autonomous vehicles,” Int. Conf. on Robotics and Automation (ICRA), pp. 5784–5791, 2011.Google ScholarCross Ref
- Fitri Utaminingrum, Renaldi P. Prasetya, and Rizdania, "Combining Multiple Feature for Robust Traffic Sign Detection," Journal of Image and Graphics, Vol. 8, No. 2, pp. 53-58, June 2020.Google ScholarCross Ref
- J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.Google ScholarCross Ref
- Ryo Hasegawa, Yutaro Iwamoto, and Yen-Wei Chen, "Robust Japanese Road Sign Detection and Recognition in Complex Scenes Using Convolutional Neural Networks," Journal of Image and Graphics, Vol. 8, No. 3, pp. 59-66, September 2020.Google ScholarCross Ref
- W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.-Y. Fu, and A. C. Berg, “Ssd: Single shot multibox detector,” in European conference on computer vision. Springer, 2016.Google ScholarCross Ref
- Z. Gan, L. Wenju, C. Wanghui and S. Pan, "Traffic sign recognition based on improved YOLOv4," 2021 6th International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), 2021.Google Scholar
- F.-A. Redmon, Joseph, “Yolov3: An incremental improvement,” Tech. Rep., 2018.Google Scholar
- Cai Z.-X., Gu M.-Q. Accurate Recognition and State Estimation of Traffic Lights in Urban Environment. Control. Decis. 2014.Google Scholar
- Philipsen M.P., Jensen M.B., Møgelmose A., Moeslund T.B., Trivedi M.M. Traffic Light Detection: A Learning Algorithm and Evaluations on Challenging Dataset; Proceedings of the 2015 IEEE 18th International Conference on Intelligent Transportation Systems; Gran Canaria, Spain. 15–18 September 2015; Piscataway, NJ, USA: IEEE; 2015.Google Scholar
- Du X.-P., Li Y., Guo Y., Xiong H. Vision-Based Traffic Light Detection for Intelligent Vehicles; Proceedings of the 2017 4th International Conference on Information Science and Control Engineering; Changsha, China. 21–23 July 2017; Piscataway, NJ, USA: IEEE; 2017.Google ScholarCross Ref
- Behrendt K., Novak L., Botros R. A Deep Learning Approach to Traffic Lights: Detection, Tracking, and Classification; Proceedings of the 2017 IEEE International Conference on Robotics and Automation; Singapore. 29 May–3 June 2017; Piscataway, NJ, USA: IEEE; 2017.Google Scholar
- Pan W.-G., Chen Y.-H., Liu B., Shi H.-L. Detection and Recognition of Traffic Lights Based on Faster R-CNN. Transducer Microsyst. Technol. 2019;38:147–149.Google Scholar
- Pan W.-G., Chen Y.-H., Liu B., Shi H.-L. Detection and Recognition of Traffic Lights Based on Faster R-CNN. Transducer Microsyst. Technol. 2019.Google Scholar
- Morten B.J., Kamal N., Thomas B. Evaluating State-of-the-art Object Detector on Challenging Traffic Light Data; Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition; Honolulu, HI, USA. 21–26 July 2017.Google Scholar
- Muller J., Dietmayer K. Detecting Traffic Lights by Single Shot Detection; Proceedings of the 21st IEEE International Conference on Intelligent Transportation Systems; Maui, HI, USA. 4–7 November 2018; Piscataway, NJ, USA: IEEE; 2018.Google ScholarDigital Library
- Possatti L.C., Guidolini R., Cardoso V.B., Berriel R.F., Paixão T.M., Badue C., de Souza A.F., Oliveira-Santos T. Traffic Light Recognition Using Deep Learning and Prior Maps for Autonomous Cars; Proceedings of the 2019 International Joint Conference on Neural Networks; Budapest, Hungary. 14–19 July 2019.Google ScholarCross Ref
- Du L., Chen W., Fu S., Kong H., Li C., Pei Z. Real-time Detection of Vehicle and Traffic Light for Intelligent and Connected Vehicles Based on YOLOv3 Network; Proceedings of the 2019 5th International Conference on Transportation Information and Safety; Liverpool, UK. 14–17 July 2019.Google ScholarCross Ref
- Tran, T. H.-P., & Jeon, J. W. (2020). Accurate Real-Time Traffic Light Detection Using YOLOv4. 2020 IEEE International Conference on Consumer Electronics - Asia (ICCE-Asia). doi:10.1109/icce-asia49877.2020.Google ScholarCross Ref
- S. Wang , "K-Means Clustering With Incomplete Data," in IEEE Access, vol. 7, pp. 69162-69171, 2019.Google ScholarCross Ref
- Hoang Tran Ngoc and Luyl-Da Quach, “Adaptive Lane Keeping Assist for an Autonomous Vehicle based on Steering Fuzzy-PID Control in ROS” International Journal of Advanced Computer Science and Applications(IJACSA), 13(10), 2022.Google Scholar
Index Terms
- Traffic Lights Detection and Recognition Method using Deep Learning with Improved YOLOv5 for Autonomous Vehicle in ROS2
Recommendations
Deriving Pattern in Driver's Observability in Road Turns & Traffic Lights: Eye-Tracking based Analysis
C3VP '18: Proceedings of the 1st International Workshop on Communication and Computing in Connected Vehicles and PlatooningAs one move towards driverless cars, there will always be a big worry of how autonomous cars would behave in the presence of vehicles driven by humans. In the co-existence model, it is essential for autonomous systems to 'understand' the behavior and ...
Appearance-based Brake-Lights recognition using deep learning and vehicle detection
2016 IEEE Intelligent Vehicles Symposium (IV)Vehicle following is one of the fundamental functions of an autonomous driving system. Detection and recognition of tail light signal is important to prevent an autonomous vehicle from rear-end collisions or accidents. Although sensors like acoustic sonar ...
An automated hyperparameter tuned deep learning model enabled facial emotion recognition for autonomous vehicle drivers
AbstractThe progress of autonomous driving cars is a difficult movement that causes problems regarding safety, ethics, social acceptance, and cybersecurity. Currently, the automotive industry is utilizing these technologies to assist drivers ...
Highlights- Propose a deep learning based Facial Emotion Recognition for Autonomous Vehicle Drivers.
Comments