Abstract
In this paper, the implementation of image recognition for traffic light signal recognition system is demonstrated. The detection of traffic light signal is an essential step for a self-driving car. Here we present a method for the recognition of traffic lights using image processing and controlling the vehicle accordingly. The algorithm developed in this research work is tested and processed using a Raspberry Pi board. The input-output modules such as camera, motors and chassis of the model car are all integrated together so they can perform as a single unit. For processing the image on real-time, OpenCV is used as an API to perform essential steps in the detection of signal like capturing, resizing, thresholding and morphological operations. Contour detection on a binary image has further been used for object detection. The algorithm has been tested with Valgrind profiling tools Callgrind and Cachegrind.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Jensen, M.B., Philipsen, M.P., Møgelmose, A., Moeslund, T.B., Trivedi, M.M.: Vision for looking at traffic lights: issues, survey, and perspectives. In: IEEE Transactions on Intelligent Transportation Systems (2015)
Williams, C.: Stop lights, sunsets, junctions are tough work for Google’s robo-cars (2016). https://www.theregister.co.uk/2016/08/24/google_self_driving_car_problems/
Lee, U., et al.: EureCar turbo: a self-driving car that can handle adverse weather conditions. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, pp. 2301–2306 (2016)
Yu, C., Huang, C., Lang, Y.: Traffic light detection during day and night conditions by a camera. In: IEEE 10th International Conference on Signal Processing Proceedings, Beijing, pp. 821–824 (2010)
Campbell, J., Amor, H.B., Ang, M.H., Fainekos, G.: Traffic light status detection using movement patterns of vehicles. In: 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), Rio de Janeiro, pp. 283–288 (2016)
Shi, Z., Zou, Z., Zhang, C.: Real-time traffic light detection with adaptive background suppression filter. IEEE Trans. Intell. Transp. Syst. 17(3), 690–700 (2016)
John, V., Yoneda, K., Liu, Z., Mita, S.: Saliency map generation by the convolutional neural network for real-time traffic light detection using template matching. IEEE Trans. Comput. Imaging 1(3), 159–173 (2015)
Michael, M., Schlipsing, M.: Extending traffic light recognition: efficient classification of phase and pictogram. In: 2015 International Joint Conference on Neural Networks (IJCNN), Killarney, pp. 1–8 (2015)
Suzuki, S., Abe, K.: Topological structural analysis of digitized binary images by border following. Comput. Vision Graph. Image Proc. 30(1), 32–46 (1985). http://dx.doi.org/10.1016/0734-189X(85)90016-7, ISSN 0734-189X
Fisher, R., Perkins, S., Walker, A., Wolfart, E.: Mathematical morphology. http://homepages.inf.ed.ac.uk/rbf/HIPR2/matmorph.htm
Najman, L., Talbot, H.: Mathematical morphology, 1st edn. ISTE, London (2010)
Fisher, R., Perkins, S., Walker, A., Wolfart, E.: Morphology. http://homepages.inf.ed.ac.uk/rbf/HIPR2/morops.htm
Tutorial: mathematical morphology. https://clouard.users.greyc.fr/Pantheon/experiments/morphology/index-en.html
Chanda, B., Majumder, D.: Digital image processing and analysis, 1st edn. Prentice-Hall of India, New Delhi (2007)
Fisher, R., Perkins, S.,Walker, A., Wolfart, E.: Median filter. http://homepages.inf.ed.ac.uk/rbf/HIPR2/median.htm
Huang, T., Yang, G., Tang, G.: A fast two-dimensional median filtering algorithm. IEEE Trans. Acoust. Speech Signal Process. 27(1), 13–18 (1979)
Wang, R.: Median Filter. http://fourier.eng.hmc.edu/e161/lectures/smooth_sharpen/node2.html
Median Filtering. http://users.ecs.soton.ac.uk/msn/book/new_demo/median/
Remove noise using an averaging filter and a median filter. https://www.mathworks.com/examples/image/mw/images-ex74217292-remove-noise-using-an-averaging-filter-and-a-median-filter
Viola, P., Jones, M.: Robust real-time face detection. In: Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, pp. 747–747 (2001)
Diaz-Cabrera, M., Cerri, P., Sanchez-Medina, J.: Suspended traffic lights detection and distance estimation using color features. In: 2012 15th International IEEE Conference on Intelligent Transportation Systems, Anchorage, AK, pp. 1315–1320 (2012)
Krizhevsky, A., Sutskever, I., Hinton, G. E.: ImageNet classification with deep convolutional neural networks. In: Proceedings of NIPS, pp. 1097–1105 (2012)
Philipsen, M.P., Jensen, M.P., Møgelmose, A., Moeslund, T.B., Trivedi., M.M.: Learning based traffic light detection: evaluation on challenging dataset. In: 18th IEEE Intelligent Transportation Systems Conference (2015)
Li, Y., Møgelmose, A., Trivedi, M.M.: Pushing the “Speed Limit”: high-accuracy US traffic sign recognition with convolutional neural networks. IEEE Trans. Intell. Veh. 1(2), 167–176 (2016)
Wang, Z.: Self driving RC car. https://zhengludwig.wordpress.com/projects/self-driving-rc-car/
Online diagram software to draw flowcharts, UML & more. Creately. http://www.creately.com
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Agarwal, N., Sharma, A., Chang, J.R. (2018). Real-Time Traffic Light Signal Recognition System for a Self-driving Car. In: Thampi, S., Krishnan, S., Corchado Rodriguez, J., Das, S., Wozniak, M., Al-Jumeily, D. (eds) Advances in Signal Processing and Intelligent Recognition Systems. SIRS 2017. Advances in Intelligent Systems and Computing, vol 678. Springer, Cham. https://doi.org/10.1007/978-3-319-67934-1_24
Download citation
DOI: https://doi.org/10.1007/978-3-319-67934-1_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-67933-4
Online ISBN: 978-3-319-67934-1
eBook Packages: EngineeringEngineering (R0)