Abstract
Evidently, Intelligent Transport System (ITS) has progressed tremendously all its way. The core of ITS are detection and recognition of traffic sign, which are designated to fulfill safety and comfort needs of driver. This paper provides a critical review on three major steps in Automatic Traffic Sign Detection and Recognition(ATSDR) system i.e., segmentation, detection and recognition in the context of vision based driver assistance system. In addition, it focuses on different experimental setups of image acquisition system. Further, discussion on possible future research challenges is made to make ATSDR more efficient, which inturn produce a wide range of opportunities for the researchers to carry out the detailed analysis of ATSDR and to incorporate the future aspects in their research.
Similar content being viewed by others
References
Abukhait J, Abdel-Qader I, Oh J-S, Abudayyeh O (2012) Road sign detection and shape recognition invariant to sign defects. In: EIT. USA, pp 1–6
Barnes N, Zelinsky A (2004) Real-time radial symmetry for speed sign detection. In: IEEE intelligent vehicles symposium. Italy, pp 566–571
Barnes N, Zelinsky A, Fletcher L (2008) Real-time speed sign detection using the radial symmetry detector. IEEE Trans Intell Transp Syst 9(2):322–332
Baró X, Escalera S, Vitrià J, Pujol O, Radeva P (2009) Traffic sign recognition using evolutionary adaboost detection and forest-ecoc classification. IEEE Trans Intell Transp Syst 10(1):113–126
Belaroussi R, Tarel J-P (2009) Angle vertex and bisector geometric model for triangular road sign detection. In: WACV. USA, pp 1–7
Belaroussi R, Tarel J-P (2009) A real-time road sign detection using bilateral chinese transform. In: ISVC (2). Las Vegas, pp 1161–1170
Belaroussi R, Foucher P, Tarel J-P, Soheilian B, Charbonnier P, Paparoditis N (2010) Road sign detection in images: a case study. In: ICPR. Istanbul, pp 484–488
Benallal M, Meunier J (2003) Real-time color segmentation of road signs. In: CCECE, pp 1823–1826
Boumediene M, Cudel C, Basset M, Ouamri A (2013) Triangular traffic signs detection based on rsld algorithm. Mach Vis Appl 24(8):1721–1732
Cardarelli E, Medici P, Porta P P, Ghisio G (2009) Road signs shapes detection based on sobel phase analysis. In: Procs.IEEE intelligent vehicles symposium. Xian, pp 376–381
Chiang H-H, Chen Y-L, Wang W-Q, Lee T-T (2010) Road speed sign recognition using edge-voting principle and learning vector quantization network. In: ICS. Taiwan, pp 246–251
Creusen I, Wijnhoven R G J, Herbschleb E, de With P (2010) Color exploitation in hog-based traffic sign detection. In: Proc IEEE ICIP. Hong Kong, pp 2669–2672
de la Escalera A, Armingol JM, Mata M (2003) Traffic sign recognition and analysis for intelligent vehicles. Image Vis Comput 21(3):247–258
de la Escalera A, Armingol JM, Pastor JM, Rodríguez FJ (2004) Visual sign information extraction and identification by deformable models for intelligent vehicles. IEEE Trans Intell Transp Syst 5(2):57–68
Eichner M L, Breckon T (2008) Integrated speed limit detection and recognition from real-time video. In: Proc. IEEE intelligent vehicles symposium. Eindhoven, pp 626–631
Fang C-Y, Chen S-W, Fuh C-S (2003) Road-sign detection and tracking. IEEE T Veh Technol 52(5):1329–1341
Fleyeh H (2006) Shadow and highlight invariant colour segmentation algorithm for traffic signs. In: IEEE conf. on cybernetics and intelligent systems. Bangkokl, pp 1–7
Fleyeh H, Dougherty M, Aenugula D, Baddam S (2007) Invariant road sign recognition with fuzzy artmap and zernike moments. In: IEEE intelligent vehicles symposium, istanbul. Turkey, pp 31–36
Fleyeh H, Dougherty M (2008) Traffic sign classification using invariant features and support vector machines. In: Procs. IEEE intelligent vehicles symposium. Netherlands, pp 530–535
Fleyeh H (2009) Traffic signs database
Fleyeh H, Davami E (2011) Eigen-based traffic sign recognition. IET Intell Transp Syst 5(3):190–196
Gao X W, Podladchikova L, Shaposhnikov D, Hong K, Shevtsova N (2006) Recognition of traffic signs based on their colour and shape features extracted using human vision models. J Vis Commun Image Represent 17(4):675–685
Gao XW, Hong K, Passmore P, Podladchikova L, Shaposhnikov D (2008) Colour vision model-based approach for segmentation of traffic signs. EURASIP J Image Video Process 2008(386705):1–7
Gao X (2011) A collection of benchmark images for traffic sign research. In: ICDSP. Corfu, pp 1–6
Ghica R, Lu S, Yuan X (1994) Recognition of traffic signs using a multilayer neural network. In: Proceedings of the Canadian conference on electrical and computer engineering
Gil-Jimenez P, Gomez-Moreno H, Siegmann P, Lafuente-Arroyo S, Maldonado-Bascon S (2007) Traffic sign shape classification based on support vector machines and the FFT of the signature of blobs. In: IEEE intelligent vehicles symposium. Istanbul, pp 375–380
Gil Jiménez P, Bascón S M, Moreno H G, Arroyo S L, Ferreras F L (2008) Traffic sign shape classification and localization based on the normalized fft of the signature of blobs and 2d homographies. Signal Process 88(12):2943–2955
Gómez-Moreno H, Maldonado-Bascón S, Gil-Jiménez P, Lafuente-Arroyo S (2010) Goal evaluation of segmentation algorithms for traffic sign recognition. IEEE Trans Intell Transp Syst 11(4):917– 930
Greenhalgh J, Mirmehdi M (2012) Real-time detection and recognition of road traffic signs. IEEE Trans Intell Transp Syst 13(4):1498–1506
Grigorescu C, Petkov N (2003) Distance sets for shape filters and shape recognition. IEEE Trans Image Process 12(10):1274–1286
Gu Y, Yendo T, Tehrani M P, Fujii T, Tanimoto M (2010) A new vision system for traffic sign recognition. In: IEEE intelligent vehicles symposium. USA, pp 7–12
Gu Y, Yendo T, Tehrani M P, Fujii T, Tanimoto M (2011) Traffic sign detection in dual-focal active camera system. In: IEEE intelligent vehicles symposium. Germany, 1054–1059
Gudigar A, Jagadale B, Mahesh P K, Raghavendra U (2012) Kernel based automatic traffic sign detection and recognition using svm. In: Eco-friendly computing and communication systems, ser. CCIS, vol 305. India, pp 153–161
Han L, Ding L, Qi L (2002) Real-time recognition of road traffic sign in moving scene image using genetic algorithm. In: Proc. 1st. int. conf. mach.learn. cybern, vol 2, pp 83–86
Houben S (2011) A single target voting scheme for traffic sign detection. In: IEEE intelligent vehicles symposium. Germany, pp 124–129
Hsu S-H, Huang C-L (2001) Road sign detection and recognition using matching pursuit method. Image Vis Comput 19(3):119–129
Ishizuka Y, Hirai Y (2004) Segmentation of road sign symbols using opponent-color filters. In: Proc. ITSWC2004. Nagoya, pp 18–24
Janssen H Method and device for traffic sign recognition and navigation, May 6 2003, uS Patent 6,560,529. [Online]. Available: http://www.google.com/patents/US6560529
Kastner R, Michalke T, Burbach TJ, Fritsch T, Goerick C (2010) Attention-based traffic sign recognition with an array of weak classifiers. In: IEEE intelligent vehicles symposium. USA, pp 333–339
Keller C G, Sprunk C, Bahlmann C, Giebel J, Baratoff G (2008) Real-time recognition of u.s. speed signs. In: IEEE IV intelligent vehicles symposium. Netherlands, pp 518–523
Khan J F, Bhuiyan S M A, Adhami R R (2011) Image segmentation and shape analysis for road-sign detection. IEEE Trans Intell Transp Syst 12(1):83–96
Kiran CG, Prabhu LV, Abdu RV, Rajeev K (2009) Traffic sign detection and pattern recognition using support vector machine. In: ICAPR. India, pp 87–90
Koncar A, Janíen H, Halgamuge S (2007) Gabor wavelet similarity maps for optimising hierarchical road sign classifiers. Pattern Recogn Lett 28(2):260–267
Kuo W-J, Lin C-C (2007) Two-stage road sign detection and recognition. In: IEEE international conference on multimedia and expo. Beijing, pp 1427–1430
Kus M, Gokmen M, Etaner-Uyar S (2008) Traffic sign recognition using scale invariant feature transform and color classification. In: ISCIS. Istanbul, pp 1–6
Larsson F, Felsberg M (2011) Using fourier descriptors and spatial models for traffic sign recognition. In: SCIA, ser. Lecture Notes in Computer Science, vol 6688. Springer, pp 238–249
Li Y, Pankanti S, Guan W (2010) Real-time traffic sign detection: an evaluation study. In: ICPR. Istanbul, pp 3033–3036
Loy G B, Barnes N M (2004) Fast shape-based road sign detection for a driver assistance system. In: IROS. Japan, pp 70–75
Lu K, Ding Z, Ge S (2012) Sparse-representation-based graph embedding for traffic sign recognition. IEEE Trans Intell Transp Syst 13(4):1515–1524
Maldonado-Bascón S, Lafuente-Arroyo S, Gil-Jiménez P, Gómez-Moreno H, López-Ferreras F (2007) Road-sign detection and recognition based on support vector machines. IEEE Trans Intell Transp Syst 8(2):264–278
Maldonado Bascón S, Acevedo Rodríguez J, Lafuente Arroyo S, Fernndez Caballero A, López-Ferreras F (2010) An optimization on pictogram identification for the road-sign recognition task using svms. Comput Vis Image Underst 114 (3):373–383
Mathias M, Timofte R, Benenson R, Van Gool L (2013) Traffic sign recognition - how far are we from the solution? In: IJCNN. USA, pp 1–8
Miura J, Kanda T, Shirai Y (2000) An active vision system for real-time traffic sign recognition. In: IEEE intelligent tranportion symposium. Dearborn, pp 52–57
Mogelmose A, Trivedi M M, Moeslund T B (2012) Vision-based traffic sign detection and analysis for intelligent driver assistance systems: perspectives and survey. IEEE Trans Intell Transp Syst 13(4):1484–1497
Nguwi Y-Y, Kouzani AZ (2008) Detection and classification of road signs in natural environments. Neural Comput Appl 17(3):265–289
Paclík P, Novovicová J, Pudil P, Somol P (2000) Road sign classification using laplace kernel classifier. Pattern Recog Lett 21(13-14):1165–1173
Paclík P, Novovicová J, Duin RPW (2006) Building road-sign classifiers using a trainable similarity measure. IEEE Trans Intell Transp Syst 7(3):309–321
Parada-Loira F, Alba-Castro J L (2010) Local contour patterns for fast traffic sign detection. In: IEEE intelligent vehicles symposium. San Diego, pp 1–6
Pazhoumand-dar H, Yaghoobi M (2013) A new approach in road sign recognition based on fast fractal coding. Neural Comput Appl 22(3–4):615–625
Piccioli G, Micheli E D, Parodi P, Campani M (1996) Robust method for road sign detection and recognition. Image Vis Comput 14(3):209–223
Priese L, Klieber J, Lakmann R, Rehrmann V, Schian R (1994) New results on traffic sign recognition. In: IEEE the intelligent vehicles symposium. Paris, pp 249–254
Porikli F, Ruta A Method for recognizing traffic signs, Oct. 18 2011, uS Patent 8,041,080. [Online]. Available: http://www.google.co.in/patents/US8041080
Ritter W, Stein F, Janssen R (1995) Traffic sign recognition using colour information. Math Comput Model 22(4–7):149–161
Ruta A, Li Y, Liu X (2010) Real-time traffic sign recognition from video by class-specific discriminative features. Pattern Recogn 43(1):416–430
Ruta A, Porikli F, Shintaro W, Li Y (2011) In-vehicle camera traffic sign detection and recognition. Mach Vis Appl 22(2):359–375
Segu M, Prieto, Allen A R (2009) Using self-organising maps in the detection and recognition of road signs. Image Vision Comput 27(6):673–683
Soetedjo A., Yamada K (2007) A new approach on red color thresholding for traffic sign recognition system. J Japan Soc Fuzzy Theory Intell Inform 19(5):457–465
Souani C, Faiedh H, Besbes K (2014) Efficient algorithm for automatic road sign recognition and its hardware implementation. J Real-Time Image Process 9(1):79–93
Stallkamp J, Schlipsing M, Salmen J, Igel C (2011) The german traffic sign recognition benchmark: A multi-class classification competition. In: IJCNN. USA, pp. 1453–1460
Stallkamp J, Schlipsing M, Salmen J, Igel C (2012) Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition. Neural Netw 32:323–332
Stein G P, Gdalyahu Y, Shashua A (2010) Stereo-assist: top-down stereo for driver assistance systems. In: Intelligent vehicles symposium. USA, pp 723–730
Stein G, Shachar O, Taieb Y, Wolfovitz U Detecting and recognizing traffic signs, Nov. 22 2011, uS Patent 8,064,643. [Online]. Available: http://www.google.co.in/patents/US8064643
Stromme O Automatic traffic sign recognition, Nov. 2 2004, uS Patent 6,813,545. [Online]. Available: http://www.google.com/patents/US6813545
Timofte R, Zimmermann K, Gool L J V (2009) Multi-view traffic sign detection, recognition, and 3d localisation. In: WACV. USA, pp 1–8
Xu S (2009) Robust traffic sign shape recognition using geometric matching. IET Intell Transp Syst 3(1):10–18
Zaklouta F, Stanciulescu B (2014) Real-time traffic sign recognition in three stages. Robot Auton Syst 62(1):16–24
Yang H-M, Liu C-L, Liu K-H, Huang S-M (2003) Traffic sign recognition in disturbing environments. In ISMIS, ser. Lecture Notes in Computer Science, vol 2871. Springer, pp 252–261
Yang X, Qu Y, Fang S (2012) Color fused multiple features for traffic sign recognition. In: ICIMCS’12. China, pp 84–87
Zadeh M, Kasvand T, Suen C (1998) Localization and recognition of traffic road signs for automated vehicle control systems. In: Proceedings of the SPIE intelligent system and automated manufacturing, pp 272–282
Zaklouta F, Stanciulescu B, Hamdoun O (2011) Traffic sign classification using k-d trees and random forests. In: IJCNN. USA, pp 2151–2155
Zhu Y, Wang X, Yao C, Bai X (2013) Traffic sign classification using two-layer image representation. In: ICIP. Melbourne, pp 3755–3759
Acknowledgment
The authors would like to express their gratitude to the reviewers and the chief editor for their valuable suggestions, which have significantly improved the presentation of this paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gudigar, A., Chokkadi, S. & U, R. A review on automatic detection and recognition of traffic sign. Multimed Tools Appl 75, 333–364 (2016). https://doi.org/10.1007/s11042-014-2293-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2293-7