Skip to main content
SpringerLink
Log in

Design of efficient embedded system for road sign recognition

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Automatic traffic sign recognition enhances driver interactivity while driving. It improves the vigilance of the driver by alarming-him/her of signs that he/she may not perceive. In this paper, an embedded real-time system for automatic traffic sign recognition is proposed. The segmentation task of an acquired scene is processed in the HSV color space. The recognition process is performed by using the Oriented fast-and-Rotated Brief features. The developed algorithm is implemented on a ZedBoard hardware platform. The detection rate reaches the value of 97.39%. The recognition rate is equal to 95.53%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  • Ahonen T, Matas J, He C, Pietikäinen M (2009) Rotation invariant image description with local binary pattern histogram fourier features. In: Image analysis. Springer, Berlin, pp 61–70

    Chapter  Google Scholar 

  • Alefs B, Eschemann G, Ramoser H, Beleznai C (2007) Road sign detection from edge orientation histograms. 2007 IEEE intelligent vehicles symposium, pp 993–998

  • Alsibai MH, Hirai Y (2010) Real-time recognition of blue traffic signs designating directions. Int J Intell Transp Syst Res 8:96–105. https://doi.org/10.1007/s13177-010-0010-0

    Google Scholar 

  • Anders J, Mefenza M, Bobda C, Yonga F, Aklah Z, Gunn K (2016) A hardware/software prototyping system for driving assistance investigations. J Real-Time Image Proc 11(3):559–569

    Article  Google Scholar 

  • Chen Z, Huang X, Ni Z, He H (2014) A GPU-based real-time traffic sign detection and recognition system. 2014 IEEE symposium on computational intelligence in vehicles and transportation systems (CIVTS), pp 1–5

  • Escalera A de la, Moreno LE, Salichs MA, Armingol JM (1997) Road traffic sign detection and classification. IEEE Trans Ind Electron 44:848–859. https://doi.org/10.1109/41.649946

    Article  Google Scholar 

  • Farhat W, Faiedh H, Souani C, Besbes K (2015a) Novel approach for real time detection and classification based on template matching in video. In: 2015 World Congress on Information Technology and Computer Applications (WCITCA). pp 1–7

  • Farhat W, Faiedh H, Souani C, Besbes K (2015b) Effect of color spaces on video segmentation performances. In: 2015 World Symposium on Computer Networks and Information Security (WSCNIS). pp 1–5

  • Farhat W, Faiedh H, Souani C, Besbes K (2017) Real-time embedded system for traffic sign recognition based on ZedBoard. J Real Time Image Process. https://doi.org/10.1007/s11554-017-0689-0

    Google Scholar 

  • Fleyeh H, Davami E (2011) Eigen-based traffic sign recognition. IET Intel Transport Syst 5(3):190

    Article  Google Scholar 

  • Gao XW, Podladchikova L, Shaposhnikov D, Hong K, Shevtsova N (2006) Recognition of traffic signs based on their colour and shape features extracted using human vision models. J Vis Commun Image Represent 17(4):675–685

    Article  Google Scholar 

  • Gavrila DM (1998) Multi-feature hierarchical template matching using distance transforms. In: Proceedings. Fourteenth international conference on pattern recognition (Cat. No.98EX170), vol. 1. pp 439–444

  • Grana C, Borghesani D, Manfredi M, Cucchiara R (2013) A fast approach for integrating ORB descriptors in the bag of words model, Proc. SPIE 8667, Multimedia Content and Mobile Devices, 866709

  • Greenhalgh J, Mirmehdi M (2012) Real-time detection and recognition of road traffic signs. IEEE Trans Intell Transp Syst 13:1498–1506. https://doi.org/10.1109/TITS.2012.2208909

    Article  Google Scholar 

  • Gomez-Moreno H, Maldonado-Bascon S, Gil-Jimenez P, Lafuente-Arroyo S (2010) Goal evaluation of segmentation algorithms for traffic sign recognition. IEEE Trans Intell Transp Syst 11:917–930. https://doi.org/10.1109/TITS.2010.2054084

    Article  Google Scholar 

  • Gonzalez Á, Garrido MÁ, Llorca DF et al (2011) Automatic traffic signs and panels inspection system using computer vision. IEEE Trans Intell Transp Syst 12:485–499. https://doi.org/10.1109/TITS.2010.2098029

    Article  Google Scholar 

  • Gudigar A, Chokkadi S, U R (2016) A review on automatic detection and recognition of traffic sign. Multimedia Tools Appl 75 (1):333–364

    Article  Google Scholar 

  • Gudigar A, Jagadale BN, P.k M, U R (2012) Kernel based automatic traffic sign detection and recognition using SVM. In: Mathew J, Patra P, Pradhan DK, Kuttyamma AJ (eds) Eco-friendly Computing and Communication Systems. Springer, Berlin, Heidelberg, pp 153–161

  • Han Y, Oruklu E (2014) Real-time traffic sign recognition based on Zynq FPGA and ARM SoCs. In: IEEE International Conference on Electro/Information Technology, pp 373–376

  • Hamdi S, Faiedh H, Souani C, Besbes K (2016) A lighting independent vision based system for driver assistance. In: 2016 11th International Design Test Symposium (IDT), pp 328–333

  • Hmida R, Abdelali AB, Mtibaa A (2016) Hardware implementation and validation of a traffic road sign detection and identification system. J Real Time Image Process. https://doi.org/10.1007/s11554-016-0579-x

    Google Scholar 

  • Hsieh JW, Chen LC, Chen DY (2014) Symmetrical SURF and Its applications to vehicle detection and vehicle make and model recognition. IEEE Trans Intell Transp Syst 15:6–20. https://doi.org/10.1109/TITS.2013.2294646

    Article  Google Scholar 

  • Irmak H, Real time traffic sign recognition system on FPGA., 2010

  • Kuo WJ, Lin CC (2007) Two-stage road sign detection and recognition. In: 2007 IEEE international conference on multimedia and expo, pp 1427–1430

  • Lafuente-Arroyo S, Salcedo-Sanz S, Maldonado-Bascón S et al (2010) A decision support system for the automatic management of keep-clear signs based on support vector machines and geographic information systems. Expert Syst Appl 37:767–773. https://doi.org/10.1016/j.eswa.2009.05.102

    Article  Google Scholar 

  • Larsson F, Felsberg M (2011) Using fourier descriptors and spatial models for traffic sign recognition. In: Heyden A, Kahl F (eds) Image analysis. Springer, Berlin Heidelberg, 238–249

    Chapter  Google Scholar 

  • Lillo-Castellano JM, Mora-Jimenez I, Figuera-Pozuelo C, Rojo-Alvarez JL (2015) Traffic sign segmentation and classification using statistical learning methods. Neurocomputing 153:286–299. https://doi.org/10.1016/j.neucom.2014.11.026

    Article  Google Scholar 

  • Loy G, Zelinsky A (2003) Fast radial symmetry for detecting points of interest. IEEE Trans Pattern Anal Mach Intell 25:959–973. https://doi.org/10.1109/TPAMI.2003.1217601

    Article  MATH  Google Scholar 

  • Maldonado-Bascon S, Lafuente-Arroyo S, Gil-Jimenez P et al (2007) Road-sign detection and recognition based on support vector machines. IEEE Trans Intell Transp Syst 8:264–278. https://doi.org/10.1109/TITS.2007.895311

    Article  Google Scholar 

  • Malinowski A, Yu H (2011) Comparison of embedded system design for industrial applications. IEEE Trans Ind Inform 7:244–254. https://doi.org/10.1109/TII.2011.2124466

    Article  Google Scholar 

  • Mathias M, Timofte R, Benenson R, Gool LV (2013) Traffic sign recognition #x2014; How far are we from the solution? In: The 2013 international joint conference on neural networks (IJCNN), pp 1–8

  • Miura J, Kanda T, Shirai Y (2000) An active vision system for real-time traffic sign recognition. In: ITSC2000. 2000 IEEE intelligent transportation systems. Proceedings (Cat. No.00TH8493), pp 52–57

  • Mogelmose A, Trivedi MM, Moeslund TB (2012) Vision-based traffic sign detection and analysis for intelligent driver assistance systems: perspectives and survey. IEEE Trans Intell Transp Syst 13:1484–1497. https://doi.org/10.1109/TITS.2012.2209421

    Article  Google Scholar 

  • Moutarde F, Bargeton A, Herbin A, Chanussot L (2007) Robust on-vehicle real-time visual detection of American and European speed limit signs, with a modular traffic signs recognition system. 2007 IEEE intelligent vehicles symposium, pp 1122–1126

  • Par K, Tosun O (2012) Real-time traffic sign recognition with map fusion on multicore/many-core architectures. Acta Polytech Hung 9(2):231–250

    Google Scholar 

  • Park J, Kwon J, Oh J et al (2011) A 92 mW real-time traffic sign recognition system with robust light and dark adaptation. In: IEEE Asian solid-state circuits conference 2011, pp 397–400

  • Park J-G, Kim K-J (2013) Design of a visual perception model with edge-adaptive Gabor filter and support vector machine for traffic sign detection. Expert Syst Appl 40(9):3679–3687

    Article  Google Scholar 

  • Paulo CF, Correia PL (2007) Automatic detection and classification of traffic signs. In: Eighth international workshop on image analysis for multimedia interactive services, 2007. WIAMIS’07, pp 11–11

  • Phalguni, Ganapathi K, Madumbu V et al (2013) Design and implementation of an automatic traffic sign recognition system on TI OMAP-L138. In: 2013 IEEE international conference on industrial technology (ICIT), pp 1104–1109

  • Ren F, Huang J, Jiang R, Klette R (2009) General traffic sign recognition by feature matching. In: 2009 24th international conference image and vision computing New Zealand, pp 409–414

  • Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: an efficient alternative to SIFT or SURF. In: Proceedings of the 2011 international conference on computer vision. IEEE Computer Society, Washington, DC, pp 2564–2571

  • Ruta A, Li Y, Liu X (2010) Real-time traffic sign recognition from video by class-specific discriminative features. Pattern Recognit 43:416–430. https://doi.org/10.1016/j.patcog.2009.05.018

    Article  MATH  Google Scholar 

  • Salti S, Petrelli A, Tombari F et al (2015) Traffic sign detection via interest region extraction. Pattern Recognit 48:1039–1049. https://doi.org/10.1016/j.patcog.2014.05.017

    Article  Google Scholar 

  • Schwiegelshohn F, Gierke L, Hübner M (2015) FPGA based traffic sign detection for automotive camera systems. In: 2015 10th international symposium on reconfigurable communication-centric systems-on-chip (ReCoSoC), pp 1–6

  • Souani C, Faiedh H, Besbes K (2014) Efficient algorithm for automatic road sign recognition and its hardware implementation. J Real Time Image Process 9:79–93. https://doi.org/10.1007/s11554-013-0348-z

    Article  Google Scholar 

  • Stallkamp J, Schlipsing M, Salmen J, Igel C (2011) The German traffic sign recognition benchmark: a multi-class classification competition. The 2011 international joint conference on neural networks (IJCNN), pp 1453–1460

  • Stallkamp J, Schlipsing M, Salmen J, Igel C (2012) Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition. Neural Netw 32:323–332. https://doi.org/10.1016/j.neunet.2012.02.016

    Article  Google Scholar 

  • Timofte R, Zimmermann K, Van Gool L (2014) Multi-view traffic sign detection, recognition, and 3D localisation. Mach Vis Appl 25:633–647. https://doi.org/10.1007/s00138-011-0391-3

    Article  Google Scholar 

  • Turturici M, Saponara S, Fanucci L, Franchi E (2013) Low-power DSP system for real-time correction of fish-eye cameras in automotive driver assistance applications. J Real Time Image Process 9:463–478. https://doi.org/10.1007/s11554-013-0330-9

    Article  Google Scholar 

  • Waite S, Oruklu E (2013) FPGA-based traffic sign recognition for advanced driver assistance systems. J Transp Technol 03:1–16. https://doi.org/10.4236/jtts.2013.31001

    Article  Google Scholar 

  • Zaklouta F, Stanciulescu B (2011) Warning traffic sign recognition using a HOG-based K-d tree. 2011 IEEE intelligent vehicles symposium (IV), pp 1019–1024

  • Zaklouta F, Stanciulescu B (2014) Real-time traffic sign recognition in three stages. Robot Auton Syst 62:16–24. https://doi.org/10.1016/j.robot.2012.07.019

    Article  Google Scholar 

  • Zhao J, Zhu S, Huang X (2013) Real-time traffic sign detection using SURF features on FPGA. 2013 IEEE high performance extreme computing conference (HPEC),pp 1–6

  • Zhou Y, Chen Z, Huang X (2015) A pipeline architecture for traffic sign classification on an FPGA. In: 2015 IEEE international symposium on circuits and systems (ISCAS), pp 950–953

Download references

Author information

Authors and Affiliations

  1. National School of Engineers, Sousse University, Sousse, Tunisia

    Wajdi Farhat

  2. Faculty of Sciences, Monastir University, Monastir, Tunisia

    Souhir Sghaier

  3. Higher Institute of Applied Sciences and Technology, Sousse University, Sousse, Tunisia

    Hassene Faiedh & Chokri Souani

Authors
  1. Wajdi Farhat
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Souhir Sghaier
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hassene Faiedh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chokri Souani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wajdi Farhat.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Farhat, W., Sghaier, S., Faiedh, H. et al. Design of efficient embedded system for road sign recognition. J Ambient Intell Human Comput 10, 491–507 (2019). https://doi.org/10.1007/s12652-017-0673-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-017-0673-3

Keywords

Search

Navigation