Skip to main content
SpringerLink
Log in

Real-time embedded system for traffic sign recognition based on ZedBoard

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

This paper presents a design methodology of a real-time embedded system that processes the detection and recognition of road signs while the vehicle is moving. An efficient algorithm was proposed, which operates in two processing steps: the detection and the recognition. Regions of interest were extracted by using the Maximally Stable Extremal Regions Method. For the recognition phase, Oriented FAST and Rotated BRIEF features were used. A hardware system based on the Xilinx Zynq platform was developed. The designed system can achieve real-time video processing while assuring constraints and a high-level accuracy in terms of detection and recognition rates.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Michael, S.: Road sign detection and recognition. In: 1 IEEE Computer Society International Conference on Computer Vision and Pattern Recognition (2005)

  2. Souani, C., Faiedh, H., Besbes, K.: Efficient algorithm for automatic road sign recognition and its hardware implementation. J. Real-Time Image Process. 9, 79–93 (2014)

    Article  Google Scholar 

  3. Hmida, R., Abdelali, A.B., Mtibaa, A.: Hardware implementation and validation of a traffic road sign detection and identification system. J. Real Time Image Process. 1–18 (2016)

  4. Taubel, G., Yang, J.S.: A lane departure warning system based on the integration of the optical flow and hough transform methods. In: 2013 10th IEEE International Conference on Control and Automation (ICCA). pp. 1352–1357 (2013)

  5. Gomez-Moreno, H., Maldonado-Bascon, S., Gil-Jimenez, P., Lafuente-Arroyo, S.: Goal evaluation of segmentation algorithms for traffic sign recognition. IEEE Trans. Intell. Transp. Syst. 11, 917–930 (2010)

    Article  Google Scholar 

  6. Anders, J., Mefenza, M., Bobda, C., Yonga, F., Aklah, Z., Gunn, K.: A hardware/software prototyping system for driving assistance investigations. J Real Time Image Process. 11, 559–569 (2016)

    Article  Google Scholar 

  7. Ruta, A., Li, Y., Liu, X.: Real-time traffic sign recognition from video by class-specific discriminative features. Pattern Recogn. 43, 416–430 (2010)

    Article  Google Scholar 

  8. Xu, S.: Robust traffic sign shape recognition using geometric matching. IET Intell. Transp. Syst. 3, 10–18 (2009)

    Article  Google Scholar 

  9. Xie, Y., Liu, L.-F., Li, C.-H., Qu, Y.-Y.: Unifying visual saliency with HOG feature learning for traffic sign detection. In: 2009 IEEE Intelligent Vehicles Symposium. pp. 24–29 (2009)

  10. Maldonado-Bascon, S., Lafuente-Arroyo, S., Gil-Jimenez, P., Gomez-Moreno, H., Lopez-Ferreras, F.: Road-Sign Detection and Recognition Based on Support Vector Machines. IEEE Trans. Intell. Transp. Syst. 8, 264–278 (2007)

    Article  Google Scholar 

  11. Hsieh, J.W., Chen, L.C., Chen, D.Y.: Symmetrical SURF and its applications to vehicle detection and vehicle make and model recognition. IEEE Trans. Intell. Transp. Syst. 15, 6–20 (2014)

    Article  Google Scholar 

  12. Zaklouta, F., Stanciulescu, B.: Real-time traffic sign recognition in three stages. Robot. Auton. Syst. 62, 16–24 (2014)

    Article  Google Scholar 

  13. Greenhalgh, J., Mirmehdi, M.: Real-time detection and recognition of road traffic signs. IEEE Trans. Intell. Transp. Syst. 13, 1498–1506 (2012)

    Article  Google Scholar 

  14. Zaklouta, F., Stanciulescu, B.: Warning traffic sign recognition using a HOG-based K-d tree. In: 2011 IEEE Intelligent Vehicles Symposium (IV). pp. 1019–1024 (2011)

  15. Franke, U., Gavrila, D., Gorzig, S., Lindner, F., Puetzold, F., Wohler, C.: Autonomous driving goes downtown. IEEE Intell. Syst. Their Appl. 13, 40–48 (1998)

    Article  Google Scholar 

  16. Botella, G., Martín H., J.A., Santos, M., Meyer-Baese, U.: FPGA-based multimodal embedded sensor system integrating low- and mid-level vision. Sensors. 11, 8164–8179 (2011)

    Article  Google Scholar 

  17. Hamdi, S., Faiedh, H., Souani, C., Besbes, K.: A Lighting Independent Vision Based System for Driver Assistance. In: 11th IEEE International Conference on Design and Test (IDT),(2016)

  18. Zhao, P., Zhu, H., Li, H., Shibata, T.: A directional-edge-based real-time object tracking system employing multiple candidate-location generation. IEEE Trans. Circuits Syst. Video Technol. 23, 503–517 (2013)

    Article  Google Scholar 

  19. Nguwi, Y.-Y., Kouzani, A.Z.: Detection and classification of road signs in natural environments. Neural Comput. Appl. 17, 265–289 (2007)

    Article  Google Scholar 

  20. Soendoro, D., Supriana, I.: Traffic sign recognition with colorbased method shape-arc estimation and SVM. In: proceedings of International Conference on Electrical Engineering and Informatics, Bandung, pp. 1–6 (2011)

  21. Malinowski, A., Yu, H.: Comparison of Embedded System Design for Industrial Applications. IEEE Trans. Ind. Inform. 7, 244–254 (2011)

    Article  Google Scholar 

  22. ZedBoard.org, “ZedBoard,” [Online]. http://www.zedboard.org/

  23. Greenhalgh, J., Mirmehdi, M.: Traffic sign recognition using MSER and Random Forests. In: Signal Processing Conference (EUSIPCO), 2012 Proceedings of the 20th European. pp. 1935–1939 (2012)

  24. Maldonado Bascón, S., Acevedo Rodríguez, J., Lafuente Arroyo, S., Fernndez Caballero, A., López-Ferreras, F.: An optimization on pictogram identification for the road-sign recognition task using SVMs. Comput. Vis. Image Underst. 114, 373–383 (2010)

    Article  Google Scholar 

  25. Wu, B.-F., Huang, H.-Y., Chen, C.-J., Chen, Y.-H., Chang, C.-W., Chen, Y.-L.: A vision-based blind spot warning system for daytime and nighttime driver assistance. Comput. Electr. Eng. 39, 846–862 (2013)

    Article  Google Scholar 

  26. Sebastian, P., Voon, Y.V., Comley, R.: The effect of colour space on tracking robustness. In: 2008 3rd IEEE Conference on Industrial Electronics and Applications. pp. 2512–2516 (2008)

  27. Farhat, W., Faiedh, H., Souani, C., Besbes, K.: Novel approach for real time detection and classification based on template matching in video. In: 2015 World Congress on Information Technology and Computer Applications Congress (WCITCA). pp. 1–7 (2015)

  28. Tsai, L.-W., Tseng, Y.-J., Hsieh, J.-W., Fan, K.-C., Li, J.-J.: Road Sign Detection Using Eigen Color. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) Computer Vision – ACCV 2007, pp. 169–179. Springer, Berlin Heidelberg (2007)

    Chapter  Google Scholar 

  29. Kus, M.C., Gokmen, M., Etaner-Uyar, S.: Traffic sign recognition using scale invariant feature transform and color classification. In: 23rd International Symposium on Computer and Information Sciences, 2008. ISCIS’08. pp. 1–6 (2008)

  30. Gonzalez, Á., Garrido, M.Á., Llorca, D.F., Gavilan, M., Fernandez, J.P., Alcantarilla, P.F., Parra, I., Herranz, F., Bergasa, L.M., Sotelo, M.Á., de Toro, P.R.: Automatic Traffic Signs and Panels Inspection System Using Computer Vision. IEEE Trans. Intell. Transp. Syst. 12, 485–499 (2011)

    Article  Google Scholar 

  31. Belaroussi, R., Tarel, J.-P.: A Real-Time Road Sign Detection Using Bilateral Chinese Transform. In: C.T., and Coming, D. (eds.) Advances in Visual Computing. pp. 1161–1170. Springer, Berlin (2009)

    Chapter  Google Scholar 

  32. Vázquez-Reina, A., Lafuente-Arroyo, S., Siegmann, P., Maldonado-Bascón, S., Acevedo-Rodríguez, F.: Traffic sign shape classification based on correlation techniques. In: International Conference on Signal Processing, Computational Geometry & Artificial Vision, pp. 149–154 (2005)

  33. Waite, S., Oruklu, E.: FPGA-based traffic sign recognition for advanced driver assistance systems. J. Transp. Technol. 03, 1–16 (2013)

    Article  Google Scholar 

  34. Souki, M.A., Boussaid, L., Abid, M.: An embedded system for real-time traffic sign recognizing. In: 2008 3rd International Design and Test Workshop. pp. 273–276 (2008)

  35. IRMAK, H.: Real time traffic sign recognition system on FPGA. Thesis, Graduate School of Natural and Applied Sciences of Middle East Technical University (2010)

  36. Par, K., Tosum, O.: Real-time traffic sign recognition with map fusion on multicore/many-core architectures. J. Appl. Sci. 9(2), 231–250 (2012)

    Article  Google Scholar 

  37. Grana, C., Borghesani, D., Manfredi, M., Cucchiara, R.: A fast approach for integrating ORB descriptors in the bag of words model. Presented at the (2013)

  38. Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: An efficient alternative to SIFT or SURF. In: Proceedings of the 2011 International Conference on Computer Vision. pp. 2564–2571. IEEE Computer Society, Washington (2011)

  39. Russell, M., Fischaber, S.: OpenCV based road sign recognition on Zynq. In: 2013 11th IEEE International Conference on Industrial Informatics (INDIN). pp. 596–601 (2013)

  40. Han, Y., Oruklu, E.: Real-time traffic sign recognition based on Zynq FPGA and ARM SoCs. In: IEEE International Conference on Electro/Information Technology. pp. 373–376 (2014)

  41. https://www.xilinx.com/support/answers/68021.html

  42. Stallkamp, J., Schlipsing, M., Salmen, J., Igel, C.: The German traffic sign recognition benchmark: a multi-class classification competition. In: The 2011 International Joint Conference on Neural Networks (IJCNN). pp. 1453–1460 (2011)

  43. Turturici, M., Saponara, S., Fanucci, L., Franchi, E.: Low-power DSP system for real-time correction of fish-eye cameras in automotive driver assistance applications. J. Real Time Image Process. 9, 463–478 (2013)

    Article  Google Scholar 

  44. Farhat, W., Faiedh, H., Souani, C., Besbes, K.: Embedded system for road sign detection using MicroBlaze. In: 2015 12th International Multi-Conference on Systems, Signals Devices (SSD). pp. 1–5 (2015)

  45. Muja, M., Lowe, D.G.: Fast matching of binary features. In: 2012 Ninth Conference on Computer and Robot Vision. pp. 404–410 (2012)

  46. Yalçın, H., Irmak, H., Bulut, M.M., Akar, G.B.: Real-time traffic sign detection and recognition on FPGA. In: Signal Processing and Communications Applications Conference (SIU), 2013 21st. pp. 1–4 (2013)

  47. Müller, M., Braun, A., Gerlach, J., Rosenstiel, W., Nienhüser, D., Zöllner, J.M., Bringmann, O.: Design of an automotive traffic sign recognition system targeting a multi-core SoC implementation. In: 2010 Design, Automation Test in Europe Conference Exhibition. pp. 532–537 (2010)

  48. Eichner, M.L., Breckon, T.P.: Integrated speed limit detection and recognition from real-time video. In: 2008 IEEE Intelligent Vehicles Symposium. pp. 626–631 (2008)

Download references

Author information

Authors and Affiliations

  1. Laboratory of Microelectronics and Instrumentation, Monastir University, Monastir, Tunisia

    Wajdi Farhat, Hassene Faiedh, Chokri Souani & Kamel Besbes

  2. National School of Engineers, Sousse University, Sousse, Tunisia

    Wajdi Farhat

  3. Higher Institute of Applied Sciences and Technology, Sousse University, Sousse, Tunisia

    Hassene Faiedh & Chokri Souani

  4. Center for Research on Microelectronics and Nanotechnology of Sousse, Sousse University, Sousse, Tunisia

    Kamel Besbes

Authors
  1. Wajdi Farhat
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hassene Faiedh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chokri Souani
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kamel Besbes
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chokri Souani.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Farhat, W., Faiedh, H., Souani, C. et al. Real-time embedded system for traffic sign recognition based on ZedBoard. J Real-Time Image Proc 16, 1813–1823 (2019). https://doi.org/10.1007/s11554-017-0689-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-017-0689-0

Keywords

Search

Navigation