Skip to main content
SpringerLink
Log in

GPU implementation of a road sign detector based on particle swarm optimization

  • Research Paper
  • Published:
Evolutionary Intelligence Aims and scope Submit manuscript

Abstract

Road Sign Detection is a major goal of the Advanced Driving Assistance Systems. Most published work on this problem share the same approach by which signs are first detected and then classified in video sequences, even if different techniques are used. While detection is usually performed using classical computer vision techniques based on color and/or shape matching, most often classification is performed by neural networks. In this work we present a novel modular and scalable approach to road sign detection based on Particle Swarm Optimization, which takes into account both shape and color to detect signs. In our approach, in particular, the optimization of a single fitness function allows both to detect a sign belonging to a certain category and, at the same time, to estimate its position with respect to the camera reference frame. To speed up processing, the algorithm implementation exploits the parallel computing capabilities offered by modern graphics cards and, in particular, by the Compute Unified Device Architecture by nVIDIA. The effectiveness of the approach has been assessed on both synthetic and real video sequences, which have been successfully processed at, or close to, full frame rate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. http://www.povray.org.

  2. http://lib.povray.org/collection/roadsigns/chrisb2.0/roadsigns.html.

  3. http://f-lohmueller.de/pov_tut/objects/obj_500i.htm.

  4. http://www.vislab.it.

References

  1. Mallot HA, Bülthoff HH, Little JJ, Bohrer S (1991) Inverse perspective mapping simplifies optical flow computation and obstacle. Biol Cybern 64(3):177–185

    Article  MATH  Google Scholar 

  2. Broggi A, Cerri P, Medici P, Porta PP, Ghisio G (2007) Real time road signs recognition. In: Proceedings of IEEE intelligent vehicles symposium 2007, Istanbul, Turkey, pp 981–986

  3. Cagnoni S, Mordonini M, Sartori J (2007) Particle swarm optimization for object detection and segmentation. In: Applications of evolutionary computing. Proceeding of EvoWorkshops 2007, Springer, pp 241–250

  4. Cagnoni S, Mussi L, Daolio F (2009) Empirical assessment of the effects of update synchronization in Particle Swarm Optimization. In: Poster and workshop proceedings of the XI conference of the Italian association for artificial intelligence. Reggio Emilia, Italy (2009). Electronic version, ISBN 978-88-903581-1-1

  5. Anton Canalis L, Hernandez Tejera M, Sanchez Nielsen E (2006) Particle swarms as video sequence inhabitants for object tracking in computer vision. In: Proceedings of IEEE international conference on intelligent systems design and applications (ISDA’06), pp 604–609

  6. Engelbrecht AP (2007) Computational Intelligence: an Introduction, 2nd edn. Wiley, England

    Google Scholar 

  7. de la Escalera A, Armignol JM, Mata M (2003) Traffic sign recognition and analysis for intelligent vehicles. Image Vis Comput 21(3):247–258

    Article  Google Scholar 

  8. de la Escalera A, Moreno LE, Puente EA, Salichs MA (1994) Neural traffic sign recognition for autonomous vehicles. In: Proceedings of IEEE 20th international conference on industrial electronics, control and instrumentation 2:841–846

  9. Gao X, Shevtsova N, Hong K, Batty S, Podladchikova L, Golovan A, Shaposhnikov D, Gusakova V (2002) Vision models based identification of traffic signs. In: Proceedings of European conference on color in graphics image and vision. Poitiers, France, pp 47–51

  10. Gavrila D (1999) Traffic sign recognition revisited. In: Mustererkennung 1999, 21. DAGM-symposium. Springer, pp 86–93

  11. Hoessler H, Wöhler C, Lindner F, Kreßel U (2007) Classifier training based on synthetically generated samples. In: Proceedings of 5th international conference on computer vision systems. Bielefeld, Germany

  12. Ivekovic S, John V, Trucco E (2010) Markerless multi-view articulated pose estimation using adaptive hierarchical particle swarm optimisation. In: Di Chio C et al (eds) Applications of evolutionary computing: proceedings of EvoApplications 2010, Istanbul, Turkey, Part I, LNCS 6024, Springer, pp 241–250

  13. Jiang G-Y, Choi TY (1998) Robust detection of landmarks in color image based on fuzzy set theory. In: Proceedings of IEEE 4th international conference on signal processing 2:968–971

  14. Kailath T (1967) The divergence and Bhattacharyya distance measures in signal selection. IEEE Trans Commun Technol 15(1):52–60

    Article  Google Scholar 

  15. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings IEEE international conference on neural networks, IV, IEEE, New York, pp 1942–1948

  16. Kennedy J, Mendes R (2002) Population structure and particle swarm performance. In: Proceedings of congress on evolutionary computation—CEC, IEEE, pp 1671–1676

  17. Hyukseong K, Park J, Kak A (2007) A new approach for active stereo camera calibration. In: Proceedings of IEEE international conference on robotics and automation, pp 3180–3185

  18. Liang J, Qin A, Suganthan P, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10(3):281–295

    Article  Google Scholar 

  19. Loy G, Barnes N (2004) Fast shape-based road signs detection for a driver assistance system. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems, Sendai, Japan, pp 70–75

  20. Makoto M, Takuji N (1998) Mersenne Twister: a 623-dimensionally equidistributed uniform pseudo-random number generator. ACM Trans Model Comput Simul 8(1):3–30

    Article  MATH  Google Scholar 

  21. Mussi L, Cagnoni S (2008) Artificial creatures for object tracking and segmentation. In: Applications of evolutionary computing: proceedings of EvoWorkshops 2008, Springer, pp 255–264

  22. Mussi L, Cagnoni S (2009) Particle swarm for pattern matching in image analysis. In: Serra R et al (eds) Proceedings of WIVACE 2008, Italian Workshop on artificial life and evolutionary computing, World Scientific, pp 89–98

  23. Mussi L, Daolio F, Cagnoni S (2010) Evaluation of particle swarm optimization algorithms within the CUDA architecture. Inf Sci. doi:10.1016/j.ins.2010.08.045

  24. Nguwi Y, Kouzani, A (2006) A study on automatic recognition of road signs. In: Proceedings of IEEE conference on cybernetics and intelligent systems. Bangkok, Thailand, pp 1–6

  25. nVIDIA Corporation (2009) nVIDIA CUDA Programming Guide v. 2.3. http://www.nvidia.com/object/cuda_develop.html

  26. Montes de Oca M, Stützle T, Birattari M, Dorigo M (2009) Frankenstein’s PSO: a composite particle swarm optimization algorithm. IEEE Trans Evol Comput 13(5):1120–1132

    Article  Google Scholar 

  27. Owechko Y, Medasani S (2005) A swarm-based volition/attention framework for object recognition. In: Proceedings of IEEE conference on computer vision and pattern recognition—workshops (CVPR’05). IEEE, pp 91–91

  28. Poli R (2008) Analysis of the publications on the applications of particle swarm optimisation. J Artif Evol Appl 2008(1):1–10

  29. Poli R, Kennedy J, Blackwell T (2007) Particle swarm optimization: an overview. Swarm Intel 1(1):33–57

    Article  Google Scholar 

  30. Tsai RY (1987) A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J Robot Autom 3:323–344

    Article  Google Scholar 

  31. Shadeed WG, Abu-Al Nadi DI, Mismar MJ (2003) Road traffic sign detection in color images. In: Proceedings of IEEE 10th international conference on electronics, circuits and systems 2:890–893

  32. Soetedjo A, Yamada K (2005) Fast and robust traffic sign detection. In: Proceedings of IEEE international conference on systems, man and cybernetics 2:1341–1346

  33. Sonka M, Hlavac V, Boyle R (2007) Image processing, analysis, and machine vision, 3rd edn. CL-Engineering

  34. Taiana M, Nascimento J, Gaspar J, Bernardino A (2008) Sample-based 3D tracking of colored objects: a flexible architecture. In: Proceedings of British machine vision conference (BMVC’08). BMVA, pp 1–10

  35. Vitabile S, Pollaccia G, Pilato G (2001) Road signs recognition using a dynamic pixel aggregation technique in the HSV color space. In: Proceedings of international conference on image analysis and processing, Palermo, Italy, pp 572–577

  36. Wei GQ, Ma SD (1994) Implicit and explicit camera calibration: theory and experiments. IEEE Trans Pattern Anal Machine Intell 16(5):469–480

    Article  Google Scholar 

  37. Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Machine Intell 22(11):1330–1334. http://research.microsoft.com/~zhang/Calib/

    Google Scholar 

  38. Zhang X, Hu W, Maybank S, Li X, Zhu M (2008) Sequential particle swarm optimization for visual tracking. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR’08). IEEE, pp 1–8

  39. Ziraknejad N, Tafazoli S, Lawrence P (2007) Autonomous stereo camera parameter estimation for outdoor visual servoing. In: Proceedings of IEEE Workshop on machine learning for signal processing, pp 157–162

Download references

Acknowledgments

We would like to express our thanks and appreciation to Gabriele Novelli, Denis Simonazzi and Marco Tovagliari for their help in tuning, testing and assessing the performances of our system.

Author information

Authors and Affiliations

  1. Dipartimento di Ingegneria dell’Informazione, University of Parma, Viale G. Usberti 181a, 43124, Parma, Italy

    Luca Mussi, Stefano Cagnoni, Elena Cardarelli, Paolo Medici & Pier Paolo Porta

  2. Information Systems Institute (ISI) - HEC, University of Lausanne, Internef 135, CH-1015, Lausanne, Switzerland

    Fabio Daolio

Authors
  1. Luca Mussi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stefano Cagnoni
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elena Cardarelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fabio Daolio
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Paolo Medici
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Pier Paolo Porta
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stefano Cagnoni.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mussi, L., Cagnoni, S., Cardarelli, E. et al. GPU implementation of a road sign detector based on particle swarm optimization. Evol. Intel. 3, 155–169 (2010). https://doi.org/10.1007/s12065-010-0043-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12065-010-0043-y

Keywords

Search

Navigation