Skip to main content
Springer Nature Link
Log in

Smoky vehicle detection based on multi-feature fusion and ensemble neural networks

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Existing methods of smoky vehicle detection from the traffic flow are inefficiency and need a large number of workers. To solve this issue, we propose an automatic smoky vehicle detection method based on multi-feature fusion and ensemble back-propagation neural networks (E-BPNN). In this method, the Vibe background subtraction algorithm and some rules are adopted to detect vehicle objects. To obtain the key region at the back of the vehicle where may be the most possible to have black smoke, the integral projection is utilized to detect the position of the vehicle rear. The proposed LHI features, which fuse Local Binary Pattern (LBP), Histograms of Oriented Gradients (HOG) and Integral Projection (IP), are extracted from the key region. The E-BPNN are adopted to distinguish smoky vehicles and non-smoke vehicles by making classification of the extracted LHI features. The proposed algorithm framework can automatically detect smoky vehicles through analyzing road surveillance videos which obtained in the daytime with good weather conditions. The experimental results show that the proposed method of the E-BPNN with multi-feature fusion has a better performance than the method of the BPNN with single features. In addition, the proposed method also has low false alarm rates than common smoke and fire detection methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Barnich O, Droogenbroeck VM (2011) Vibe: a universal background subtraction algorithm for video sequences. IEEE Trans Image Process 20(6):1709

    Article  MathSciNet  Google Scholar 

  2. Brunelli R, Poggio T (1993) Face Recognition: Features Versus Templates. IEEE Trans Pattern Anal Mach Intell 15(10):1042–1052

    Article  Google Scholar 

  3. Bruno DOT, Nascimento MZD, Ramos RP, Batista VR, Neves LA, Martins AS (2016) LBP operators on curvelet coefficients as an algorithm to describe texture in breast cancer tissues. Expert Syst Appl 55(C):329–340

    Article  Google Scholar 

  4. Calderara S, Piccinini P, Cucchiara R (Jul. 2011) Vision based smoke detection system using image energy and color information. Mach Vis Appl 22(4):705–719

    Article  Google Scholar 

  5. Chirico R, Decarlo PF, Heringa MF, Tritscher T, Richter R et al (2010) Impact of aftertreatment devices on primary emissions and secondary organic aerosol formation potential from in-use diesel vehicles: results from smog chamber experiments. Atmos Chem Phys 10(23):11545–11563

    Article  Google Scholar 

  6. Dalal N, Triggs B (2005) Histograms of Oriented Gradients for Human Detection. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1:886–893

    Google Scholar 

  7. Dhanaekaran S, Ramachandran K, Selvamuthukumar M, Velam N, Pal S (2015) A survey on vehicle detection based on vision. Mod Appl Sci 9(12):118

    Article  Google Scholar 

  8. Favorskaya M, Pyataeva A, Popov A (2015) Verification of smoke detection in video sequences based on spatio-temporal local binary patterns. Procedia Computer Science 60(1):671–680

    Article  Google Scholar 

  9. Flach PA, Kull M (2015) Precision-Recall-Gain curves PR analysis done right. Proceedings of the 29th Annual Conference on Neural Information Processing Systems, 838–846

  10. Gonzalez RC, Woods RE (2010) Image restoration and reconstruction. In: Gonzalez (ed) Digital Image Processing, 3rd ed., Gonzalez, New Jersey, pp. 390–394

  11. Gunay O, Toreyin BU, Kose K, Cetin AE (2012) Entropy-functional-based online adaptive decision fusion framework with application to wildfire detection in video. IEEE Trans Image Process 21(5):2853–2865

    Article  MathSciNet  Google Scholar 

  12. Guo Z, Zhang L, Zhang D (2010) Rotation invariant texture classification using LBP variance (LBPV) with global matching. Pattern Recogn 43(3):706–719

    Article  Google Scholar 

  13. Hawkins JK (1970) Textural properties for pattern recognition. In: Lipkin B, Rosenfeld A (eds) Picture Processing and Psychopictorics. Academic Press, New York, pp 347–3701

    Google Scholar 

  14. Hegenbart S, Uhl A (2015) A scale- and orientation-adaptive extension of Local Binary Patterns for texture classification. Pattern Recogn 48(8):2633–2644

    Article  Google Scholar 

  15. Huang C, Wang HL, Li L et al (2015) VOC species and emission inventory from vehicles and their SOA formation potentials estimation in shanghai, China. Atmos Chem Phys Discuss 15(6):7977–8015

    Article  Google Scholar 

  16. Jakovcevic T, Stipanicev D, Krstinic D (May 2013) Visual spatial-context based wildfire smoke sensor. Mach Vis Appl 24(4):707–719

    Article  Google Scholar 

  17. Ko B, Park J, Nam JY (Oct. 2013) Spatiotemporal bag-of-features for early wildfire smoke detection. Image Vis Comput 31(10):786–795

    Article  Google Scholar 

  18. Kone J, Hagara M (2014) One-Shot-Learning Gesture Recognition using HOG-HOF Features. J Mach Learn Res 15(1):2513–2532

    MathSciNet  Google Scholar 

  19. Labati RD, Genovese A, Piuri V et al (2013) Wildfire Smoke Detection Using Computational Intelligence Techniques Enhanced With Synthetic Smoke Plume Generation. IEEE Trans Syst Man Cybern Syst 43(4):1003–1012

    Article  Google Scholar 

  20. Liu K, Skibbe H, Schmidt T, Blein T, Palme K, Brox T (2014) Rotation-invariant HOG descriptors using Fourier analysis in polar and spherical coordinates. Int J Comput Vis 106(3):342–364

    Article  MathSciNet  Google Scholar 

  21. Liu W, Yu H, Yuan H, Zhao H (2015) Effective background modelling and subtraction approach for moving object detection. IET Comput Vis 9(1):13–24

    Article  Google Scholar 

  22. Luo Y, Zhao L, Liu P, Huang D (2017) Fire smoke detection algorithm based on motion characteristic and convolutional neural networks. Multimedia Tools & Applications. https://doi.org/10.1007/s11042-017-5090-2

    Article  Google Scholar 

  23. Man HL, Park IK (2016) Blur invariant feature descriptor using multidirectional integral projection. ETRI J 38(3):502–209

    Google Scholar 

  24. Ojala T, Pietikäinen M, Mäenpää T (July 2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  Google Scholar 

  25. Park J, Ko B, Nam JY, Kwak S (2013) Wildfire smoke detection using spatiotemporal bag-of-features of smoke. Proceedings of the 2013 IEEE Workshop on Applications of Computer Vision, 200–205

  26. Pyykonen P, Peussa P, Kutila M, Fong KW (2016) Multi-camera-based smoke detection and traffic pollution analysis system. Proceedings of the IEEE International Conference on Intelligent Computer Communication and Processing (ICCP), 233–238

  27. Robinson AL, Donahue NM, Shrivastava MK, Weitkamp EA, Sage AM, Grieshop AP et al (2007) Rethinking organic aerosols: semivolatile emissions and photochemical aging. Science 315(5816):1259–1262

    Article  Google Scholar 

  28. Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representation by Back-Propagating errors, Parallel Distributed Processing: Explorations in the Microstructure of. Cognition 323(6088):533–536

    MATH  Google Scholar 

  29. Samanta S, Ahmed SS, Salem AMM, Nath SS, Dey N, Chowdhury SS (2015) Haralick Features Based Automated Glaucoma Classification Using Back Propagation Neural Network. International Conference on Frontiers of Intelligent Computing: Theory and Applications 327:29–32

    Google Scholar 

  30. Shi L, Long F, Lin CH et al (2017) Video-Based Fire Detection with Saliency Detection and Convolutional Neural Networks, International Symposium on Neural Networks. Springer, Cham, pp 299–309

    Google Scholar 

  31. Sun Z, Bebis G, Miller R (2006) On-road vehicle detection: a review. IEEE Transactions on Pattern Analysis & Machine Intelligence 28(5):694

    Article  Google Scholar 

  32. Tao H, Lu X (2018) Smoky vehicle detection based on multi-scale block Tamura features, Signal, Image and Video Processing. http://link.springer.com/article/10.1007/s11760-018-1254-4

    Article  Google Scholar 

  33. Tian H, Li W, Ogunbona P, Nguyen DT, Zhan C (2011) Smoke detection in videos using non-redundant local binary pattern-based features. Proceedings of the IEEE International Workshop on Multimedia Signal Processing, 1–4

  34. Toreyin BU, Dedeoglu Y, Cetin AE (2005) Wavelet based real-time smoke detection in video. Proceedings of the European Signal Processing Conference, 1–4

  35. Wang S, He Y, Yang H et al (2017) Video smoke detection using shape, color and dynamic features. J Intell Fuzzy Syst 33(1):305–313

    Article  Google Scholar 

  36. Wu Y, Zhang S, Hao J et al (2017) On-road vehicle emissions and their control in china: a review and outlook. Sci Total Environ 574:332–349

    Article  Google Scholar 

  37. Yang XF, Liu H, Man HY, He KB (2014) Characterization of road freight transportation and its impact on the national emission inventory in China. Atmos Chem Phys 14(10):2105–2118

    Google Scholar 

  38. Yin Z, Wan B, Yuan F et al (2017) A Deep Normalization and Convolutional Neural Network for Image Smoke Detection. IEEE Access 5(99):18429–18438

    Article  Google Scholar 

  39. Yuan F (2011) Video-based smoke detection with histogram sequence of LBP and LBPV pyramids. Fire Saf J 46(3):132–139

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Key Science & Technology Pillar Program of China (No.2014BAG01B03), the National Natural Science Foundation of China (No.61374194), Key Research and Development Program of Jiangsu Province (No.BE2016739), Postgraduate Research and Practice Innovation Program of Jiangsu Province, and a Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions.

Author information

Authors and Affiliations

  1. School of Automation, Southeast University, Nanjing, 210096, China

    Huanjie Tao & Xiaobo Lu

  2. Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education, Southeast University, Nanjing, 210096, China

    Huanjie Tao & Xiaobo Lu

Authors
  1. Huanjie Tao
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Xiaobo Lu
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Xiaobo Lu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tao, H., Lu, X. Smoky vehicle detection based on multi-feature fusion and ensemble neural networks. Multimed Tools Appl 77, 32153–32177 (2018). https://doi.org/10.1007/s11042-018-6248-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6248-2

Keywords