Skip to main content
SpringerLink
Log in

A novel method for vehicle headlights detection using salient region segmentation and PHOG feature

  • 1130T: Machine Learning and Soft Computing Applications in Multimedia
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we explore an issue that is to detect vehicle headlights from the nighttime traffic surveillance images with highly reflections. In the night, reflections on the road (water) surface, vehicles bodies, or some reflective objects (such as lane markings, traffic signs) will interfere the headlight detection seriously. Although the existing methods have achieved good results, however, most of them failed to detect the headlight when headlights are far from camera. In order to solve the issue, we propose a novel method for vehicle headlights detection. The proposed method makes full use of the brightness and gradient information of the headlights in the night. First, we propose an effective region-of-interest (ROI) segmentation method which is based on multi-scale local saliency detection. The method pre-serve faint or small-sized objects and retain the original shape of the object to the greatest extent. Then, we compute the pyramid histogram of oriented gradients (PHOG) features, which are used to train support vector machine (SVM) classifier. Finally, the extracted bright blocks are classified according to the pre-trained SVM classifier. Experimental results and quantitative evaluations in different scenes demonstrate that our proposed method can achieve a better result compared with previous methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Achanta R, Suesstrunk S (2010) Saliency detection using maximum symmetric surround. In: Image processing (ICIP), 2010 17th IEEE international conference on

  2. Adeloye D (2014) 2013 motor vehicle crashes: Overview

  3. Alcantarilla P, Bergasa L, Jimenez P, Sotelo M (2008) Night time vehicle detection for driving assistance lightbeam controller

  4. Alexe B, Deselaers T, Ferrari V (2012) Measuring the objectness of image windows. IEEE Trans Pattern Anal Mach Intell 34(11):2189–2202

    Article  Google Scholar 

  5. Arrospide J, Salgado L (2013) Log-gabor filters for image-based vehicle verification. 22(6):2286–2295

  6. Berger I, Rieke R, Kolomeets M et al (2018) Comparative study of machine learning methods for in-vehicle intrusion detection. Comput Secur 85–101

  7. Borji A, Cheng M-M, Hou Q, Jiang H, Li J (2019) Salient object detection: A survey. Comput Visual Media 5(2):117–150

    Article  Google Scholar 

  8. Bosch A, Zisserman A, Munoz X (2007) Representing shape with a spatial pyramid kernel. In: Acm international conference on image and video retrieval

  9. Chen YL, Bing-Fei W, Huang H-Y, Fan C-J (2011) A real-time vision system for nighttime vehicle detection and traffic surveillance. IEEE Trans Ind Electron 58(5):0–2044

    Google Scholar 

  10. Chen J, Chen J, Ling H, Cao H, Sun W, Fan Y, Weimin W (2018) Salient object detection via spectral graph weighted low rank matrix recovery. J Visual Commun Image Rep 50(JAN.):270–279

    Article  Google Scholar 

  11. Chen J, Li Q, Li P, Han Y, Lei W, Ling H, Weimin W (2019) Saliency prediction by mahalanobis distance of topological feature on deep color components. J Visual Commun Image Rep 60:149–157, 02

    Article  Google Scholar 

  12. Chen J, Li Q, Wu W, Ling H, Wu L, Zhang B, Li P (2019) Saliency detection via topological feature modulated deep learning. 09

  13. Chen L, Xuemin H, Tong X, Kuang H, Li Q (2017) Turn signal detection during nighttime by cnn detector and perceptual hashing tracking. IEEE Trans Intell Transp Syst 1–12

  14. Chih-Chung C, Chih-Jen L (2011) Libsvm: A library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2:01

    Article  Google Scholar 

  15. Chun-Ping GE (2012) A simple and rapid algorithm of connected component labeling for binary image. Value Eng

  16. Cucchiara R, Piccardi M (1999) Vehicle detection under day and night illumination 01

  17. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: International Conference on computer vision & amp; pattern recognition (CVPR’05), vol 1, pp 886–893

  18. Dalal N, Triggs B, Schmid C (2006) Human detection using oriented histograms of flow and appearance. In: European conference on computer vision-eccv

  19. Fan D-P, Cheng M-M, Liu J-J et al (2018) Salient objects in clutter: Bringing salient object detection to the foreground. In: European conference on computer vision (ECCV)

  20. Fan D-P, Wang Wenguan CM-M, Shen J (2019) Shifting more attention to video salient object detection. In: IEEE conference on computer vision and pattern recognition

  21. Fan DP, Zhang SC, Wu YH, Cheng MM, Ren B, Ji R, Rosin PL (2018) Face sketch synthesis style similarity: A new structure co-occurrence texture measure. arXiv preprint arXiv 1804–02975

  22. Felzenszwalb PF, Girshick RB, Mcallester D, Ramanan D (2010) Object detection with discriminatively trained part-based models. IEEE Trans Pattern Anal Mach Intell 32(9):1627–1645

    Article  Google Scholar 

  23. Guo DGD, Fraichard T, Xie MXM, Laugier C (2000) Color modeling by spherical influence field in sensing drivingenvironment

  24. Hajimolahoseini H et al (2014) Robust vehicle tracking algorithm for nighttime videos captured by fixed cameras in highly reflective environments. IET Comput Vis 8(6):535–544

    Article  Google Scholar 

  25. Hosang J, Benenson R, Schiele B (2014) How good are detection proposals, really? Comput Sci

  26. Jazayeri A, Cai H, Zheng JY, Tuceryan M (2011) Vehicle detection and tracking in car video based on motion model. IEEE Trans Intell Transp Syst 12(2):583–595

    Article  Google Scholar 

  27. Kim J, Baek J, Kim E (2015) A novel on-road vehicle detection method using pi hog. IEEE Trans Intell Transp Syst 16(6):1–16

    Article  Google Scholar 

  28. Kim H, Kuk S, Kim M, Jung H (2013) An effective method of head lamp and tail lamp recognition for night time vehicle detection. 126(21):384–392

  29. Kosaka N, Ohashi G (2015) Vision-based nighttime vehicle detection using censure and svm. IEEE Trans Intell Transp Syst 16(5):1–10

    Article  Google Scholar 

  30. Kuang H, Chen L, Feng G, Chen J, Chan L, Yan H (2016) Combining region of interest extraction and image enhancement for nighttime vehicle detection. IEEE Intell Syst 1–1

  31. Kuang H, Yang K-F, Chen L, Li Y-J, Chan LLH, Yan H (2017) Bayes saliency-based object proposal generator for nighttime traffic images. IEEE Trans Intell Transp Syst 19(3):1–12

    Google Scholar 

  32. Lee IK, Han H, David K (2002) Multiple vehicle tracking based on regional estimation in nighttime ccd images. In: IEEE international conference on acoustics speech, and signal processing, pp 3712–3715

  33. Lingyan W, Tingzhi S (1999) An image segmentation method using the entropy of histogram and genetic algorithms. Acta Armamentarii 20(3):255–258

    Google Scholar 

  34. Liu Y, Fan D-P, Nie G-Y, Zhang X, Petrosyan V, Cheng M-M (2019) Dna: Deeply-supervised nonlinear aggregation for salient object detection. Adv Multimed 2018:1–13

    Google Scholar 

  35. Otsu, Nobuyuki (2007) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9(1):62–66

    Article  Google Scholar 

  36. Qi Z, Ling H, Luo S, Huang Y, Tian M (2015) Robust nighttime vehicle detection by tracking and grouping headlights. IEEE Trans Intell Transp Syst 16(5):1–12

    Article  Google Scholar 

  37. Robert K (2009) Night-time traffic surveillance: A robust framework for multi-vehicle detection classification and tracking

  38. Shen ZQ, Miao CY, Geng L (2016) Vehicles detection and tracking algorithm for complex nighttime traffic scene. J Trans Syst Eng Inform Technol

  39. Taktak R, Dufaut M, Husson R (1994) Vehicle detection at night using image processing and pattern recognition. In: Image processing proceedings. ICIP-94, IEEE international conference, p 1994

  40. Tang C, Dong Y, Lin X, Xiao W (2017) Multi-field depth vehicle headlight detection by model construction and long trajectory extraction in nighttime city traffic. In: International symposium for intelligent transportation and smart city

  41. Tian B, Morris BT, Ming T et al (2017) Hierarchical and networked vehicle surveillance in its: A survey. In: IEEE transactions on intelligent transportation systems

  42. Tsai Luo Wei, Hsieh Jun Wei, Fan Kuo Chin (2007) Vehicle detection using normalized color and edge map. IEEE Trans Image Process 16(3):850–864

    Article  MathSciNet  Google Scholar 

  43. Viola PA, Jones MJ (2001) Rapid object detection using a boosted cascade of simple features. In: Computer vision and pattern recognition CVPR 2001. Proceedings of the 2001 IEEE computer society conference on, p 2001

  44. Viola P, Jones MJ (2014) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  45. Viola P, Jones MJ (2019) Distant vehicle detection using radar and vision. arXiv preprint arXiv 1901–10951

  46. Xu M, Yao Y, Ang Y et al (2019) Unsupervised traffic accident detection in first-person videos. arXiv preprint arXiv

  47. Zhang W, Wu QMJ, Wang G, You X (2012) Tracking and pairing vehicle headlight in night scenes. IEEE Trans Intell Transp Syst 13(1):140–153

    Article  Google Scholar 

  48. Zhao J, Cao Y, Fan D-P et al (2019) Contrast prior and fluid pyramid integration for rgbd salient object detection. In: IEEE conference on computer vision and pattern recognition (CVPR)

  49. Zhou S, Li J, Shen Z, Liu Y (2013) A night time application for a real-time vehicle detection algorithm based on computer vision. Res J Appl Sci Eng Technol 5(10):3037–3043

    Article  Google Scholar 

  50. Zitnick CL, Dollar P (2014) Edge boxes : Locating object proposals from edges

  51. Zweig MH, Campbell G (1993) Receiver-operating characteristic (roc) plots: A fundamental evaluation tool in clinical medicine. Clin Chem 39(4):561–577

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Computer Science, Sichuan University, Chengdu, China

    Jinxia Shang & Minghui Wang

  2. Fujian Normal University, Fuzhou, China

    Hua-Ping Guan

  3. College of Artificial Intelligence, Southwest University, Chongqing, China

    Yun Liu

  4. Northeast Petroleum University, Heilongjiang, China

    Hongbo Bi & Lina Yang

Authors
  1. Jinxia Shang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hua-Ping Guan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yun Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hongbo Bi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lina Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Minghui Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lina Yang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shang, J., Guan, HP., Liu, Y. et al. A novel method for vehicle headlights detection using salient region segmentation and PHOG feature. Multimed Tools Appl 80, 22821–22841 (2021). https://doi.org/10.1007/s11042-020-10501-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10501-8

Keywords

Search

Navigation