Abstract
Vehicle detection and classification has been an area of application of image processing and machine learning which is being researched extensively in accordance with its importance due to increasing number of vehicles, traffic rule defaulters and accidents. This paper aims to review various methodologies used and how it has evolved to give better results in the past years, closely moving towards usage of machine learning. This has resulted in advancing the problem statement towards helmet detection followed by number plate detection of defaulters. Object detection and Text recognition that are available in various frameworks offer built-in models which are easy to use or offer easy methods to build and train customized models.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs12065-020-00493-7/MediaObjects/12065_2020_493_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs12065-020-00493-7/MediaObjects/12065_2020_493_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs12065-020-00493-7/MediaObjects/12065_2020_493_Fig3_HTML.png)
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Lei M, Lefloch D, Gouton P, Madani K (2008) A video-based real-time vehicle counting system using adaptive background method. In: IEEE international conference on signal image technology and internet based systems (SITIS’08), pp 523–528
O’Mahony N et al (2020) Deep learning vs. traditional computer vision. In: Arai K, Kapoor S (eds) Advances in computer vision. CVC 2019. Advances in intelligent systems and computing, vol 943. Springer, Cham
Kato S, Takeuchi E, Ishiguro Y, Ninomiya Y, Takeda K, Hamada T (2015) An open approach to autonomous vehicles. IEEE Micro 35(6):60–68. https://doi.org/10.1109/MM.2015.133
Ojha S, Sakhare S (2015) Image processing techniques for object tracking in video surveillance—a survey. In: 2015 international conference on pervasive computing (ICPC), Pune, pp 1–6. https://doi.org/10.1109/PERVASIVE.2015.7087180.
Gonzales R, Woods R (1992) Digital image processing. Addison-Wesley Publishing Company, Boston, pp 81–125
Liu F, Koenig H (2010) A survey of video encryption algorithms. Comput Secur 29(1):3–15
Culjak I, Abram D, Pribanic T, Dzapo H, Cifrek M (2012) A brief introduction to OpenCV. In: 2012 proceedings of the 35th international convention MIPRO, Opatija, pp 1725–1730
Cheung S-Y, Varaiya PP (2006) Traffic surveillance by wireless sensor networks: final report. PhD diss., University of California at Berkeley
Oh S, Ritchie S, Oh C (2002) Real-time traffic measurement from single loop inductive signatures. Transp Res Rec J Transp Res Board 1804:98–106
Coifman B (2006) Vehicle level evaluation of loop detectors and the remote traffic microwave sensor. J Transp Eng 132(3):213–226
Tursun M, Amrulla G (2013) A video based real-time vehicle counting system using optimized virtual loop method. In: IEEE 8th international workshop on systems signal processing and their applications (WoSSPA)
Seki M, Fujiwara H, Sumi K (2000) A robust background subtraction method for changing background. In: Fifth IEEE workshop on applications of computer vision
Mithun NC, Rashid NU, Rahman SM (2012) Detection and classification of vehicles from video using multiple time-spatial images. IEEE Trans Intell Transp Syst 13(3):1215–1225
Boonsirisumpun N, Puarungroj W,Wairotchanaphuttha P (2018) Automatic detector for bikers with no helmet using deep learning. In: 2018 22nd international computer science and engineering conference (ICSEC), Chiang Mai, Thailand, pp 1–4
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Proceedings of the advances in neural information processing systems (NIPS), Lake Tahoe, Nevada, United States, 3–6 December 2012, pp 1097–1105
Kumar S, Balyan A, Chawla M (2017) Object detection and recognition in images. Int J Eng Dev Res 5(4):1029–1034
Ren S, He K, Girshick RB, Sun J (2015) Faster R-CNN: towards real time object detection with region proposal networks. In: Advances in neural information processing systems 28: annual conference on neural information processing systems 2015, December 7–12, 2015, Montreal, Quebec, Canada, pp 91–99
Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788
Liu W, Anguelov D, Erhan D, Szegedy C, Reed SE, Fu C, Berg AC (2016) SSD: single shot multibox detector. In: Computer vision—ECCV 2016—14th European conference, Amsterdam, The Netherlands, October 11–14, 2016, proceedings, part I, pp 21–37
Lin T, Goyal P, Girshick RB, He K, Doll’ar P (2017) Focal loss for dense object detection. In: IEEE international conference on computer vision, ICCV 2017, Venice, Italy, October 22–29, 2017, pp 2999–3007
Tekleyohannes MK, Weis C, When N, Klein M, Siegrist M (2018) A reconfigurable accelerator for morphological operations. In: 2018 IEEE international parallel and distributed processing symposium workshops (IPDPSW), Vancouver, BC
Charouh Z, Ghogho M, Guennoun Z (2019) Improved background subtraction-based moving vehicle detection by optimizing morphological operations using machine learning. In: 2019 IEEE international symposium on innovations in intelligent systems and applications (INISTA), Sofia, Bulgaria, pp 1–6
Singh D, Vishnu C, Mohan CK (2016) Visual big data analytics for traffic monitoring in smart city. In: Proceedings of the IEEE conference on machine learning and application (ICMLA), Anaheim, California, 18–20 December 2016
Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, Oxford
Annavarapu JK (2015) Statistical feature selection for image texture analysis. Int Res J Eng Technol 2:546–550
Babayan PV, Ershov MD, Erokhin DY (2019) Neural network-based vehicle and pedestrian detection for video analysis system. In: 2019 8th mediterranean conference on embedded computing (MECO), Budva, Montenegro, pp 1–5
Prajwal M, Tejas K, Varshad V, Mahesh M, Shashidhar R (2019) A Review on helmet detection by using image processing and convolutional neural networks. Int J Comput Appl 182:52–55. https://doi.org/10.5120/ijca2019918770
Prajwal MJ, Tejas B, Varshad V, Mahesh M, Shashidhar R (2019) Detection of non-helmet riders and extraction of license plate number using Yolo v2 and OCR method. Int J Comput Appl 9:5167–5172. https://doi.org/10.35940/iji-tee.B6527.129219
Baruah A, Kandali AB (2018) Pedestrian detection on OpenCV and TensorFlow. Int J Res Anal Rev 5(2):1–4
Memon S, Bhatti S, Ali L, Talpur M, Memon M (2018) A video based vehicle detection, counting and classification system. Int J Image Graph Signal Process 9:34–41
Vapnik VN (1998) Statistical learning theory. Wiley, New York
Friedman N, Russell S (1997) Image segmentation in video sequences: a probabilistic approach. In: Proceedings of the thirteenth conference on uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc
Contractorr D, Pathak K, Sharma S, Bhagat S, Sharma T (2016) Cascade classifier based helmet detection using OpenCV in image processing
Gururaj V, Shriya VR, Ashwini K (2019) Stock market prediction using linear regression and support vector machines. Int J Appl Eng Res 14(8):1931–1934
Dahiya K, Singh D, Mohan CK (2016) Automatic detection of bike-riders without helmet using surveillance videos in real-time. In: 2016 international joint conference on neural networks (IJCNN), Vancouver, BC, pp 3046–3051
Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE computer society conference on computer vision and pattern recognition, vol 1, pp 886–893
Lowe DG (1999) Object recognition from local scale-invariant features. In: Computer vision, seventh IEEE international conference
Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110
Chiverton J (2012) Helmet presence classification with motorcycle detection and tracking. IET Intell Transp Syst 6(3):259–269. https://doi.org/10.1049/ietits.2011.0138
Silva R, Aires K, Santos T, Abdala K, Veras R, Soares A (2013) Automatic detection of motorcyclists without helmet. In: 2013 XXXIX Latin American computing conference (CLEI), Naiguata, pp 1–7
Doungmala P, Klubsuwan K (2016) Helmet wearing detection in Thailand using haar like feature and circle hough transform on image processing. In: 2016 IEEE international conference on computer and information technology (CIT), Nadi, pp 611–614. https://doi.org/10.1109/CIT.2016.87.
Vishnu C, Singh D, Mohan CK, Babu S (2017) Detection of motorcyclists without helmet in videos using convolutional neural network. In: 2017 international joint conference on neural networks (IJCNN), Anchorage, AK, pp 3036–3041
Raj KCD, Chairat A, Timtong V, Dailey MN, Ekpanyapong M (2018) Helmet violation processing using deep learning. In: 2018 international workshop on advanced image technology (IWAIT), Chiang Mai, pp 1–4. https://doi.org/10.1109/IWAIT.2018.8369734
Mistry J, Misraa AK, Agarwal M, Vyas A, Chudasama VM, Upla KP (2017) An automatic detection of helmeted and non-helmeted motorcyclist with license plate extraction using convolutional neural network. In: 2017 seventh international conference on image processing theory, tools and applications (IPTA), Montreal, QC, pp 1–6. https://doi.org/10.1109/IPTA.2017.8310092.
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions (2014). arXiv preprint arXiv:1409.4842, 7
Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556
Li K, Zhao X, Bian J, Tan M (2017) Automatic safety helmet wearing detection. In: 2017 IEEE 7th annual international conference on CYBER technology in automation, control, and intelligent systems (CYBER), Honolulu, HI, pp 617–622
Rattapoom W, Nannaphat B, Vasan T, Chainarong T, Pattanawadee P (2013) Machine vision techniques for motorcycle safety helmet detection. In: Proceedings of the international conference on image and vision computing New Zealand (IVCNZ), Wellington, New Zealand, 27–29 November 2013, pp 35–40
Li J et al (2017) Safety helmet wearing detection based on image processing and machine learning. In: 2017 ninth international conference on advanced computational intelligence (ICACI), Doha, pp 201–205. https://doi.org/10.1109/ICACI.2017.7974509
Long X, Cui W, Zheng Z (2019) Safety helmet wearing detection based on deep learning. In: 2019 IEEE 3rd information technology, networking, electronic and automation control conference (ITNEC).https://doi.org/10.1109/itnec.2019.8729039
Marayatr T, Kumhom P (2014) Motorcyclist’s helmet wearing detection using image processing. Adv Mater Res 931–932:588–592. https://doi.org/10.4028/www.scientific.net/AMR.931-932.588
Goyal A, Bhatia R (2016) Automated car number plate detection system to detect far number plates. IOSR J Comput Eng 18(4):34–40
Qadri MT, Asif M (2009) Automatic number plate recoginization system for vehicle identification using optical character recoginization. In: 2009 international conference on education technology and computer
Kuldeepak MK, Vashishath M (2012) License plate recognition system based on image processing using labview. Int J Electron Commun Comput Technol 2(4):183
Kulkarni Y, Bodkhe S, Kamthe A, Patil A (2018) Automatic number plate recognition for motorcyclists riding without helmet. In: 2018 international conference on current trends towards converging technologies (ICCTCT), Coimbatore, pp 1–6. https://doi.org/10.1109/ICCTCT.2018.8551001
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sanjana, S., Sanjana, S., Shriya, V.R. et al. A review on various methodologies used for vehicle classification, helmet detection and number plate recognition. Evol. Intel. 14, 979–987 (2021). https://doi.org/10.1007/s12065-020-00493-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12065-020-00493-7