Abstract
License plate recognition has gained extensive applications in many fields. Some interesting algorithms and models have been developed to deal with the issues in the location, segmentation and recognition processes. This paper focuses on the intelligent recognition of Chinese license plates with daily life backgrounds by designing new convolutional neural networks. Firstly, to extract Chinese license plates from the images subject to daily life backgrounds, which is more difficult than from those with fixed background, a color edge algorithm is proposed to detect specific edges of input image. A color-depressed grayscale conversion method is presented to preprocess plate samples with poor quality, and an improved relocation method is given to eliminate plate frames. Then a combination of connected component analysis and projection analysis is implemented for the segmentation. Finally, simplified and recurrent convolutional neural networks are designed to automatically recognize the characters (the first one is Chinese character, which is followed by six alphanumeric characters). A total of 2189 images containing Chinese license plates are collected manually with different backgrounds. Tested on these samples, the location rate of \(98.95\%\), segmentation rate of \(96.58\%\) and recognition rate of \(98.09\%\) are, respectively, achieved by our algorithms. The accuracy rate of recognition of Chinese license plates reaches \(93.74\%\), and it averagely takes 318 ms to complete the recognition of a license plate, which meets the real-time processing requirement.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Abolghasemi V, Ahmadyfard A (2009) An edge-based color-aided method for license plate detection. Image Vis Comput 27(8):1134–1142
Anagnostopoulos CNE, Anagnostopoulos IE, Loumos V, Kayafas E (2006) A license plate-recognition algorithm for intelligent transportation system applications. IEEE Trans Intell Transp Syst 7(3):377–392
Ashtari AH, Nordin MdJ, Fathy M (2014) An Iranian license plate recognition system based on color features. IEEE Trans Intell Transp Syst 15(4):1690–1705
Bai H, Liu C (2003) A hybrid license plate extraction method based on edge statistics and morphology. In: Proceedings of intelligent transportation systems, pp 985-987
Cabido R, Montemayor AS, Pantrigo JJ (2012) High performance memetic algorithm particle filter for multiple object tracking on modern GPUs. Soft Comput 16(2):217–230
Chang CC, Lin D (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):1–27. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
Chang SL, Chen LS, Chung YC, Chen SW (2004) Automatic license plate recognition. IEEE Trans Intell Transp Syst 5(1):42–53
Cho BK, Ryu SH, Shin DR, Jung JI (2011) License plate extraction method for identification of vehicle violations at a railway level crossing. Int J Automot Technol 12(2):281–289
Dashtban MH, Dashtban Z, Bevrani H (2011) A novel approach for vehicle license plate localization and recognition. Int J Comput Appl 26(11):22–30
Du S, Badawy W (2013) Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans Circuits Syst Video Technol 23(2):311–325
EI-said SA (2015) Shadow aware license plate recognition system. Soft Comput 19(1):225–235
Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of international conference on artificial intelligence and statistics, vol 9, pp 249–256
Guo JM, Liu YF (2008) License plate localization and character segmentation with feedback self-learning and hybrid binarization techniques. IEEE Trans Veh Technol 57(3):1417–1424
Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov RR (2012) Improving neural networks by preventing co-adaptation of feature detectors. arXiv:1207.0580
Hsu GS, Chen JC, Chung YZ (2013) Application-oriented license plate recognition. IEEE Trans Veh Technol 62(2):552–561
Huang J, Li J, Yu D, Deng L, Gong Y (2013) Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers. In: Proceedings of international conference on acoustics, speech and signal processing, pp 7304–7308
Jiao J, Ye Q, Huang Q (2009) A configurable method for multi-style license plate recognition. Pattern Recognit 42(3):358–369
Jia W, Zhang H, He X, Piccardi M (2005) Mean shift for accurate license plate localization. In: Proceedings of the 8th international IEEE conference on intelligent transportation systems, pp 566–571
Jin L, Xian H, Bie J (2012) License plate recognition algorithm for passenger cars in Chinese residential areas. Sensors 12(6):8355–8370
Jung K (2001) Neural network-based text location in color images. Pattern Recognit Lett 22(14):1503–1515
Kanayama K, Fujikawa Y, Fujimoto K, Horino M (1991) Development of vehicle-license number recognition system using real-time image processing and its application to travel-time measurement. In: Proceedings of IEEE vehicle technology conference, pp 798–804
Kasaei SH, Kasaei SM, Kasaei SA (2010) New morphology based method for robust Iranian car plate detection and recognition. Int J Comput Theory Eng 2(2):264–268
Kim K-B, Cho J-H (2007) Recognition of identifiers from shipping container images using fuzzy binarization and enhanced fuzzy RBF network. Soft Comput 11:213–220
Kim I, Xie X (2015) Handwritten Hangul recognition using deep convolutional neural networks. Int J Doc Anal Recognit 18:1–13
LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324
Li W, Liang D, Wang X, Yu D (2004) Character segmentation for degraded license plate. J Computer-aided Des Comput Graph 16(5):698–703
Liu Y, Huang H (2015) Car plate character recognition using a convolutional neural network with shared hidden layers. In: Proceedings of the 2015 Chinese automation congress, pp 638–643
Moon H-M, Seo CH, Pan SB (2016) A face recognition system based on convolution neural network using multiple distance face. Soft Comput. doi:10.1007/s00500-016-2095-0
Moreira-Matias L, Cats O, Gama J, Mendes-Moreira J, de Sousa JF (2016) An online learning approach to eliminate Bus Bunching in real-time. Appl Soft Comput 47:460–482
Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern SMC 9(1):62–66
Rasooli M, Branch T, Ghofrani S, Fatemizadeh E (2011) Farsi license plate detection based on element analysis and characters recognition. Int J Signal Process Image Process Pattern Recognit 4(1):65–80
Rouhani M, Javan DS (2016) Two fast and accurate heuristic RBF learning rules for data classification. Neural Netw 75:150–161
Sulehria HK, Zhang Y, Irfan D, Sulehria AK (2008) Vehicle number plate recognition using mathematical morphology and neural networks. WSEAS Trans Comput 7(6):781–790
Wang F, Man L, Wang B, Xiao Y, Pan W, Lu X (2008) Fuzzy-based algorithm for color recognition of license plates. Pattern Recognit Lett 29(7):1007–1020
Wang M, Chen Y, Wang X (2014) Recognition of handwritten characters in Chinese legal amounts by stacked autoencoders. In: Proceedings of international conference on pattern recognition, pp 3002–3007
Wen Y, Lu Y, Shi PF (2007) Handwritten Bangla numeral recognition system and its application to postal automation. Pattern Recognit 40(1):99–107
Wen Y, Lu Y, Yan J, Zhou Z, von Deneen KM, Shi PF (2011) An algorithm for license plate recognition applied to intelligent transportation system. IEEE Trans Intell Transp Syst 12(3):830–835
Wu C, Fan W, He Y, Sun J, Naoi S (2014) Handwritten character recognition by alternately trained relaxation convolutional neural network. In: Proceedings of international conference on frontiers in handwriting recognition, pp 291–296
Yao Y, Rosasco L, Caponnetto A (2007) On early stopping in gradient descent learning. Constr Approx 26(2):289–315
Zhang Y, Zhang C (2003) A new algorithm for character segmentation of license plate. In: IEEE intelligent vehicles symposium, pp 106–109
Zheng D, Zhao Y, Wang J (2005) An efficient method of license plate location. Pattern Recognit Lett 26:2431–2438
Zhou W, Li H, Lu Y, Tian Q (2012) Principal visual word discovery for automatic license plate detection. IEEE Trans Image Process 21(9):4269–4279
Zunino R, Rovetta S (2000) Vector quantization for license-plate location and image coding. IEEE Trans Ind Electron 47(1):159–167
Acknowledgements
This study was funded by the Qing Lan Project of Jiangsu Province, the National Natural Science Foundation of China under Grant Nos. 61273122 and 61573106, and the National Priority Research Project NPRP 8-274-2-107.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Communicated by V. Loia.
Rights and permissions
About this article
Cite this article
Liu, Y., Huang, H., Cao, J. et al. Convolutional neural networks-based intelligent recognition of Chinese license plates. Soft Comput 22, 2403–2419 (2018). https://doi.org/10.1007/s00500-017-2503-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-017-2503-0