Abstract
Recognizing car license plates in natural scene images is an important yet challenging task in intelligent transport systems. Most of current methods perform well for license plates collected under constrained conditions [1], e.g., from a single region with specific patterns or shot in front-view with nearly horizontal position. In this work, we propose a simple yet robust approach for license plate recognition under complex conditions. It is composed of an off-the-shelf Xception module and 2-dimension attention based image to sequence learning framework. Despite its simplicity, the proposed model can recognize license plates under various scenarios, including license plates captured in dark or strong lighting conditions, from different regions, oriented, distorted, or even blurred. A CycleGAN based method is employed to generate synthetic license plate images with different province characters and under various situations (shadow, darkness, glare, etc.), which enriches the training data largely and improves the recognition capability greatly. The proposed model achieves state-of-the-art recognition performance on various datasets, which demonstrates its effectiveness and robustness.
The first author is a student. This work is supported in part by the National Natural Science Foundation of China (No. 61876152).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Gruzdev, A., Zherzdev, S.: LPRNet: license plate recognition via deep neural networks. arXiv preprint arXiv:1806.10447 (2018)
Li, H., Shen, C.: Reading car license plates using deep convolutional neural networks and LSTMs. arXiv preprint arXiv:1601.05610 (2016)
Xu, Z., Yang, W., Meng, A., Lu, N., Huang, H., Ying, C., Huang, L.: Towards end-to-end license plate detection and recognition: a large dataset and baseline. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11217, pp. 261–277. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01261-8_16
Silva, S.M., Jung, C.R.: License plate detection and recognition in unconstrained scenarios. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11216, pp. 593–609. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01258-8_36
Redmon, J., Farhadi, A.: Yolo9000: better, faster, stronger. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7263–7271 (2017)
Gou, C., Wang, K., Yao, Y., Li, Z.: Vehicle license plate recognition based on extremal regions and restricted Boltzmann machines. IEEE Trans. Intell. Transp. Syst. 17(4), 1096–1107 (2015)
Guo, J.-M., Liu, Y.-F.: License plate localization and character segmentation with feedback self-learning and hybrid binarization techniques. IEEE Trans. Veh. Technol. 57(3), 1417–1424 (2008)
Gonçalves, G.R., da Silva, S.P.G., Menotti, D., Schwartz, W.R.: Benchmark for license plate character segmentation. J. Electron. Imaging 25(5), 053034 (2016)
Li, H., Wang, P., Shen, C.: Towards end-to-end car license plates detection and recognition with deep neural networks. corr abs/1709.08828 (2017)
Duan, S., Hu, W., Li, R., Li, W., Sun, S.: Attention enhanced ConvNet-RNN for Chinese vehicle license plate recognition. In: Chinese Conference on Pattern Recognition and Computer Vision (PRCV) (2018)
Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)
Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)
Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015)
Mirza, M., Osindero, S.: Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784 (2014)
Arjovsky, M., Chintala, S., Bottou, L.: Wasserstein gan. arXiv preprint arXiv:1701.07875 (2017)
Zhu, J.-Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2223–2232 (2017)
Hsu, G.-S., Chen, J.-C., Chung, Y.-Z.: Application-oriented license plate recognition. IEEE Trans. Veh. Technol. 62(2), 552–561 (2012)
Yuan, Y., Zou, W., Zhao, Y., Wang, X., Xuefeng, H., Komodakis, N.: A robust and efficient approach to license plate detection. IEEE Trans. Image Process. 26(3), 1102–1114 (2016)
Wang, S.-Z., Lee, H.-J.: A cascade framework for a real-time statistical plate recognition system. IEEE Trans. Inf. Forensics Secur. 2(2), 267–282 (2007)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)
Liu, W., et al.: SSD: single shot MultiBox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9905, pp. 21–37. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46448-0_2
Wu, C., Xu, S., Song, G., Zhang, S.: How many labeled license plates are needed? In: Lai, J.-H., et al. (eds.) PRCV 2018. LNCS, vol. 11259, pp. 334–346. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-03341-5_28
Masood, S.Z., Shu, G., Dehghan, A., Ortiz, E.G.: License plate detection and recognition using deeply learned convolutional neural networks. arXiv preprint arXiv:1703.07330 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, L., Wang, P., Dang, F., Zhang, S. (2019). A Simple and Robust Attentional Encoder-Decoder Model for License Plate Recognition. In: Lin, Z., et al. Pattern Recognition and Computer Vision. PRCV 2019. Lecture Notes in Computer Science(), vol 11857. Springer, Cham. https://doi.org/10.1007/978-3-030-31654-9_26
Download citation
DOI: https://doi.org/10.1007/978-3-030-31654-9_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-31653-2
Online ISBN: 978-3-030-31654-9
eBook Packages: Computer ScienceComputer Science (R0)