Abstract
This paper proposes an automatic license plate recognition system for the Devanagari license plate (LP) in a static environment. The LP region is detected and localized using YOLOv3. The RGB mask of localized LP region is converted into HSV color space; and saturation mask of HSV color is processed using the CLAHE algorithm to segment unwanted regions from LP. The noise-free LP mask is acquired using different image preprocessing techniques. Skew correction is performed in the subsequent stage, followed by segmentation of LP characters using horizontal and vertical projection profiles. The characters are learned and predicted using a Convolution Neural Network (CNN). The CNN model is trained on the 19663 self-created Nepali LP character dataset. The proposed system has 99.2% accuracy on individual character recognition of LP characters and 95.5% accuracy on recognizing whole LP characters. The system is tested on both frontal and rear LPs of private two-wheelers and four-wheelers of Bagmati Zone.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic License Plate Recognition (ALPR): a state-of-the-art review. IEEE Trans. Circuits Syst. Video Technol. 23(2), 311–325 (2013)
Pant, A.K., Gyawali, P.K., Acharya, S.: Automatic nepali number plate recognition with support vector machines. In: Proceedings of the 9th International Conference on Software, Knowledge, Information Management and Applications (SKIMA), pp. 92–99 (2015)
Muhammad, J., Altun, H.: Improved license plate detection using HOG-based features and genetic algorithm. In: 2016 24th Signal Processing and Communication Application Conference (SIU), pp. 1269–1272 (2016). https://doi.org/10.1109/SIU.2016.7495978
Ahmad Yousef, K., Al-Tabanjah, M., Hudaib, E., Ikrai, M.: SIFT based automatic number plate recognition. In: International Conference on Information and Communication Systems. ICICS 2015, pp. 124–129 (2015). https://doi.org/10.1109/IACS.2015.7103214
Bai, H., Liu, C.: A hybrid license plate extraction method based on edge statistics and morphology. In: Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004, vol. 2, pp. 831–834 (2004). https://doi.org/10.1109/ICPR.2004.1334387.
Rabee, A., Barhumi, I.: License plate detection and recognition in complex scenes using mathematical morphology and support vector machines. In: IWSSIP 2014 Proceedings, pp. 59–62 (2014)
MartÃn-RodrÃguez, F., GarcÃa, M., Alba-Castro, J.L.: NEW METHODS FOR AUTOMATIC READING OF VLP’s (2002)
Azad, R., Davami, F., Azad, B.: A novel and robust method for automatic license plate recognition system based on pattern recognition. Adv. Comput. Sci. an Int. J. 2(3), 64–70 (2013)
Jaderberg, M., Simonyan, K., Vedaldi, A., Zisserman, A.: Reading text in the wild with convolutional neural networks. Int. J. Comput. Vision 116(1), 1–20 (2015). https://doi.org/10.1007/s11263-015-0823-z
Wang, T., Wu, D.J., Coates, A., Ng, A.Y.: End-to-end text recognition with convolutional neural networks. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 3304–3308 (2012)
Radzi, S.A., Khalil-Hani, M.: Character Recognition of License Plate Number Using Convolutional Neural Network. In: Zaman, H.B., et al. (eds.) Visual Informatics: Sustaining Research and Innovations, pp. 45–55. Springer Berlin Heidelberg, Berlin, Heidelberg (2011). https://doi.org/10.1007/978-3-642-25191-7_6
Wang, Q., Gao, J., Yuan, Y.: A joint convolutional neural networks and context transfer for street scenes labeling. IEEE Trans. Intell. Transp. Syst. 19(5), 1457–1470 (2018). https://doi.org/10.1109/TITS.2017.2726546
Silva, S.M., Jung, C.R.: Real-time license plate detection and recognition using deep convolutional neural networks. J. Vis. Commun. Image Represent. 71, 102773 (2020). https://doi.org/10.1016/j.jvcir.2020.102773
Rabbani, G., Islam, M.A., Azim, M.A., Islam, M.K., Rahman, M.M.: bangladeshi license plate detection and recognition with morphological operation and convolution neural network. 2018 21st International Conference of Computer and Information Technology ICCIT 2018, pp. 1–5 (2019). https://doi.org/10.1109/ICCITECHN.2018.8631937
Redmon, J., Farhadi, A.: YOLOv3: An Incremental Improvement [Online] (2018). http://arxiv.org/abs/1804.02767
GitHub - AlexeyAB/darknet: YOLOv4 (v3/v2) - Windows and Linux version of Darknet Neural Networks for object detection. https://github.com/AlexeyAB/darknet. Accessed on 05 May 2020
Zuiderveld, K.: Contrast Limited Adaptive Histogram Equalization. In: Graphics Gems IV, pp. 474–485. Academic Press Professional Inc, USA (1994)
Pizer, S., et al.: Adaptive histogram equalization and its variations. Comput. Vis. Graph. Image Process. 39(3), 355–368 (1987). https://doi.org/10.1016/S0734-189X(87)80186-X
Otsu, N.: A Threshold Selection Method from Gray-Level Histogram. Automatica 11, 285–296 (1975)
Ninno, E., Nicchiotti, G., Ottaviani, E.: A general and flexible deskewing method based on generalized projection. In: Bimbo, A. (ed.) ICIAP 1997. LNCS, vol. 1311, pp. 632–638. Springer, Heidelberg (1997). https://doi.org/10.1007/3-540-63508-4_177
Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.R.: Improving neural networks by preventing co-adaptation of feature detectors (2012)
Character_dataset. https://www.kaggle.com/pankajdawadi/nepali-lp-dataset. Accessed on 18 Mar 2021
Acknowledgment
The authors would like to thank Khagendra Acharya for his English editing.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Dawadi, P.R., Pokharel, M., Bal, B.K. (2021). An Approach of Devanagari License Plate Detection and Recognition Using Deep Learning. In: Singh, M., Tyagi, V., Gupta, P.K., Flusser, J., Ören, T., Sonawane, V.R. (eds) Advances in Computing and Data Sciences. ICACDS 2021. Communications in Computer and Information Science, vol 1441. Springer, Cham. https://doi.org/10.1007/978-3-030-88244-0_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-88244-0_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-88243-3
Online ISBN: 978-3-030-88244-0
eBook Packages: Computer ScienceComputer Science (R0)