Skip to main content
SpringerLink
Log in

License Plate Recognition Using Deep FCN

  • Conference paper
  • First Online:
Cognitive Systems and Signal Processing (ICCSIP 2016)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 710))

Included in the following conference series:

Abstract

In our work, we concentrate on the problem of car license plate recognition after the plate has been extracted from an image. Traditional methods approach this problem as three separate steps: preprocessing, segmentation, and recognition. In this paper, we propose a unified approach that integrates these steps using a fully convolutional network. We train a 36-class FCN on a dataset of single characters and apply it to height-normalized license plates. The architecture of this model successfully reduces the loss in detail during end-to-end convolution. Finally, we extract the results from the output sequences of probabilities using a variant of the NMS algorithm. The experiments on public license plate datasets show that our approach outperforms the state-of-the-art methods.

This research is conducted during the Research Science Initiative — Tsinghua 2016.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Liu, G., Ma, Z., Du, Z., Wen, C.: The calculation method of road travel time based on license plate recognition technology. In: Tan, H., Zhou, M. (eds.) Advances in Information Technology and Education. Communications in Computer and Information Science, vol. 201, pp. 385–389. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  2. Chiou, Y.C., Lan, L.W., Tseng, C.M., Fan, C.C.: Optimal locations of license plate recognition to enhance the origin-destination matrix estimation. In: Proceedings of the Eastern Asia Society for Transportation Studies, vol. 2011, p. 297. Eastern Asia Society for Transportation Studies (2011)

    Google Scholar 

  3. Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans. Circ. Syst. Video Technol. 23(2), 311–325 (2013)

    Article  Google Scholar 

  4. Llorens, D., Marzal, A., Palazón, V., Vilar, J.M.: Car license plates extraction and recognition based on connected components analysis and HMM decoding. In: Marques, J.S., Pérez de la Blanca, N., Pina, P. (eds.) IbPRIA 2005. LNCS, vol. 3522, pp. 571–578. Springer, Heidelberg (2005). doi:10.1007/11492429_69

    Chapter  Google Scholar 

  5. Lee, E.R., Kim, P.K., Kim, H.J.: Automatic recognition of a car license plate using color image processing. In: IEEE International Conference on Image Processing, 1994 Proceedings, ICIP-1994, vol. 2, pp. 301–305. IEEE, November 1994

    Google Scholar 

  6. Busch, C., Domer, R., Freytag, C., Ziegler, H.: Feature based recognition of traffic video streams for online route tracing. In: 48th IEEE Vehicular Technology Conference, 1998, VTC 1998, vol. 3, pp. 1790–1794. IEEE, May 1998

    Google Scholar 

  7. Fan, X., Fan, G.: Graphical models for joint segmentation and recognition of license plate characters. IEEE Sig. Process. Lett. 16(1), 10–13 (2009)

    Article  Google Scholar 

  8. Wang, T., Wu, D.J., Coates, A., Ng, A.Y.: End-to-end text recognition with convolutional neural networks. In: 2012 21st International Conference on Pattern Recognition (ICPR), pp. 3304–3308. IEEE, November 2012

    Google Scholar 

  9. Matan, O., Burges, C.J., LeCun, Y., Denker, J.S.: Multi-digit recognition using a space displacement neural network. In: NIPS, pp. 488–495 (1991)

    Google Scholar 

  10. Neubeck, A., Van Gool, L.: Efficient non-maximum suppression. In: 18th International Conference on Pattern Recognition (ICPR 2006), vol. 3, pp. 850–855. IEEE, August 2006

    Google Scholar 

  11. Wen, Y., Lu, Y., Yan, J., Zhou, Z., von Deneen, K.M., Shi, P.: An algorithm for license plate recognition applied to intelligent transportation system. IEEE Trans. Intell. Transp. Syst. 12(3), 830–845 (2011)

    Article  Google Scholar 

  12. Li, H., Shen, C.: Reading Car License Plates Using Deep Convolutional Neural Networks and LSTMs. arXiv preprint arXiv:1601.05610 (2016)

  13. Paliy, I., Turchenko, V., Koval, V., Sachenko, A., Markowsky, G.: Approach to recognition of license plate numbers using neural networks. In: Proceedings of IEEE International Joint Conference on Neural Networks, vol. 4, pp. 2965–2970, July 2004

    Google Scholar 

  14. Jaderberg, M., Vedaldi, A., Zisserman, A.: Deep features for text spotting. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 512–528. Springer, Cham (2014). doi:10.1007/978-3-319-10593-2_34

    Google Scholar 

  15. Ioffe, S., Szegedy, C.: Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)

  16. He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1026–1034 (2015)

    Google Scholar 

  17. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385 (2015)

  18. Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)

    Google Scholar 

  19. Hsu, G.S., Chen, J.C., Chung, Y.Z.: Application-oriented license plate recognition. IEEE Trans. Veh. Technol. 62(2), 552–561 (2013)

    Article  Google Scholar 

  20. de Campos, T.E., Babu, B.R., Varma, M.: Character recognition in natural images. In: VISAPP, no. 2, pp. 273–280, February 2009

    Google Scholar 

  21. Lee, S., Cho, M.S., Jung, K., Kim, J.H.: Scene text extraction with edge constraint and text collinearity. In: 2010 20th International Conference on Pattern Recognition (ICPR), pp. 3983–3986. IEEE, August 2010

    Google Scholar 

  22. Mishra, A., Alahari, K., Jawahar, C.V.: Top-down and bottom-up cues for scene text recognition. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2687–2694. IEEE, June 2012

    Google Scholar 

  23. Wang, K., Babenko, B., Belongie, S.: End-to-end scene text recognition. In: 2011 International Conference on Computer Vision, pp. 1457–1464. IEEE, November 2011

    Google Scholar 

  24. Caltech plate dataset (2003). http://www.vision.caltech.edu/html-files/archive.htm

  25. Ganesh, V.: Parking lot monitoring system using an autonomous quadrotor UAV (2015)

    Google Scholar 

  26. Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)

    Google Scholar 

Download references

Acknowledgements

I want to give special thanks to Ruoqi Zhang and Fanfu Shentu, who helped me during data collection and network visualization. Also, I would like to thank my writing coach, Aradhana Sinha, and tutor, Ms. Qianhui Wu, who helped me revise my paper.

Last but not the least, I would like to show my gratitude to Tsinghua University and Center for Excellence in Education for the computational resources and for providing me with such a wonderful research opportunity this summer.

Author information

Authors and Affiliations

  1. Shenzhen College of International Education, Shenzhen, China

    Yue Wu

  2. State Key Laboratory of Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology, Department of Computer Science and Technology, Tsinghua University, Beijing, China

    Jianmin Li

Authors
  1. Yue Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jianmin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yue Wu .

Editor information

Editors and Affiliations

  1. Tsinghua University, Beijing, China

    Fuchun Sun

  2. Department of Computer Science and Technology, Tsinghua University, Beijing, China

    Huaping Liu

  3. College of Mechatronics and Automation, National University of Defense Technology, Changsha, China

    Dewen Hu

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Wu, Y., Li, J. (2017). License Plate Recognition Using Deep FCN. In: Sun, F., Liu, H., Hu, D. (eds) Cognitive Systems and Signal Processing. ICCSIP 2016. Communications in Computer and Information Science, vol 710. Springer, Singapore. https://doi.org/10.1007/978-981-10-5230-9_25

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-5230-9_25

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-5229-3

  • Online ISBN: 978-981-10-5230-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation