Skip to main content
SpringerLink
Log in

Learning to Decipher License Plates in Severely Degraded Images

  • Conference paper
  • First Online:
Pattern Recognition. ICPR International Workshops and Challenges (ICPR 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12666))

Included in the following conference series:

Abstract

License plate recognition is instrumental in many forensic investigations involving organized crime and gang crime, burglaries and trafficking of illicit goods or persons. After an incident, recordings are collected by police officers from cameras in-the-wild at gas stations or public facilities. In such an uncontrolled environment, a generally low image quality and strong compression oftentimes make it impossible to read license plates. Recent works showed that characters from US license plates can be reconstructed from noisy, low resolution pictures using convolutional neural networks (CNN). However, these studies do not involve compression, which is arguably the most prevalent image degradation in real investigations.

In this paper, we present work toward closing this gap and investigate the impact of JPEG compression on license plate recognition from strongly degraded images. We show the efficacy of the CNN on a real-world dataset of Czech license plates.

Using only synthetic data for training, we show that license plates with a width larger than 30 pixels, an SNR above –3 dB, and a JPEG quality factor down to 15 can at least partially be reconstructed. Additional analyses investigate the influence of the position of the character in the license plate and the similarity of characters.

We gratefully acknowledge support by the German Federal Ministry of Education and Research (BMBF) under Grant No. 13N15319, the German Research Foundation GRK Cybercrime (393541319/GRK2475/1-2019), and the German Research Foundation (146371743/TRR 89).

P. Kaiser and F. Schirrmacher—Both authors contributed equally to this work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abdullah, S., Mahedi Hasan, M., Islam, S.: YOLO-based three-stage network for Bangla license plate recognition in Dhaka metropolitan city. In: International Conference on Bangla Speech and Language Processing, pp. 1–6 (2018)

    Google Scholar 

  2. Agarwal, S., Tran, D., Torresani, L., Farid, H.: Deciphering severely degraded license plates. In: Media Watermarking, Security, and Forensics, pp. 138–143 (2017)

    Google Scholar 

  3. Arafat, M.Y., Khairuddin, A.S.M., Khairuddin, U., Paramesran, R.: Systematic review on vehicular licence plate recognition framework in intelligent transport systems. IET Intel. Transport Syst. 13, 745–755 (2019)

    Article  Google Scholar 

  4. Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans. Circuits Syst. Video Technol. 23(2), 311–325 (2013)

    Google Scholar 

  5. Farid, H.: Photo Forensics. MIT Press, Cambridge (2016)

    Book  Google Scholar 

  6. Glorot, X., Bengio, Y.: Understanding the difficulty of training deep feedforward neural networks. In: International Conference on Artificial Intelligence and Statistics, pp. 249–256 (2010)

    Google Scholar 

  7. Gonçalves, G.R., Diniz, M.A., Laroca, R., Menotti, D., Schwartz, W.R.: Real-time automatic license plate recognition through deep multi-task networks. In: 31st Conference on Graphics, Patterns and Images, pp. 110–117 (2018)

    Google Scholar 

  8. Goodfellow, I., Bulatov, Y., Ibarz, J., Arnoud, S., Shet, V.: Multi-digit number recognition from street view imagery using deep convolutional neural networks. In: International Conference on Learning Representations (2014)

    Google Scholar 

  9. Jaderberg, M., Simonyan, K., Vedaldi, A., Zisserman, A.: Reading text in the wild with convolutional neural networks. Int. J. of Comput. Vis. 116(1), 1–20 (2016)

    Article  MathSciNet  Google Scholar 

  10. Kilic, I., Aydin, G.: Turkish vehicle license plate recognition using deep learning. In: International Conference on Artificial Intelligence and Data Processing, pp. 1–5 (2018)

    Google Scholar 

  11. Li, H., Wang, P., You, M., Shen, C.: Reading car license plates using deep neural networks. Image Vis. Comput. 72, 14–23 (2018)

    Article  Google Scholar 

  12. Liu, L., Zhang, H., Feng, A., Wan, X., Guo, J.: Simplified local binary pattern descriptor for character recognition of vehicle license plate. In: International Conference on Computer Graphics, Imaging and Visualization, pp. 157–161 (2010)

    Google Scholar 

  13. Liu, P., Li, G., Tu, D.: Low-quality license plate character recognition based on CNN. In: International Symposium on Computational Intelligence and Design, pp. 53–58 (2015)

    Google Scholar 

  14. Llorens, D., Marzal, A., Palazón, V., Vilar, J.M.: Car license plates extraction and recognition based on connected components analysis and HMM decoding. In: Pattern Recognition and Image Analysis, pp. 571–578 (2005)

    Google Scholar 

  15. Lorch, B., Agarwal, S., Farid, H.: Forensic reconstruction of severely degraded license plates. In: Electronic Imaging (January 2019)

    Google Scholar 

  16. Ministerstvo vnitra České republiky: Collection of laws no. 343/2014 (2014). https://aplikace.mvcr.cz/sbirka-zakonu/ViewFile.aspx?type=z&id=27609

  17. Pei-Lun, H., Liang, Y.M., Liao, H.Y.M.: Recognition of blurred license plate images. In: IEEE International Workshop on Information Forensics and Security (2010)

    Google Scholar 

  18. Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: IEEE Conference on Computer Vision and Pattern Recognition (2016)

    Google Scholar 

  19. Shivakumara, P., Tang, D., Asadzadeh, M., Lu, T., Pal, U., Anisi, H.: CNN-RNN based method for license plate recognition. CAAI Trans. on Intell. Technol. 3(3), 169–175 (2018)

    Article  Google Scholar 

  20. Silva, S.M., Jung, C.R.: Real-time Brazilian license plate detection and recognition using deep convolutional neural networks. In: Conference on Graphics, Patterns and Images, pp. 55–62 (2017)

    Google Scholar 

  21. Silva, S.M., Jung, C.R.: License plate detection and recognition in unconstrained scenarios. In: European Conference on Computer Vision, pp. 580–596 (2018)

    Google Scholar 

  22. Špaňhel, J., Sochor, J., Juránek, R., Herout, A., Maršík, L., Zemčík, P.: Holistic recognition of low quality license plates by CNN using track annotated data. In: IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 1–6 (2017)

    Google Scholar 

  23. Suvarnam, B., Ch, V.S.: Combination of CNN-GRU model to recognize characters of a license plate number without segmentation. In: International Conference on Advanced Computing & Communication Systems, pp. 317–322 (2019)

    Google Scholar 

  24. Wen, Y., Lu, Y., Yan, J., Zhou, Z., Von Deneen, K., Shi, P.: An algorithm for license plate recognition applied to intelligent transportation system. IEEE Trans. Intell. Transp. Syst. 12, 830–845 (2011)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. IT Security Infrastructures Lab, Computer Science, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany

    Paula Kaiser, Franziska Schirrmacher, Benedikt Lorch & Christian Riess

Authors
  1. Paula Kaiser
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Franziska Schirrmacher
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Benedikt Lorch
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Christian Riess
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Franziska Schirrmacher .

Editor information

Editors and Affiliations

  1. Dipartimento di Ingegneria dell’Informazione, University of Firenze, Firenze, Italy

    Alberto Del Bimbo

  2. Dipartimento di Ingegneria “Enzo Ferrari”, Università di Modena e Reggio Emilia, Modena, Italy

    Rita Cucchiara

  3. Department of Computer Science, Boston University, Boston, MA, USA

    Stan Sclaroff

  4. Dipartimento di Matematica e Informatica, University of Catania, Catania, Italy

    Giovanni Maria Farinella

  5. Cloud & AI, JD.COM, Beijing, China

    Tao Mei

  6. Dipartimento di Ingegneria dell’Informazione, University of Firenze, Firenze, Italy

    Marco Bertini

  7. Computational Sciences Department, National Institute of Astrophysics, Optics and Electronics (INAOE), Tonantzintla, Puebla, Mexico

    Hugo Jair Escalante

  8. Dipartimento di Ingegneria “Enzo Ferrari”, Università di Modena e Reggio Emilia, Modena, Italy

    Roberto Vezzani

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kaiser, P., Schirrmacher, F., Lorch, B., Riess, C. (2021). Learning to Decipher License Plates in Severely Degraded Images. In: Del Bimbo, A., et al. Pattern Recognition. ICPR International Workshops and Challenges. ICPR 2021. Lecture Notes in Computer Science(), vol 12666. Springer, Cham. https://doi.org/10.1007/978-3-030-68780-9_43

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-68780-9_43

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-68779-3

  • Online ISBN: 978-3-030-68780-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation