Skip to main content
Springer Nature Link
Log in

Banknote serial number recognition using deep learning

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we recognize serial numbers on banknotes using deep learning. The samples used in this paper are digital images which have been preprocessed with data labelling and data augmentation, e.g., scaling transformation, etc. The algorithms based on deep learning are proposed and have the stability for serial number recognition with complex backgrounds. In this paper, a pipeline of deep neural networks is established for the recognition of banknote serial numbers. Because high reliability is more important than accuracy in financial applications, DenseNet is set forth as the primary classifier, the scaling transformation of SegLink is put forward to locate the characters, the detection rate is up to 95.80%. A convolutional neural network with residual attention model is proposed for serial number recognition, the precision is up to 97.09%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Arlot S, Celisse A (2010) A survey of cross-validation procedures for model selection. Statistics Surveys 4:40–79

    Article  MathSciNet  Google Scholar 

  2. Athiwaratkun B, Stokes JW (2017) Malware classification with LSTM and GRU language models and a character-level CNN. In IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp 2482-2486)

  3. Ban SW, Lee I, Lee M (2008) Dynamic visual selective attention model. Neurocomputing 71(4–6):853–856

    Article  Google Scholar 

  4. Bissacco A, Cummins M, Netzer Y, Neven H (2013). PhotoOCR: Reading text in uncontrolled conditions. In the IEEE international conference on computer vision. (pp 785-792)

  5. Buntscheck W, Stein D, Wilfer K (2015) U.S. Patent No. 9,123,192. U.S. Patent and Trademark Office, Washington, DC

    Google Scholar 

  6. Cao P, Chen Y, Liu K, Zhao J (2018) Adversarial transfer learning for Chinese named entity recognition with self-attention mechanism. International Conference on Empirical Methods in Natural Language Processing

  7. Chowdhury MA, Deb K (2013) Extracting and segmenting container name from container images. Int J Comput Appl 74(19):18–22

    Google Scholar 

  8. De Campos TE, Babu BR, Varma M (2009) Character recognition in natural images. VISAPP 2:7

    Google Scholar 

  9. Defferrard M, Bresson X, Vandergheynst P (2016) Convolutional neural networks on graphs with fast localized spectral filtering. In advances in neural information processing systems (pp. 3844-3852)

  10. Dolz J, Gopinath K, Yuan J, Lombaert H, Desrosiers C, Ayed IB (2018) HyperDense-net: a hyper-densely connected CNN for multi-modal image segmentation. IEEE Trans Med Imaging 38(5):1116–1126

    Article  Google Scholar 

  11. Fan Y, Lu X, Li D, Liu Y (2016) Video-based emotion recognition using CNN-RNN and C3D hybrid networks. In ACM international conference on multimodal interaction (pp 445-450)

  12. Gao Y, Chen Y, Wang J, Tang M, Lu H (2019) Reading scene text with fully convolutional sequence modeling. Neurocomputing 339:161–170

    Article  Google Scholar 

  13. Ghadhban HQ, Othman M, Samsudin NA, Ismail MNB, Hammoodi MR (2020) Survey of offline Arabic handwriting word recognition. In international conference on soft computing and data mining (pp 358-372). Springer

  14. Guan J, Lai R, Xiong A, Liu Z, Gu L (2020) Fixed pattern noise reduction for infrared images based on cascade residual attention CNN. Neurocomputing 377:301–313

    Article  Google Scholar 

  15. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In IEEE conference on computer vision and pattern recognition (pp 4700-4708)

  16. Huang J, Rathod V, Sun C, Zhu M, Korattikara A, Fathi A, Guadarrama S (2017) Speed/accuracy trade-offs for modern convolutional object detectors. In IEEE conference on computer vision and pattern recognition (pp 7310-7311)

  17. Huang G, Liu S, Van der Maaten L, Weinberger KQ (2018) CondenseNet: an efficient densenet using learned group convolutions. In IEEE Conference on Computer Vision and Pattern Recognition

  18. Jayadevan R, Kolhe SR, Patil PM, Pal U (2012) Automatic processing of handwritten bank cheque images: a survey. Int J Docum Analys Recognition (IJDAR) 15(4):267–296

    Article  Google Scholar 

  19. Khomenko V, Shyshkov O, Radyvonenko O, Bokhan K (2016) Accelerating recurrent neural network training using sequence bucketing and multi-GPU data parallelization. In IEEE international conference on Data Stream Mining & Processing (DSMP) (pp 100-103)

  20. Kong T, Sun F, Tan C, Liu H, Huang W (2018) Deep feature pyramid reconfiguration for object detection. In European conference on computer vision (pp 169-185)

  21. Kumar A, Sangwan SR, Arora A, Nayyar A, Abdel-Basset M (2019) Sarcasm detection using soft attention-based bidirectional long short-term memory model with convolution network. IEEE Access 7:23319–23328

    Article  Google Scholar 

  22. Lee C-Y, Osindero S (2016) Recursive recurrent nets with attention modeling for OCR in the wild. In IEEE conference on computer vision and pattern recognition (pp.2231-2239)

  23. Li J, Cheng J-h, Shi J-y, Huang F (2012) Brief introduction of back propagation (BP) neural network algorithm and its improvement. In the Advances in Computer Science and Information Engineering, pp 553–558

  24. Li Y, Hu H, Zhu Z, Zhou G (2020) SCANet: sensor-based continuous authentication with two-stream convolutional neural networks. ACM Trans Sens Networks 16(3):1–26

    Article  Google Scholar 

  25. Li Y, Hu H, Zhou G Using data augmentation in continuous authentication on smartphones. IEEE Internet Things 6(1):628–640

  26. Liang S, Zhang R, Liang D, Song T, Ai T, Xia C, Wang Y (2018) Multimodal 3D DenseNet for IDH genotype prediction in gliomas. Genes 9(8):382

    Article  Google Scholar 

  27. Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C-Y, Berg AC (2016) SSD: single shot multibox detector. In European conference on computer vision (pp 21-37)

  28. Ma N, Zhang X, Zheng HT, Sun J (2018) Shufflenet v2: practical guidelines for efficient CNN architecture design. In European conference on computer vision (pp 116-131)

  29. Mahmood H (2020) Text detection and recognition from natural images (PhD dissertation), Loughborough University

  30. Mohamad NS, Hussin B, Shibghatullah AS, Basari A (2014) Banknote authentication using artificial neural network. Sci Int:1865-1868

  31. Mu R, Zeng X (2019) A review of deep learning research. TIIS 13(4):1738–1764

    Google Scholar 

  32. Nweke HF, Teh YW, Al-Garadi MA, Alo UR (2018) Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: state of the art and research challenges. Expert Syst Appl 105:233–261

    Article  Google Scholar 

  33. Peddinti V, Povey D, Khudanpur S (2015) A time delay neural network architecture for efficient modeling of long temporal contexts. In Annual Conference of the International Speech Communication Association

  34. Peters GW, Panayi E (2016) Understanding modern banking ledgers through blockchain technologies: future of transaction processing and smart contracts on the internet of money. In banking beyond banks and money (pp 239-278). Springer

  35. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In IEEE conference on computer vision and pattern recognition (pp 779-788)

  36. Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In the advances in neural information processing systems (pp 91-99)

  37. Ryan M, Hanafiah N (2015) An examination of character recognition on ID card using template matching approach. Procedia Comput Sci 59(520–529):520–529

    Article  Google Scholar 

  38. Schroth G, Hilsenbeck S, Huitl R, Schweiger F, Steinbach E (2011) Exploiting text-related features for content-based image retrieval. In IEEE international symposium on multimedia (pp 77-84)

  39. Schulz R, Talbot B, Lam O, Dayoub F, Corke P, Upcroft B, Wyeth G (2015) Robot navigation using human cues: a robot navigation system for symbolic goal-directed exploration. In IEEE international conference on robotics and automation (ICRA) (pp 1100-1105)

  40. Shi B, Bai X, Belongie S (2017) Detecting oriented text in natural images by linking segments. In IEEE conference on computer vision and pattern recognition (pp 2550-2558)

  41. Sufri NAJ, Rahmad NA, Ghazali NF, Shahar N, As’ari MA (2019) Vision based system for banknote recognition using different machine learning and deep learning approach. In IEEE control and system graduate research colloquium (pp 5-8). IEEE

  42. Tao C, Gao S, Shang M, Wu W, Zhao D, Yan R (2018) Get the point of my utterance! Learning towards effective responses with multi-head attention mechanism. In IJCAI

  43. Tay F, Cao L (2001) Application of support vector machine (SVM) on serial number identification of RMB. Omega 29(4):309–317

    Article  Google Scholar 

  44. Tran A, Cheong LF (2017) Two-stream flow-guided convolutional attention networks for action recognition. In IEEE international conference on computer vision workshops (pp 3110-3119)

  45. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Polosukhin I (2017) Attention is all you need. In the Advances in neural information processing system

  46. Xu H, Saenko K (2016). Ask, attend and answer: exploring question-guided spatial attention for visual question answering. In European conference on computer vision (pp 451-466)

  47. Yan WQ (2019) Introduction to intelligent surveillance: surveillance data capture, transmission, and analytics. Springer (pp 9-15)

  48. Yan H, He Q, Xie W (2020) CRNN-CTC based mandarin keywords spotting. In IEEE international conference on acoustics, speech and signal processing (pp 7489-7493)

  49. Zhang Q, Yan W (2018) Currency recognition using deep learning. IEEE AVSS (pp 1-6)

  50. Zhang Z, Shen W, Yao C, Bai X (2015) Symmetry-based text line detection in natural scenes. In IEEE conference on computer vision and pattern recognition (pp 2558-2567)

  51. Zhang Q, Yan W, Kankanhalli M (2019) Overview of currency recognition using deep learning. J Banking Financial Technol 3(1):59–69

    Article  Google Scholar 

  52. Zhao T, Zhao J, Zheng R, Zhang L (2010) Study on RMB number recognition based on genetic algorithm artificial neural network. In international congress on image and signal processing (pp 1951-1955)

  53. Zhu Y, Yao C, Bai X (2016) Scene text detection and recognition: recent advances and future trends. Front Comput Sci 10(1):19–36

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Auckland University of Technology, Auckland, 1010, New Zealand

    Xin Ma & Wei Qi Yan

Authors
  1. Xin Ma
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Wei Qi Yan
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Wei Qi Yan.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ma, X., Yan, W.Q. Banknote serial number recognition using deep learning. Multimed Tools Appl 80, 18445–18459 (2021). https://doi.org/10.1007/s11042-020-10461-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10461-z

Keywords