Skip to main content
SpringerLink
Log in

Multi-scale residual based siamese neural network for writer-independent online signature verification

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

How to extract effective features from a small number of signature samples provided by new registered users and achieve high accuracy authentication is a challenge for researchers in the field of online signature verification. In response to this challenge, we propose a novel writer-independent online signature verification method using the combin ation of one dimensional multi-scale residual based Siamese neural network (1D-MRSNet) and adaptive boosting softmax (ABSoftmax) classification. First of all, we propose a channel attention mechanism based Siamese neural network (CASNet) framework. The proposed CASNet framework can adaptively learn the weights of different signature feature sequences, which makes the network pay more attention to the information of important feature sequences. Since the proposed CASNet framework does not need to train the signature samples registered by new users, it effectively alleviated the problem of insufficient signature samples in practical applications. Next, a multi-scale residual attention mechanism (MSRA) block is proposed to automatically extract the multi-scale features of the signature, so as to improve the representation learning ability of the network. Then, the adaptive boosting (AdaBoost) algorithm is used to construct ABSoftmax classifier to achieve the integrated decision of online signature verification, thereby improving the accuracy of online signature verification. Finally, when using a reference sample, the proposed method has achieved 6.57% equal error rate (EER) and 11.74% EER in MCYT-100 database and SVC 2004-task2 database, respectively. When using five reference samples, the proposed has method achieved 1.38% EER and 2.33% EER in two databases respectively. The results illustrate the proposed method reached a state-of-the art level.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Sharma A, Sundaram S (2016) A novel online signature verification system based on GMM features in a DTW framework. IEEE Trans Inform Forens Secur 12(3):705–718

    Article  Google Scholar 

  2. Al-Hmouz R, Pedrycz W, Daqrouq K et al (2019) Quantifying dynamic time warping distance using probabilistic model in verification of dynamic signatures. Soft Comput 23(2):407–418

    Article  Google Scholar 

  3. Okawa M (2020) Online signature verification using single-template matching with time-series averaging and gradient boosting. Pattern Recogn 102:107227

    Article  Google Scholar 

  4. Yeung D-Y, Chang H, Xiong Y et al (2004) SVC2004: First international signature verification competition. In: International conference on biometric authentication, pp 16–22

  5. Nanni L (2006) Experimental comparison of one-class classifiers for online signature verification. Neurocomputing 69(7-9):869–873

    Article  Google Scholar 

  6. Wan L, Lin Z (2009) Signature Sample Synthesis. Citeseer, pp 1205–1210

  7. Nanni L, Maiorana E, Lumini A et al (2010) Combining local, regional and global matchers for a template protected on-line signature verification system. Expert Syst Appl 37(5):3676–3684

    Article  Google Scholar 

  8. Iranmanesh V, Ahmad SMS, Adnan WW et al (2013) Online signature verification using neural network and pearson correlation features. In: 2013 IEEE conference on open systems (ICOS), pp 18–21

  9. Sae-Bae N, Memon N (2014) Online signature verification on mobile devices. IEEE Trans Inform Forens Secur 9(6):933–947

    Article  Google Scholar 

  10. Swanepoel J, Coetzer J (2014) Feature weighted support vector machines for writer-independent on-line signature verification. In: 2014 14th international conference on frontiers in handwriting recognition, pp 434–439

  11. Ahrabian K, Babaali B (2019) Usage of autoencoders and Siamese networks for online handwritten signature verification. Neural Comput Applic 31(12):9321–9334

    Article  Google Scholar 

  12. Jain A K, Griess F D, Connell S D (2002) On-line signature verification. Pattern Recognit 35(12):2963–2972

    Article  Google Scholar 

  13. Lee L, Berger T (1992) Reliable on-line signature verification systems for point-of-sales applications. IEEE Trans Pattern Anal Mach Intell 18:643–647

    Article  Google Scholar 

  14. Fierrez-Aguilar J, Nanni L, Lopez-Penalba J et al (2005) An on-line signature verification system based on fusion of local and global information. In: International conference on audio-and video-based biometric person authentication, pp 523–532

  15. Guru D, Prakash H (2008) Online signature verification and recognition: an approach based on symbolic representation. IEEE Trans Pattern Anal Mach Intell 31(6):1059–1073

    Article  Google Scholar 

  16. Vorugunti CS, Mukherjee P, Pulabaigari V (2019) OSVNet: convolutional siamese network for writer independent online signature verification. In: 2019 international conference on document analysis and recognition (ICDAR), pp 1470–1475

  17. Lejtman DZ, George SE (2001) On-line handwritten signature verification using wavelets and back-propagation neural networks. In: Proceedings of sixth international conference on document analysis and recognition, pp 992–996

  18. Alpar O, Krejcar O (2018) Online signature verification by spectrogram analysis. Appl Intell 48(5):1189–1199

    Google Scholar 

  19. Zeinali H, Babaali B, Hadian H (2018) Online signature verification using i-vector representation. IET Biometrics 7(5):405–414

    Article  Google Scholar 

  20. Kholmatov A, Yanikoglu B (2005) Identity authentication using improved online signature verification method. Pattern Recognit Lett 26(15):2400–2408

    Article  Google Scholar 

  21. Sharma A, Sundaram S (2016) An enhanced contextual DTW based system for online signature verification using vector quantization. Pattern Recogn Lett 84:22–28

    Article  Google Scholar 

  22. Vivaracho-Pascual C, Faundez-Zanuy M, Pascual JM (2009) An efficient low cost approach for on-line signature recognition based on length normalization and fractional distances. Pattern Recogn 42(1):183–193

    Article  Google Scholar 

  23. Okawa M (2021) Time-series averaging and local stability-weighted dynamic time warping for online signature verification. Pattern Recogn 112:107699

    Article  Google Scholar 

  24. Van BL, Garcia-Salicetti S, Dorizzi B (2007) On using the Viterbi path along with HMM likelihood information for online signature verification. IEEE Transactions on Systems, Man, and Cybernetics Part B (Cybernetics) 37(5):1237–1247

    Article  Google Scholar 

  25. Vorugunti C S, Pulabaigari V, Gorthi R K S S et al (2020) OSVFUsenet: Online Signature Verification by feature fusion and depth-wise separable convolution based deep learning. Neurocomputing 409:157–172

    Article  Google Scholar 

  26. Tolosana R, Vera-Rodriguez R, Fierrez J et al (2018) Exploring recurrent neural networks for on-line handwritten signature biometrics. Access 6:5128–5138

    Article  Google Scholar 

  27. Li C, Zhang X, Lin F et al (2019) A stroke-based rnn for writer-independent online signature verification. In: 2019 international conference on document analysis and recognition (ICDAR), pp 526–532

  28. Lai S, Jin L, Yang W (2017) Online signature verification using recurrent neural network and length-normalized path signature descriptor. In: 2017 14th IAPR international conference on document analysis and recognition (ICDAR), pp 400–405

  29. Lai S, Jin L (2018) Recurrent adaptation networks for online signature verification. IEEE Trans Inform Forens Secur 14(6):1624–1637

    Article  Google Scholar 

  30. Tang L, Kang W, Fang Y (2017) Information divergence-based matching strategy for online signature verification. IEEE Trans Inform Forens Secur 13(4):861–873

    Article  Google Scholar 

  31. Richiardi J, Drygajlo A (2003) Gaussian Mixture Models for on-line signature verification. In: Proceedings of the 2003 ACM SIGMM workshop on Biometrics methods and applications, pp 115–122

  32. Xia X, Chen Z, Luan F et al (2017) Signature alignment based on GMM for on-line signature verification. Pattern Recogn 65:188–196

    Article  Google Scholar 

  33. Yang L, Cheng Y, Wang X et al (2018) Online handwritten signature verification using feature weighting algorithm relief. Soft Comput 22(23):7811–7823

    Article  Google Scholar 

  34. Panday D, De Amorim R C, Lane P (2018) Feature weighting as a tool for unsupervised feature selection. Inform Process Lett 129:44–52

    Article  MathSciNet  Google Scholar 

  35. Manjunatha K, Manjunath S, Guru D et al (2016) Online signature verification based on writer dependent features and classifiers. Pattern Recogn Lett 80:129–136

    Article  Google Scholar 

  36. Parziale A, Diaz M, Ferrer M A et al (2019) Sm-dtw: stability modulated dynamic time warping for signature verification. Pattern Recogn Lett 121:113–122

    Article  Google Scholar 

  37. Bromley J, Bentz J W, Bottou L et al (1993) Signature verification using a ”siamese” time delay neural network. Int J Pattern Recognit Artif Intell 7:669–688

    Article  Google Scholar 

  38. Koch G, Zemel R, Salakhutdinov R (2015) Siamese neural networks for one-shot image recognition. In: ICML deep learning workshop, vol 2

  39. Szegedy C, Liu W, Jia Y et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9

  40. Zhao H, Shi J, Qi X et al (2017) Pyramid scene parsing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2881–2890

  41. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440

  42. Moghimi M, Belongie SJ, Saberian MJ et al (2016) Boosted Convolutional Neural Networks. In: BMVC, p 6

  43. Dvornik N, Schmid C, Mairal J (2019) Diversity with cooperation: Ensemble methods for few-shot classification. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 3723–3731

  44. Freund Y, Schapire R E (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119–139

    Article  MathSciNet  Google Scholar 

  45. Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141

  46. Yu F, Koltun V (2015) Multi-scale context aggregation by dilated convolutions. arXiv:1511.07122

  47. He K, Zhang X, Ren S et al (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  48. Ortega-Garcia J, Fierrez-Aguilar J, Simon D et al (2003) MCYT Baseline corpus: a bimodal biometric database. IEE Proceedings-Vision Image Signal Process 150(6):395–401

    Article  Google Scholar 

  49. Gorry PA (1990) General least-squares smoothing and differentiation by the convolution (Savitzky-Golay) method. Anal Chem 62(6):570–573

    Article  Google Scholar 

  50. Van Der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Machine Learn Res 9 (11):2579–2605

    MATH  Google Scholar 

  51. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556

  52. Szegedy C, Ioffe S, Vanhoucke V et al (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Proceedings of the AAAI conference on artificial intelligence, vol 31

  53. Tan C, Sun F, Kong T et al (2018) A survey on deep transfer learning. In: International conference on artificial neural networks, p 270–279

  54. Diaz M, Fischer A, Ferrer M A et al (2016) Dynamic signature verification system based on one real signature. IEEE Trans Cybern 48(1):228–239

    Article  Google Scholar 

  55. Vorugunti CS, Gorthi RKS, Pulabaigari V (2019) Online signature verification by few-shot separable convolution based deep learning. In: 2019 international conference on document analysis and recognition (ICDAR), pp 1125–1130

  56. Guru D, Manjunatha K, Manjunath S et al (2017) Interval valued symbolic representation of writer dependent features for online signature verification. Expert Syst Appl 80:232–243

    Article  Google Scholar 

  57. Doroz R, Kudlacik P, Porwik P (2018) Online signature verification modeled by stability oriented reference signatures. Inf Sci 460:151–171

    Article  Google Scholar 

  58. Xia X, Song X, Luan F et al (2018) Discriminative feature selection for on-line signature verification. Pattern Recogn 74:422–433

    Article  Google Scholar 

  59. Sharma A, Sundaram S (2017) On the exploration of information from the DTW cost matrix for online signature verification. IEEE Trans Cybern 48:611–624

    Article  Google Scholar 

  60. Diaz M, Ferrer MA, Quintana JJ (2018) Anthropomorphic features for On-line Signatures. IEEE Trans Pattern Anal Machine Intell 41:2807–2819

    Article  Google Scholar 

  61. Lai S, Jin L, Lin L et al (2020) SynSig2Vec: Learning representations from synthetic dynamic signatures for real-world verification. In: Proceedings of the AAAI conference on artificial intelligence, pp 735–742

  62. Tan H, He L, Huang Z-C et al (2021) Online signature verification based on dynamic features from gene expression programming. Multimed Tools Appl, 1–27

  63. Jia Y, Huang L, Chen H (2019) A two-stage method for online signature verification using shape contexts and function features. Sensors 19:1808

    Article  Google Scholar 

Download references

Acknowledgements

This research work is partially supported by the National Natural Science Foundation of China (Project Codes: 62073227), Liaoning Province Natural Science Foundation (20180520037, 2019-ZD-0681).

Author information

Authors and Affiliations

  1. School of Information and Control Engineering, Shenyang JianZhu University, 110168, Shenyang, China

    Qi Shen, Fangjun Luan & Shuai Yuan

Authors
  1. Qi Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fangjun Luan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shuai Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fangjun Luan.

Ethics declarations

Conflict of Interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shen, Q., Luan, F. & Yuan, S. Multi-scale residual based siamese neural network for writer-independent online signature verification. Appl Intell 52, 14571–14589 (2022). https://doi.org/10.1007/s10489-022-03318-5

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03318-5

Keywords

Search

Navigation