Skip to main content
SpringerLink
Log in

FVSR-Net: an end-to-end Finger Vein Image Scattering Removal Network

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Based on the ever-growing emphasis on high security of biometrics recognition, finger vein recognition has captured more and more attention. However, due to the light scattering in human skin tissue during near-infrared light transmission imaging, the collected finger vein images are always degraded dramatically, which leads to the unreliability of vein features and the low accuracy of finger vein recognition. Although considerable traditional methods are dedicated to eliminating the effect of light scattering on imaging, the clearer images cannot be output end-to-end, the processes of restoring degraded finger vein images are laborious as well. Thereupon, with the aim at improving the visibility of finger vein features and generating clear finger vein images end-to-end, this effort represents a simple and effective method utilizing Convolutional Neural Network (CNN). First, in our previous work, the biological optical model used to settle the matter of skin scattering is modified to output restored finger vein images in an end-to-end manner. Second, a multi-scale CNN named E-Net is established to acquire credible estimation map of finger vein features, which is conducive to the acquisition of pleasurable restoration outcome. Finally, a scattering removal framework, addressed as Finger Vein Image Scattering Removal Network (FVSR-Net), is designed via integrating improved biological optical model with E-Net. Such a novel design facilitates the generation of clearer venous regions and increases computational efficiency and stability. Experiments accomplished on two finger vein datasets demonstrate the superiority of our proposed method in terms of visual quality and recognition performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Cai B, Xu X, Jia K, Qing C, Tao D (2016) Dehazenet: an end-to-end system for single image haze removal. IEEE Trans Image Process 25(11):5187–5198

    Article  MathSciNet  Google Scholar 

  2. Chanukya PSVVN, Thivakaran TK (2020) Multimodal biometric cryptosystem for human authentication using fingerprint and ear. Multimed Tools Appl 79:659–673. https://doi.org/10.1007/s11042-019-08123-w

    Article  Google Scholar 

  3. Fan DP, Cheng MM, Liu JJ, et al. (2018) Salient objects in clutter: bringing salient object detection to the foreground. In: proceedings of the European conference on computer vision (ECCV), pp 186-202

  4. Fan DP, Zhang S, Wu YH, Liu Y, Cheng MM, Ren B, Rosin PL, Ji R (2019) Scoot: a perceptual metric for facial sketches. In: Proceedings of the IEEE International Conference on Computer Vision, pp 5612–5622

  5. Fu B, Cui J, Xiong X (2010). A novel adaptive vein image contrast enhancement method based on fuzzy and Retinex theory. In: IEEE international conference on information and automation (ICIA). IEEE, pp 2447–2450

  6. Golts A, Freedman D, Elad M (2019) Unsupervised single image dehazing using dark channel prior loss. IEEE Trans Image Process 29:2692–2701

    Article  Google Scholar 

  7. Huang G, Liu Z, Van Der Maaten L, et al. (2017). Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708

  8. Kingma D, Ba J (2015) Adam: a method for stochastic optimization. 2015 international conference on learning representations (ICLR). arXiv:1412.6980

  9. Lee E, Park K (2009) Restoration method of skin scattering blurred vein image for finger vein recognition. Electron Lett 45(21):1074–1076

    Article  Google Scholar 

  10. Lee EC, Park KR (2011) Image restoration of skin scattering and optical blurring for finger vein recognition. Opt Lasers Eng 49:816–828

    Article  Google Scholar 

  11. Li B, Peng X, Wang Z, Xu, J, Dan F (2017) AOD-net: all-in-one Dehazing network. In: Proceedings of IEEE International Conference on Computer Vision, Venice, pp 4780–4788

  12. Liao X, Li K, Yin J (2017) Separable data hiding in encrypted image based on compressive sensing and discrete fourier transform. Multimed Tools Appl 76:20739–20753. https://doi.org/10.1007/s11042-016-3971-4

    Article  Google Scholar 

  13. Liao X, Qin Z, Ding L (2017) Data embedding in digital images using critical functions. Image Commun 58:146–156. https://doi.org/10.1016/j.image.2017.07.006

    Article  Google Scholar 

  14. Lu X, Wang W, Ma C, et al. (2019) See more, know more: unsupervised video object segmentation with co-attention siamese networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3623–3632

  15. Qin H, Chen Z, He X (2018) Finger-vein image quality evaluation based on the representation of grayscale and binary image. Multimed Tools Appl 77:2505–2527. https://doi.org/10.1007/s11042-016-4317-y

    Article  Google Scholar 

  16. Ren W, Liu S, Zhang H, Pan J, Cao X, Yang MH (2016). Single image dehazing via multi-scale convolutional neural networks. In: Proceedings of European conference on computer vision, pp 154–169.

  17. Ronneberger O, Fischer P, Brox T (2015). U-net: convolutional networks for biomedical image segmentation. In proceedings of international conference on medical image computing and computer-assisted intervention, pp 234-241

  18. Shin KY, Park YH, Nguyen DT (2014) Finger-vein image enhancement using a fuzzy-based fusion method with gabor and retinex filtering. Sensors 14(2):3095–3129

    Article  Google Scholar 

  19. Szegedy C, Liu W, Jia Y, et al. (2015). Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9

  20. Tarel J. P, Hautiere N (2009). Fast visibility restoration from a single color or gray level image. In: Proceedings of 2009 IEEE 12th International Conference on Computer Vision, pp 2201–2208

  21. Wang Z, Bovik AC, Sheikh HR et al (2014) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  22. Wang W, Shen J, Shao L (2018) Video salient object detection via fully convolutional networks. IEEE Trans Image Process 27(1):38–49

    Article  MathSciNet  Google Scholar 

  23. Wax AP, Backman V (2010). Biomedical applications of light scattering IV Biomedical applications of light scattering IV, 7573

  24. Wen X, Zhao J, Liang X (2008) Image enhancement of finger-vein patterns based on wavelet denoising and histogram template equalization. Journal of Jilin University (Science Edition) 2:026

    Google Scholar 

  25. Yang J, Li X (2010). Efficient finger vein localization and recognition. In: Proceedings of international conference on pattern recognition, pp 1148–1151

  26. Yang J, Shi Y (2012) Finger-vein ROI localization and vein ridge enhancement. Pattern Recogn. Lett. 33(12):1569–1579

    Google Scholar 

  27. Yang J, Shi Y (2014) Towards finger-vein image restoration and enhancement for finger-vein recognition. Inf Sci 1(268):33–52

    Article  Google Scholar 

  28. Yang J, Wang J (2011). Finger-vein image restoration considering skin layer structure. In: proceedings of 2011 international conference on hand-based biometrics, pp 1-5

  29. Yang J, Yan M. (2010). An improved method for finger-vein image enhancement. In: proceedings of the 10th IEEE international conference on signal processing (ICSP 2010), Beijing, pp 1706–1709

  30. Yang J, Yang J (2009) Multi-channel gabor filter design for finger-vein image enhancement. In: Fifth international conference on image and graphics. IEEE, pp 87–91

    Google Scholar 

  31. Yang J, Yang J, Shi Y (2009). Combination of gabor wavelets and circular gabor filter for finger-vein extraction. In: proceedings of 5th international conference on intelligent computing, pp 346–354

  32. Yang J, Zhang B, Shi Y (2012) Scattering removal for finger-vein image restoration. Sensors 12(3):3627–3640

    Article  Google Scholar 

  33. Yin Y, Liu L, Sun X (2011). Sdumla-hmt: a multimodal biometric database. In: Biometric Recognition. Springer, pp 260–268

  34. Zhang H, Li S, Shi Y, Yang J (2019) Graph fusion for finger multimodal biometrics. IEEE Access 7:28607–28615

    Article  Google Scholar 

  35. Zhang J, Fan DP, Dai Y, et al. (2020) UC-net: uncertainty inspired rgb-d saliency detection via conditional variational autoencoders. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 8582–8591

  36. Zhang J, Yu X, Li A, et al. (2020) Weakly-supervised salient object detection via scribble annotations. arXiv preprint arXiv:2003.07685

  37. Zhao H, Gallo O, Frosio I, Kautz J (2017) Loss functions for image restoration with neural networks. IEEE Trans Comput Imaging 3:47–57

    Article  Google Scholar 

  38. Zhao JX, Liu JJ, Fan DP, et al. (2019) EGNet: edge guidance network for salient object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp 8779–8788

  39. Zhao JX, Cao Y, Fan DP, et al. (2019) Contrast prior and fluid pyramid integration for RGBD salient object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3927–3936

Download references

Author information

Author notes

  1. Jinfeng Yang and Zhigang Su contributed equally to this work.

Authors and Affiliations

  1. Tianjin Key Laboratory for Advanced Signal Processing, Civil Aviation University of China, Tianjin, China

    Shanshan Du & Zhigang Su

  2. Institute of Applied Artificial Intelligence of the Guangdong-Hong Kong-Macao Greater Bay Area, Shenzhen Polytechnic, Shenzhen, China

    Jinfeng Yang & Haigang Zhang

  3. Department of Computer and Information Science, University of Macau, Zhuhai, Taipa, China

    Bob Zhang

  4. Sino-European Institute of Aviation Engineering, Civil Aviation University of China, Tianjin, China

    Zhigang Su

Authors
  1. Shanshan Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jinfeng Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Haigang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bob Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zhigang Su
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Jinfeng Yang or Zhigang Su.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interest regarding the publication of this paper.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Du, S., Yang, J., Zhang, H. et al. FVSR-Net: an end-to-end Finger Vein Image Scattering Removal Network. Multimed Tools Appl 80, 10705–10722 (2021). https://doi.org/10.1007/s11042-020-09270-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09270-1

Keywords

Search

Navigation