Skip to main content

Advertisement

SpringerLink
Log in

A hybrid fusion model of iris, palm vein and finger vein for multi-biometric recognition system

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Biometric system has been widely adopted for human verification or identification, so inherently it requires the characteristics like high security, accuracy and acceptability. However, most of existing unimodal biometric systems provide low-middle security and are vulnerable to attacks. Therefore, multimodal biometric system fuses information from multiple modalities to break these limitations. This paper presents a novel hybrid fusion model for a multimodal biometric system. The hybrid fusion model includes an improved feature fusion algorithm and a novel weighting vote strategy. It captures canonical characteristics with multi-set structure and utilizes score distribution information to help guiding decision-making. The system was examined on databases from CASIA, PolyU and SDU respectively, which provided high precision and strong robustness over previous work. Experimental results showed that the proposed approach achieved an average accuracy of 99.33%, which outperformed other fusion strategies in multimodal biometric systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Ahmad MI, Woo WL, Dlay S (2016) Non-stationary feature fusion of face and palmprint multimodal biometrics. Neurocomputing 177:49–61

    Google Scholar 

  2. Ahonen T, Hadid A, Pietikäinen M (2006) Face recognition with local binary patterns. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041

    MATH  Google Scholar 

  3. Al-Maadeed S, Bourif M, Bouridane A, Jiang R (2016) Low-quality facial biometric verification via dictionary-based random pooling. Pattern Recogn 52:238–248

    Google Scholar 

  4. Al-Tayyan A, Assaleh K, Shanableh T (2017) Decision-level fusion for single-view gait recognition with various carrying and clothing conditions. Image Vis Comput 61:54–69

    Google Scholar 

  5. Al-Waisy AS, Qahwaji R, Ipson S, Al-Fahdawi S, Nagem TAM (2017) A multi-biometric iris recognition system based on a deep learning approach. Pattern Anal Applic 21(4):1–20

    Google Scholar 

  6. Bo S, Li L, Xuewen W, Zuo T, Chen Y, Zhou G, He J, Zhu X (2016) Combining feature-level and decision-level fusion in a hierarchical classifier for emotion recognition in the wild. J Multimodal User Interfaces 10(2):125–137

    Google Scholar 

  7. Chen Z, You X, Zhong B, Li J, Tao D (2017) Dynamically modulated mask sparse tracking. IEEE Transactions on Cybernetics 47(11):3706–3718

    Google Scholar 

  8. Cui F, Yang G (2011) Score level fusion of fingerprint and finger vein recognition. Journal of Computational Information Systems 7:5723–5731

    Google Scholar 

  9. Dass SC, Nandakumar K, Jain AK (2005) A principled approach to score level fusion in multimodal biometric systems. In: Audio- and video-based biometric person authentication, 5th international conference, AVBPA 2005, hilton rye town, NY, USA, July 20-22, 2005, Proceedings

  10. Gao Y, Ma J, Yuille AL (2017) Semi-supervised sparse representation based classification for face recognition with insufficient labeled samples. IEEE Trans Image Process 26(5):2545–2560

    MathSciNet  MATH  Google Scholar 

  11. Gopal, Smriti S (2017) Accurate human recognition by score-level and feature-level fusion using palm cphalanges print. Arab J Sci Eng 43(6):1–12

    Google Scholar 

  12. Gopal, Smriti S, Saurabh B, Sandeep B (2016) Fusion of palm-phalanges print with palmprint and dorsal hand vein. Applied Soft Computing, pp. S1568494616302496

  13. Grover J, Hanmandlu M (2015) Hybrid fusion of score level and adaptive fuzzy decision level fusions for the finger-knuckle-print based authentication. Appl Soft Comput 31(C):1–13

    Google Scholar 

  14. Guan X, Liu G, Huang C, Liu Q, Wu C, Jin Y, Li Y (2017) An object-based linear weight assignment fusion scheme to improve classification accuracy using landsat and modis data at the decision level. IEEE Trans Geosci Remote Sens 55(12):6989–7002

    Google Scholar 

  15. Haghighat M, Abdel-Mottaleb M, Alhalabi W (2016) Discriminant correlation analysis: Real-time feature level fusion for multimodal biometric recognition. IEEE Trans Inf Foren Sec 11(9):1984–1996

    Google Scholar 

  16. Jeng R, Chen W (2016) Two feature-level fusion methods with feature scaling and hashing for multimodal biometrics. IETE Tech Rev 34(1):11

    Google Scholar 

  17. Jing X, Yao Y, Zhang D, Yang J, Li M (2007) Face and palmprint pixel level fusion and kernel dcv-rbf classifier for small sample biometric recognition. Pattern Recogn 40(11):3209–3224

    MATH  Google Scholar 

  18. Kabir W, Omair AM, Swamy MNS (2018) Normalization and weighting techniques based on genuine-impostor score fusion in multi-biometric systems. IEEE Trans Inf Foren Sec 13(8):1989–2000

    Google Scholar 

  19. Khaled R, Hamza R, Hongyang Y (2019) Sensitive and energetic iot access control for managing cloud electronic health records. IEEE Acess 7:86384–86393

    Google Scholar 

  20. Khellat-Kihel S, Abrishambaf R, Monteiro JL, Benyettou M (2016) Multimodal fusion of the finger vein, fingerprint and the finger-knuckle-print using kernel fisher analysis. Appl Soft Comput 42(C):439–447

    Google Scholar 

  21. Kittler J, Alkoot FM (2003) Sum versus vote fusion in multiple classifier systems. IEEE Trans Pattern Anal Mach Intell 25(1):110–115

    Google Scholar 

  22. Kumar A, Shekhar S (2011) Personal identification using multibiometrics rank-level fusion. IEEE Trans Syst Man Cy Part C 41(5):743–752

    Google Scholar 

  23. Kun S, Yang G, Bo W, Yang L, Li D, Peng S, Yin Y (2019) Human identification using finger vein and ecg signals. Neurocomputing 332:111–118

    Google Scholar 

  24. Lin H, Jain A (1998) Integrating faces and fingerprints for personal identification. IEEE Trans Pattern Anal Mach Intell 20(12):1295–1307

    Google Scholar 

  25. Modak S, Jha V (2018) Multibiometric fusion strategy and its applications: a review. Information Fusion 49:174–204

    Google Scholar 

  26. Ojala T, Pietikäinen M, Mäenpää T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    MATH  Google Scholar 

  27. Perlibakas V (2004) Distance measures for pca-based face recognition. Pattern Recogn Lett 25(6):711–724

    Google Scholar 

  28. Pinar AJ, Rice J, Hu L, Anderson DT, Havens TC (2017) Efficient multiple kernel classification using feature and decision level fusion. IEEE Trans Fuzzy Syst 25(6):1403–1416

    Google Scholar 

  29. Qiu J, Li H, Zhao C (2019) Cancelable palmprint templates based on random measurement and noise data for security and privacy-preserving authentication. Computer and Security 82:1–14

    Google Scholar 

  30. Hamza R, Yan Z, Muhammad K, Bellavista P, Titouna F (2019) A privacy-preserving cryptosystem for iot e-healthcare. Information Sciences

  31. Regouid M, Touahria M, Benouis M (2019) Multimodal biometric system for ecg, ear and iris recognition based on local descriptors. Multimed Tools Appl 78(16):22509–22535

    Google Scholar 

  32. Ribaric S, Fratric I (2005) A biometric identification system based on eigenpalm and eigenfinger features. IEEE Trans Pattern Anal Mach Intell 27(11):1698–1709

    Google Scholar 

  33. Singh WG, Tarandeep S, Kuldeep S, Neelam V (2019) Robust multimodal biometric system based on optimal score level fusion model. Expert Syst Appl 116:364–376

    Google Scholar 

  34. Sinha A, Chen H, Danu DG, Kirubarajan T, Farooq M (2008) Estimation and decision fusion: a survey. Neurocomputing 71(13):2650–2656

    Google Scholar 

  35. Snelick R, Uludag U, Mink A, Indovina M, Jain AK (2005) Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems. IEEE Trans Pattern Anal Mach Intell 27(3):450–455

    Google Scholar 

  36. Sun Q, Shenggen Z, Yan L, Heng PA, Deshen X (2005) A new method of feature fusion and its application in image recognition. Pattern Recogn 38(12):2437–2448

    Google Scholar 

  37. Tao Qian, Veldhuis Raymond (2009) Threshold-optimized decision-level fusion and its application to biometrics. Pattern Recogn 42(5):823–836

    Google Scholar 

  38. The finger vein database from shandong university (sdumla). http://mla.sdu.edu.cn/info/1006/1195.htm

  39. The iris database. http://biometrics.idealtest.org/findTotalDbByMode.do?mode=Iris

  40. The palm vein database. https://www4.comp.polyu.edu.hk/biometrics/

  41. Toygar Ö, Alqaralleh E, Afaneh A (2018) Symmetric ear and profile face fusion for identical twins and non-twins recognition. Signal Image and Video Processing 12(6):1157–1164

    Google Scholar 

  42. Wild P, Radu P, Chen L, Ferryman J (2015) Robust multimodal face and fingerprint fusion in the presence of spoofing attacks. Pattern Recogn 50:17–25

    Google Scholar 

  43. Yan X, Kang W, Deng F, Qiuxia W (2015) Palm vein recognition based on multi-sampling and feature-level fusion. Neurocomputing 151:798–807

    Google Scholar 

  44. Yang G, Xi X, Yin Y (2012) Finger vein recognition based on a personalized best bit map. Sensors 12(2):1738–1757

    Google Scholar 

  45. Yang J, Luo L, Qian J, Tai Y, Zhang F, Xu Y (2016) Nuclear norm based matrix regression with applications to face recognition with occlusion and illumination changes. IEEE Trans Pattern Anal Mach Intell 39(1):156–171

    Google Scholar 

  46. Yang J, Sun Q (2017) A novel generalized fuzzy canonical correlation analysis framework for feature fusion and recognition. Neural Process Lett 46 (2):521–536

    Google Scholar 

  47. Yang J, Yang J (2002) Generalized k cl transform based combined feature extraction. Pattern Recogn 35(1):295–297

    MATH  Google Scholar 

  48. Yang J, Yang J, Zhang D, Lu J (2003) Feature fusion: parallel strategy vs. serial strategy. Pattern Recogn 36(6):1369–1381

    MATH  Google Scholar 

  49. Yang Lu, Yang G, Yin Y, Xi X (2018) Finger vein recognition with anatomy structure analysis. IEEE Transactions on Circuits and Systems for Video Technology 28(8):1892–1905

    Google Scholar 

  50. Yang W, Song W, Jiankun Hu, Zheng G, Valli C (2017) A fingerprint and finger-vein based cancelable multi-biometric system. Pattern Recogn 78:242–251

    Google Scholar 

  51. Yang X, Kong L, Zhi L, Wang C, Xiaoke X (2018) Multimodal feature-level fusion for biometrics identification system on iomt platform. IEEE Access 6:21418–21426

    Google Scholar 

  52. Yao Y, Jing X, Wong H (2007) Face and palmprint feature level fusion for single sample biometrics recognition

  53. You X, Guo W, Yu S, Li K, Príncipe JC, Tao D (2016) Kernel learning for dynamic texture synthesis. IEEE Trans Image Process 25 (10):4782–4795

    MathSciNet  MATH  Google Scholar 

  54. You X, Wang R, Tao D (2014) Diverse expected gradient active learning for relative attributes. IEEE Trans Image Process 23(7):3203–3217

    MathSciNet  MATH  Google Scholar 

  55. You X, Weihua O, Chen CLP, Li Q, Zhu Z, Tang Y (2015) Robust nonnegative patch alignment for dimensionality reduction. IEEE Trans Neur Net Lear Syst 26(11):2760–2774

    MathSciNet  Google Scholar 

  56. Yue Z, You X, Yu S, Chang X, Tao D (2018) Multi-view manifold learning with locality alignment. Pattern Recogn 78:154–166

    Google Scholar 

  57. Zifeng W, Huang Y, Wang L, Wang X, Tan T (2016) A comprehensive study on cross-view gait based human identification with deep cnns. IEEE Trans Pattern Anal Mach Intell 39(2):209–226

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank Prof. M. Haghighat for providing his source code to implement [15]. We would also want to express thanks to Chinese Academy of Sciences for sharing CASIA-IrisV4 Database [39], Hong Kong Poly University for sharing their database [40] and Shandong University for sharing SDUMLA-HMT Database [44]. This study is partially financed by the National Natural Science Foundation of China (NSFC: 61771233 and 81000642), Science and Technology Planning Project of Guangdong Province, China (Grant no. 2013B090500104).

Author information

Authors and Affiliations

  1. Guangdong Provincial Key Laboratory of Medical Image Processing, School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong Province, China

    Chenyi Zhou, Jing Huang, Feng Yang & Yaqin Liu

Authors
  1. Chenyi Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jing Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Feng Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yaqin Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jing Huang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, C., Huang, J., Yang, F. et al. A hybrid fusion model of iris, palm vein and finger vein for multi-biometric recognition system. Multimed Tools Appl 79, 29021–29042 (2020). https://doi.org/10.1007/s11042-020-08914-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-08914-6

Keywords

Search

Navigation