Skip to main content
Log in

Bimodal biometric system for hand shape and palmprint recognition based on SIFT sparse representation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Biometric-based hand modality is considered as one of the most popular biometric technologies especially in forensic applications. In this paper, a bimodal hand identification system was proposed based on Scale Invariant Feature Transform (SIFT) descriptors, extracted from hand shape and palmprint modalities. A local sparse representation method was adopted in order to represent images with high discrimination. Moreover, fusion was performed at feature and decision levels using a cascade fusion in order to generate the final identification rate of our bimodal system. Our experiments were applied on two hand databases: Indian Institute of Technology of Delhi (IITD) hand database and Bosphorus hand database containing, respectively, 230 and 615 subjects. The results show that the proposed method offers high accuracies compared to other popular bimodal hand biometric methods over the two hand databases. The correct identification rate reaches 99.57 % which is competitive compared to systems existing in the literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Alsaade F, Ariyaeeinia AM, Malegaonkar AS, Pawlewski M, Pillay SG (2008) Enhancement of multimodal biometric segregation using unconstrained cohort normalisation. Pattern Recogn 41(3):814–820

    Article  MATH  Google Scholar 

  2. Amayeh G, Bebis G, Erol A, Nicolescu M (2006) Peg-free hand shape verification using high order zernike moments. In: Proceedings of the 2006 conference on computer vision and pattern recognition workshop, pp 40–47

  3. Boser BE, Guyon IM, Vapnik VN (1992) A training algorithm for optimal margin classifiers. In: Proceedings of the 5th annual workshop on computational learning theory, COLT ’92, pp 144–152

  4. Briceño JC, Travieso CM, Alonso JB, Ferrer M (2011) Biometric identification based on hand-shape features using a hmm kernel. In: International conference on hand-based biometrics (ICHB). IEEE, pp 1–6

  5. Burges CJ, Schölkopf B (1997) Improving the accuracy and speed of support vector machines. In: Advances in neural information processing systems, vol 9. MIT Press, pp 375–381

  6. Buyssens P, Revenu M, Lepetit O (2009) Fusion of ir and visible light modalities for face recognition, pp 1–6

    Google Scholar 

  7. Chang K, Bowyer K, Sarkar S, Victor B (2003) Comparison and combination of ear and face images in appearance-based biometrics. IEEE Trans Pattern Anal Mach Intell 25(9):1160–1165

    Article  Google Scholar 

  8. Charfi N, Trichili H, Alimi A, Solaiman B (2015) Hand verification system based on multi-features fusion. In: 15th international conference on intelligent systems design and applications (ISDA2015), pp 189–194

  9. Charfi N, Trichili H, Alimi A, Solaiman B (2015) Personal recognition system using hand modality based on local features. In: 11th international conference on information assurance and security (IAS2015), pp 13–17

  10. Charfi N, Trichili H, Alimi AM, Solaiman B (2014) Bimodal biometric system based on SIFT descriptors of hand images. In: 2014 IEEE international conference on systems, man, and cybernetics, SMC 2014. San Diego, pp 4141–4145

  11. Choraś RS, Choraś M (2007) Adaptive and natural computing algorithms: Proceedings, Part ii 8th international conference, icannga 2007. Warsaw, pp 407–414

  12. Dong K, Feng G, Hu D (2005) Digital curvelet transform for palmprint recognition. In: Advances in biometric person authentication, pp 639–645

  13. Duta N (2009) A survey of biometric technology based on hand shape. Pattern Recogn 42(11):2797–2806

    Article  Google Scholar 

  14. El-Sallam A, Sohel F, Bennamoun M (2011) Robust pose invariant shape-based hand recognition. In: 6th IEEE conference on industrial electronics and applications (ICIEA), pp 281–286

  15. Ernst RH Hand id system. U. S. Patent No. 3576537

  16. Ferrer M, Vargas F, Morales A (2011) Bispectral contactless hand based biometric system. In: 2nd national conference on telecommunications (CONATEL), 2011, pp 1–6

  17. Fujisawa H (2008) Forty years of research in character and document recognition–an industrial perspective. Pattern Recogn 41(8):2435–2446

    Article  Google Scholar 

  18. Giot R, Rosenberger C (2012) Genetic programming for multibiometrics. Expert Syst Appl 39(2):1837–1847

    Article  Google Scholar 

  19. Goh MKO, TCJA (2012) A contactless biometric system using multiple hand features. J Vis Commun Image Represent (JVIS) 23(7):1068–1084

    Article  Google Scholar 

  20. Guesmi H, THAASB (2015) Novel biometric features fusion method based on possibility theory. In: IEEE 14th international conference on cognitive informatics cognitive computing (ICCI*CC), 2015, pp 418–425

  21. Guo JM, Hsia CH, Liu YF, Yu JC, Chu MH, Le TN (2012) Contact-free hand geometry-based identification system. Expert Syst Appl 39(14):11,728–11,736

    Article  Google Scholar 

  22. Han CC (2004) A hand-based personal authentication using a coarse-to-fine strategy. Image Vis Comput 22(11):909–918

    Article  Google Scholar 

  23. Hong L, Jain A (1998) Integrating faces and fingerprints for personal identification. IEEE Trans Pattern Anal Mach Intell 20(12):1295–1307

    Article  Google Scholar 

  24. Hu RX, Jia W, Zhang D, Gui J, Song LT (2012) Hand shape recognition based on coherent distance shape contexts. Pattern Recogn 45(9):3348–3359

    Article  Google Scholar 

  25. Jain AK, DN (1999) Deformable matching of hand shapes for user verification. In: Proceedings of international conference image processing, pp 857–861

  26. Jia W, Huang DS, Zhang D (2008) Palmprint verification based on robust line orientation code. Pattern Recogn 41(5):1504–1513

    Article  MATH  Google Scholar 

  27. Kumar A (2008) Incorporating cohort information for reliable palmprint authentication. In: 6th Indian conference on computer vision, graphics & image processing, ICVGIP ’08, pp 583–590

  28. Kumar A, Shekhar S (2011) Personal identification using multibiometrics rank-level fusion. IEEE Trans Syst Man Cybern Part C Appl Rev 41(5):743–752

    Article  Google Scholar 

  29. Kumar A, Shekhar S (2011) Personal identification using multibiometrics rank-level fusion. IEEE Trans Syst Man Cybern Part C Appl Rev 41(5):743–752

    Article  Google Scholar 

  30. Kumar A, Wong DC, Shen HC, Jain AK (2006) Personal authentication using hand images. Pattern Recogn Lett 27(13):1478–1486

    Article  Google Scholar 

  31. Kumar A, Wong DCM, Shen HC, Jain AK (2003) Personal verification using palmprint and hand geometry biometric. In: Proceedings of the 4th international conference on audio- and video-based biometric person authentication, pp 668–678

  32. Kumar A, Zhang D (2006) Personal recognition using hand shape and texture. IEEE Trans Image Process 15(8):2454–2461

    Article  Google Scholar 

  33. Ladoux P, Rosenberger C, Dorizzi B (2009) Palm vein verification system based on sift matching. In: 3rd international conference ICB, pp 1290–1298

  34. Lee H, Battle A, Raina R, Ng A (2007) Efficient sparse coding algorithms. In: NIPS. NIPS, pp 801–808

  35. Leng L, Li M, Kim C, Bi X (2015) Dual-source discrimination power analysis for multi-instance contactless palmprint recognition. Multimedia Tools Appl 1–22

  36. Leng L, Li M, Leng L, Teoh ABJ (2013) Conjugate 2dpalmhash code for secure palm-print-vein verification. In: 6th international congress on image and signal processing (CISP), 2013, vol 3, pp 1705–1710

  37. Leng L, Liu G, Li M, Khan MK, Al-Khouri AM (2014) Logical conjunction of triple-perpendicular-directional translation residual for contactless palmprint preprocessing. In: 11th international conference on information technology: new generations (ITNG), 2014, pp 523–528

  38. Leng L, Zhang J, Khan MK, Chen X, Alghathbar K (2010) Dynamic weighted discrimination power analysis: a novel approach for face and palmprint recognition in dct domain. Academic Journals, pp 2543–2554

  39. Lin C, Wang S (2004) Training algorithms for fuzzy support vector machines with noisy data. Pattern Recogn Lett 25(14):1647–1656

    Article  Google Scholar 

  40. Lindeberg T (1994) Scale-space theory: a basic tool for analysing structures at different scales. J Appl Stat 21(2):224–270

    Google Scholar 

  41. Lowe DG (1999) Object recognition from local scale-invariant features. In: Proceedings of the international conference on computer vision, ICCV ’99, vol 2, pp 1150–1157

  42. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110

    Article  Google Scholar 

  43. Luo YT, Zhao LY, Zhang B, Jia W, Xue F, Lu JT, Zhu YH, Xu BQ (2016) Local line directional pattern for palmprint recognition. Pattern Recogn 50:26–44

    Article  Google Scholar 

  44. Luque-Baena RM, Elizondo D, Lopez-Rubio E, Palomo EJ, Watson T (2013) Assessment of geometric features for individual identification and verification in biometric hand systems. Expert Syst Appl 40(9):3580–3594

    Article  Google Scholar 

  45. Prasad SM, Govindan VK, Sathidevi PS (2009) Bimodal personal recognition using hand images. In: Proceedings of the international conference on advances in computing, communication and control, pp 403–409

  46. Raghavendra R, Dorizzi B, Rao A, Hemantha G (2009) Pso versus adaboost for feature selection in multimodal biometrics, pp 1–7

    Google Scholar 

  47. Ross A, Jain AK (2004) Multimodal biometrics: an overview. In: Proceedings of 12th European signal processing conference, pp 1221–1224

  48. Sanchez-Reillo R, Sanchez-Avila C, Gonzalez-Marcos A (2000) Biometric identification through hand geometry measurements. IEEE Trans Pattern Anal Mach Intell 22(10):1168–1171

    Article  Google Scholar 

  49. Shang L, Cui M, Chen J (2012) Palm recognition using fast sparse coding algorithm. Advanced Intell Comput Theories Appl 6839:701–707

    Google Scholar 

  50. Shu W, Zhang D (1998) Palmprint verification: an implementation of biometric technology, vol 1, pp 219–221

  51. Sim T, Zhang S, Janakiraman R, Kumar S (2007) Continuous verification using multimodal biometrics. IEEE Trans Pattern Anal Mach Intell 29(4):687–700

    Article  Google Scholar 

  52. Srinivas BG, Gupta P (2009) Palmprint based verification system using surf features. Commun Comput Inf Sci 40:250–262

    Google Scholar 

  53. Sun Z, Tan T, Wang Y, Li SZ (2005) Ordinal palmprint represention for personal identification. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 1, pp 279–284

  54. Tashk A, Helfroush M, Karimi V (2012) An automatic traffic control system based on simultaneous persian license plate recognition and driver fingerprint identification. In: 20th telecommunications forum (TELFOR), 2012, pp 1729–1732

  55. Tashk A, Helfroush MS, Dehghani MJ (2010) A chebyshev/legendre polynomial interpolation approach for fingerprint orientation estimation smoothing and prediction. J Zhejiang Univ Sci C 11(12): 976–988

    Article  Google Scholar 

  56. Tashk A, Helfroush MS, Kazemi K (2011) A novel fingerprint matcher based on an ergodic 2-d hidden markov model. Int J Electron Commun 65(9):742–749

  57. Tounsi M, Moalla I, Alimi AM, Lebouregois F (2015) Arabic characters recognition in natural scenes using sparse coding for feature representations. In: 13th international conference on document analysis and recognition (ICDAR), vol 36, pp 1036–1040

  58. Wang S, Xu Y (2008) A new palmprint identification algorithm based on gabor filter and moment invariant. In: IEEE conference on cybernetics and intelligent systems, 2008, pp 491–496

  59. Wang WC, Chen WS, Shih SW (2009) Biometric recognition by fusing palmprint and hand-geometry based on morphology. In: Proceedings of the 2009 IEEE international conference on acoustics, speech and signal processing, pp 893–896

  60. Wright J, Ma Y, Mairal J, Sapiro G, Huang T, Yan S (2010) Sparse representation for computer vision and pattern recognition. Proc IEEE 98(6):1031–1044

    Article  Google Scholar 

  61. Wright J, Yang A, Ganesh A, Sastry S, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31 (2):210–227

    Article  Google Scholar 

  62. Wu K, Yap KH (2006) Fuzzy svm for content-based image retrieval: a pseudo-label support vector machine framework. Comp Intell Mag 1(2):10–16

    Article  Google Scholar 

  63. Wu X, Zhao Q, Bu W (2014) A sift-based contactless palmprint verification approach using iterative ransac and local palmprint descriptors. Pattern Recogn 47 (10):3314–3326

    Article  Google Scholar 

  64. Yang J, Yu K, Gong Y, Huang T (2009) Linear spatial pyramid matching using sparse coding for image classification

    Google Scholar 

  65. Yap KH, Wu K (2005) A soft relevance framework in content-based image retrieval systems. IEEE Trans Circuits Syst Video Technol 15(12):1557–1568

    Article  Google Scholar 

  66. Yörük E, Dutağaci H, Sankur B (2006) Hand biometrics. Image Vis Comput 24(5):483–497

    Article  Google Scholar 

  67. Zhihan L, Alaa H, Shengzhong F, Haibo L, Shafiq Ur R (2014) Multimodal hand and foot gesture interaction for handheld devices. ACM Trans Multimedia Comput Commun Appl 11:10:1–10:19

    Google Scholar 

  68. Zhihan L, Alaa H, Shengzhong F, Shafiq Ur R, Haibo L (2015) Touch-less interactive augmented reality game on vision-based wearable device. Pers Ubiquit Comput 19(3-4):551–567

    Article  Google Scholar 

  69. Zuo W, Lin Z, Guo Z, Zhang D (2010) The multiscale competitive code via sparse representation for palmprint verification. In: IEEE conference on computer vision and pattern recognition (CVPR), 2010, pp 2265–2272

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nesrine Charfi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Charfi, N., Trichili, H., Alimi, A.M. et al. Bimodal biometric system for hand shape and palmprint recognition based on SIFT sparse representation. Multimed Tools Appl 76, 20457–20482 (2017). https://doi.org/10.1007/s11042-016-3987-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3987-9

Keywords

Navigation