Skip to main content
SpringerLink
Log in

Enhanced long-range personal identification based on multimodal information of human features

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This work presents an enhanced long-range personal identification scheme using multimodal information of human features. Multimodal information includes multiview face detection, height measurement and face recognition. Multiview faces are estimated by collecting five face databases that correspond to left, half-left, right, half-right, and frontal faces, respectively. The sequences of parameters based on four detectors are also designed to determine the face direction. The detectors use the head-shoulder region, frontal face, profile face, and eyes detector respectively. In addition to determining when individuals enter the monitoring area, the multiview face detection module also describes the detected face direction. This result allows the identification system to select the face database of a specific direction to identify subsequent faces. Additionally, the height measurement module estimates individual height by calculating the vanishing points and lines. The module concept is based on single-view metrology. The measured information further refines the face database selected by multiview face detection and minimizes the candidates for face identification. Importantly, the proposed method integrates the multimodal information based on face direction, height and face features to refine the database and analyzes the information to determine the identity of a person. In this work, images from a monitoring area 5.6 m away from a camera are captured using an inexpensive digital web camera. The experimental results show that the proposed method can improve the accuracy rate by more than 21 % in contrast with the baselines and correspondingly demonstrates the effectiveness of the proposed idea.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  2. BenAbdelkader C, Cutler R, Davis L (2002) Person identification using automatic height and stride estimation. 4, Institute of Electrical and Electronics Engineers Inc., pp 377–380

  3. Berger M (1987) Geometry II. Springer, Berlin/Heidelberg p 406. http://www.springer.com/mathematics/geometry/book978-3-540-17015-0

  4. Choi YH, Tak YS, Rho S, Hwang E (2013) Skin feature extraction and processing model for statistical skin age estimation. Multimed Tools Appl 64(2):227–247

    Article  Google Scholar 

  5. Choras RS (2010) Multimodal biometric personal authentication integrating iris and retina images. Adv Intell Soft Comput 84:121–131

    Article  Google Scholar 

  6. Criminisi A (2001) Accurate visual metrology from single and multiply uncalibrated images. Springer-Verlag London Ltd, p 197

  7. Criminisi A (2002) Single-view metrology: algorithms and applications. DAGM-Symposium on Pattern Recognition, September 2002

  8. Criminisi A, Reid I, Zisserman A (2000) Single view metrology. Int J Comput Vis 40(2):123–148

    Article  MATH  Google Scholar 

  9. Dantcheva A, Velardo C, D’Angelo A, Dugelay JL (2011) Bag of soft biometrics for person identification. Multimed Tools Appl 51(2):739–777

    Article  Google Scholar 

  10. Feng W, Xie L, Zeng J, Liu ZQ (2009) Audio-visual human recognition using semi-supervised spectral learning and hidden Markov models. J Vis Lang Comput 20(3):188–195

    Article  Google Scholar 

  11. Hrechak AK, McHugh JA (1990) Automated fingerprint recognition using structural matching. Pattern Recog 23(8):893–904

    Article  Google Scholar 

  12. Jain AK, Dass SC, Nandakumar K (2004) Can soft biometric traits assist user recognition? biometric technology for human identification, April 12, 2004 - April 13, 2004. SPIE, Orlando, pp 561–572

    Google Scholar 

  13. Kawulok M (2010) Energy-based blob analysis for improving precision of skin segmentation. Multimed Tools Appl 49(3):463–481

    Article  Google Scholar 

  14. Kuan TW, Tsai HC, Wang JF, Wang JC, Chen BW, Lin ZY (2012) A new hybrid and dynamic fusion of multiple experts for intelligent porch system. Expert Syst Appl 39(10):9288–9296

    Article  Google Scholar 

  15. Liao Y, Vemuri VR (2002) Use of K-nearest neighbor classifier for intrusion detection. Comput Secur 21(5):439–448

    Article  Google Scholar 

  16. Liu C, Wechsler H (2002) Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans Image Process 11(4):467–476

    Article  Google Scholar 

  17. Martinez AM, Kak AC (2001) PCA versus LDA. IEEE Trans Pattern Anal Mach Intell 23(2):228–233

    Article  Google Scholar 

  18. Moayer B, Fu KS (1986) A tree system approach for fingerprint pattern-recognition. IEEE Trans Pattern Anal Mach Intell 8(3):376–387

    Article  Google Scholar 

  19. Swets DL, Weng JJ (1996) Using discriminant eigenfeatures for image retrieval. IEEE Trans Pattern Anal Mach Intell 18(8):831–836

    Article  Google Scholar 

  20. Tsai H-C, Wang W-C, Wang J-C, Wang J-F (2009) Long distance person identification using height measurement and face recognition. 2009 I.E. region 10 conference, TENCON 2009, November 23, 2009–November 26, 2009. Institute of Electrical and Electronics Engineers Inc, Singapore, pp 1–4

    Google Scholar 

  21. Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86

    Article  Google Scholar 

  22. Varetskyy Y, Rusyn B, Molga A, Ignatovych A (2010) A new method of fingerprint key protection of grid credential. Adv Intell Soft Comput 84:99–103

    Article  Google Scholar 

  23. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. 2001 I.E. computer society conference on computer vision and pattern recognition, December 8, 2001–December 14, 2001. Institute of Electrical and Electronics Engineers Computer Society, Kauai, pp I511–I518

    Google Scholar 

  24. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  25. Wildes RP (1997) Iris recognition: an emerging biometric technology. Proc IEEE 85(9):1348–1363

    Article  Google Scholar 

  26. Xiao QH (2007) Biometrics - technology, application, challenge, and computational intelligence solutions. IEEE Comput Intell Mag 2(2):5

    Article  Google Scholar 

  27. Zewail R, Elsafi A, Saeb M, Hamdy N (2004) Soft and hard biometrics fusion for improved identity verification. The 2004 47th midwest symposium on circuits and systems - conference proceedings, July 25, 2004–July 28, 2004. Institute of Electrical and Electronics Engineers Inc, Hiroshima, pp I225–I228

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, National Cheng Kung University, Tainan, Taiwan

    Hsin-Chun Tsai, Bo-Wei Chen & Jhing-Fa Wang

  2. School of Computer Science and Engineering, Kyungpook National University, Daegu, South Korea

    Anand Paul

Authors
  1. Hsin-Chun Tsai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bo-Wei Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jhing-Fa Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anand Paul
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hsin-Chun Tsai.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tsai, HC., Chen, BW., Wang, JF. et al. Enhanced long-range personal identification based on multimodal information of human features. Multimed Tools Appl 73, 291–307 (2014). https://doi.org/10.1007/s11042-013-1606-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1606-6

Keywords

Search

Navigation