Skip to main content

Multimodal Speaker Verification Using Ear Image Features Extracted by PCA and ICA

  • Conference paper
Audio- and Video-Based Biometric Person Authentication (AVBPA 2005)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 3546))

  • 2303 Accesses

Abstract

This paper first compares performances of two authentication methods using ear images, in which feature vectors are extracted by either principal component analysis (PCA) or independent component analysis (ICA). Next, the effectiveness of combining PCA- and ICA-based ear authentication methods is investigated. In our previous work, we proposed an audio-visual person authentication using speech and ear images with the aim of increasing noise robustness in mobile environments. In this paper, we apply the best ear authentication method to our audio-visual authentication method and examine its robustness. Experiments were conducted using an audio-visual database collected from 36 male speakers in five sessions over a half year. Speech data were contaminated with white noise at various SNR conditions. Experimental results show that: (1) PCA outperforms ICA in the ear authentication framework using GMMs; (2) the fusion of PCA- and ICA-based ear authentication is effective; and (3) by combining the fusion method for ear images with the speech-based method, person authentication performance can be improved. The audio-visual person authentication method achieves better performance than ear-based as well as speech-based methods in an SNR range between 15 and 30dB.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Brunelli, R., Falavigna, D.: Personal identification using multiple cues. IEEE Trans. on Pattern Analysis and Machine Intelligence 17(10), 955–966 (1995)

    Article  Google Scholar 

  2. Duc, B., Bigun, E.S., Bigun, J., Maitre, G., Fischer, S.: Fusion of audio and video information for multi modal person authentication. Pattern Recognition Letters 18(9), 835–843 (1997)

    Article  Google Scholar 

  3. Jourlin, P., Luettin, J., Genoud, D., Wassner, H.: Acoustic-labial speaker verification. Pattern Recognition Letters 18(9), 853–858 (1997)

    Article  Google Scholar 

  4. Poh, N., Korczak, J.: Hybrid biometric person authentication using face and voice features. In: Bigun, J., Smeraldi, F. (eds.) AVBPA 2001. LNCS, vol. 2091, pp. 348–353. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  5. Ross, A., Jain, A., Qian, J.-Z.: Information fusion in biometrics. In: Bigun, J., Smeraldi, F. (eds.) AVBPA 2001. LNCS, vol. 2091, pp. 354–359. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  6. Chang, K., Bowyer, K.W., Sarkar, S., Victor, B.: Comparison and combination of ear and face images in appearance-based biometrics. IEEE Trans. on Pattern Analysis and Machine Intelligence 25(9), 1160–1165 (2003)

    Article  Google Scholar 

  7. Iwano, K., Hirose, T., Kamibayashi, E., Furui, S.: Audio-visual person authentication using speech and ear images. In: Proc. Workshop on Multimodal User Authentication, pp. 85–90 (2003)

    Google Scholar 

  8. Iannarelli, A.: Ear Identification, Forensic Identification series. Paramont Publishing Company, Fremont (1989)

    Google Scholar 

  9. Burge, M., Burger, W.: Ear biometrics. In: Jain, A., Bolle, R., Pankanti, S. (eds.) Biometrics: Personal Identification in Networked Society, pp. 273–285. Kluwer Academic, Boston (1999)

    Google Scholar 

  10. Turk, M., Pentland, A.P.: Face recognition using eigenface. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 586–591 (1991)

    Google Scholar 

  11. Common, P.: Independent component analysis – A new concept? Signal Processing 36(3), 287–314 (1994)

    Article  Google Scholar 

  12. Draper, B.A., Baek, K., Bartlett, M.S., Beveridge, J.R.: Recognizing faces with PCA and ICA. Computer Vision and Image Understanding 91(2), 115–137 (2003)

    Article  Google Scholar 

  13. Connie, T., Teoh, A., Goh, M., Ngo, D.: Palmprint recognition with PCA and ICA. In: Proc. Image and Vision Computing New Zealand, Palmerston North, New Zealand, pp. 227–232 (2003)

    Google Scholar 

  14. http://www.cis.hut.fi/projects/ica/fastica/

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Iwano, K., Miyazaki, T., Furui, S. (2005). Multimodal Speaker Verification Using Ear Image Features Extracted by PCA and ICA. In: Kanade, T., Jain, A., Ratha, N.K. (eds) Audio- and Video-Based Biometric Person Authentication. AVBPA 2005. Lecture Notes in Computer Science, vol 3546. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11527923_61

Download citation

  • DOI: https://doi.org/10.1007/11527923_61

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-27887-0

  • Online ISBN: 978-3-540-31638-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics