Skip to main content
Springer Nature Link
Log in

Person Identification Using Lip Motion Sequence

  • Conference paper
Knowledge-Based Intelligent Information and Engineering Systems (KES 2007)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4692))

Abstract

In this paper, we propose a new method based on lip motion sequence and the Unconstrained Minimum Average Correlation Energy (UMACE) filter as a classifier for person identification. UMACE filter has advantages in terms of their characteristics such as distortion-tolerant, shift-invariant and high discrimination ability. Therefore, executing UMACE filter provides an ideal application for person identification because we deal with the variations of the lip appearance in each frame sequence. The results obtained using a Digit Database show that the use of lip motion sequence and UMACE filter offer a good potential and can be an alternative technique for a person identification system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Brunelli, R., Falavigna, D.: Personal Identification using Multiple Cue. IEEE Trans. on Pattern Analysis and Machine Intelligence 17(10), 955–966 (1995)

    Article  Google Scholar 

  2. Zhang, D., Ghobakhlou, A., Kasabov, N.: An Adaptive Model of Person Identification Combining Speech and Image Information. In: IEEE International Conference on Control, Automation, Robotic and Vision, pp. 413–418 (2004)

    Google Scholar 

  3. Fox, N.A., Reilly, R.B.: Robust Multi-Modal Person Identification with Tolerance of Facial Expression. In: IEEE International Conference on System, Man and Cybernetics, pp. 580–585 (2004)

    Google Scholar 

  4. Wark, T., Sridharan, S.: A Syntactic Approach to Automatic Lip Feature Extraction for Speaker Identification. IEEE International Conference on Acoustics Speech and Signal Processing 6, 3693–3696 (1998)

    Google Scholar 

  5. Wark, T., Sridharan, S., Chandran, V.: The use of Speech and Lip Modalities for Robust Speaker Verification under Adverse Conditions. IEEE International Conference on Acoustics Speech and Signal Processing 6, 3061–3064 (1999)

    Google Scholar 

  6. Broun, C.C., Zhang, X., Mersereau, R.M., Clements, M.: Automatic Speechreading with Application to Speaker Verification. IEEE International Conference on Acoustics Speech and Signal Processing 1, 685–688 (2002)

    Article  Google Scholar 

  7. Chetty, G., Wagner, M.: Liveness Verification in Audio-Video Speaker Authentication. In: Proceeding of International Conference on Spoken Language Processing ICSLP, pp. 2509–2512 (2004)

    Google Scholar 

  8. Chetty, G., Wagner, M.: Automated Lip Feature Extraction for Liveness Verification in Audio-Video Authentication. In: Proceeding of Image and Vision Computing, pp. 17–22 (2004)

    Google Scholar 

  9. Faraj, M.I., Bigun, J.: Person Verification by Lip-Motion. In: IEEE International Conference on Computer Vision and Pattern Recognition Workshop, pp. 37–43 (2006)

    Google Scholar 

  10. Hennecke, M.E., Stork, D.G., Prasad, K.V.: Visionary speech: Looking Ahead to Practical Speechreading Systems. Speechreading by Humans and Machines, pp. 331–349. Springer, Heidelberg (1996)

    Google Scholar 

  11. Potamianos, G., Neti, C., Gravier, G., Garg, A., Senior, A.W.: Recent Advances in Automatic Recognition of Audio-Visual Speech. Proceeding of the IEEE 91(9), 1306–1326 (2003)

    Article  Google Scholar 

  12. Potamianos, G., Neti, C.: Improved ROI and Within Frame Discriminant Features for Lipreading, pp. 250–253 (2001)

    Google Scholar 

  13. Reynolds, D.A.: An Overview of Automatic Speaker Recognition Technology. Proceeding of IEEE on Acoustics Speech and Signal Processing 4, 4072–4075 (2002)

    Google Scholar 

  14. Campbell, W.M.: A SVM/HMM System for Speaker Recognition. Proceeding of IEEE on Acoustics Speech and Signal Processing 2, 209–212 (2003)

    Google Scholar 

  15. Savvides, M., Venkataramani, K., Vijaya Kumar, B.V.K.: Incremental Updating of Advanced Correlation Filters for Biometric Authentication System. Proceeding of ICME 3, 229–232 (2003)

    Google Scholar 

  16. Vijaya Kumar, B.V.K., Savvides, M., Venkataramani, K., Xie, C.: Spatial Frequency Domain Image Processing for Biometric Recognition. Proceeding of International. Conference on Image Processing (ICIP) 1, 53–56 (2002)

    Article  Google Scholar 

  17. Savvides, M., Vijaya Kumar, B.V.K., Khosla, P.: Face Verification using Correlation Filters. Proceeding of Third IEEE Automatic Identification Advanced Technologies, pp. 56–61 (2002)

    Google Scholar 

  18. Venkataramani, K., Vijaya Kumar, B.V.K.: Fingerprint Verification using Correlation Filters. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 886–894. Springer, Heidelberg (2003)

    Google Scholar 

  19. Savvides, M., Vijaya Kumar, B.V.K.: Efficient Design of Advanced Correlation Filters for Robust Distortion-Tolerant Face Recognition. In: Proceeding of the IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS’03), pp. 229–232 (2003)

    Google Scholar 

  20. Sanderson, C., Paliwal, K.K.: Noise Compensation in a Multi-Modal Verification System. In: Proceedings of International Conference on Acoustics, Speech and Signal Processing, pp. 157–160 (2001)

    Google Scholar 

  21. Matthews, I., Cootes, J., Bangham, J., Cox, S., Harvey, R.: Extraction of visual features for Lipreading. IEEE Trans. on Pattern Analysis and Machine Intelligence 24(2), 198–213 (2002)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia

    Salina Abdul Samad, Dzati Athiar Ramli & Aini Hussain

Authors
  1. Salina Abdul Samad
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dzati Athiar Ramli
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Aini Hussain
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Bruno Apolloni Robert J. Howlett Lakhmi Jain

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Samad, S.A., Ramli, D.A., Hussain, A. (2007). Person Identification Using Lip Motion Sequence. In: Apolloni, B., Howlett, R.J., Jain, L. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2007. Lecture Notes in Computer Science(), vol 4692. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74819-9_103

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-74819-9_103

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-74817-5

  • Online ISBN: 978-3-540-74819-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics