Skip to main content

Extraction of the Visual Features from the Audio-Visual Speech Signal and the Utilization of These Features for the Speaker Identification

  • Conference paper
Computer Recognition Systems 2

Part of the book series: Advances in Soft Computing ((AINSC,volume 45))

  • 778 Accesses

Abstract

This paper is about the visual features extraction. The shape visual features and appearance based visual features were used in this work for the speaker identification. A Gaussian Mixture Models (GMMs) were trained from these visual features and the speakers were recognized with the help of these GMMs. A difference between the speaker identification with GMM trained from audio or visual features was investigated too.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Chaloupka J (2006) Creation and Selection of the Visual Front End Features and the Audio-Visual Feature Fusion for Audio-Visual Speech Recognition. In: Speech and Computer International Conference-Specom 2006, St. Petersburg, Russia, pp. 499–502, ISBN 574520074x

    Google Scholar 

  2. Yang M H, Ahuja N (2001) Face Detection and Gesture Recognition for Human-Computer Interaction. In Kluwer Academic Publishers, USA, ISBN 0-7923-7409-6

    Google Scholar 

  3. Goecke R, Millar J B, Zelinsky A, Robert-Ribes JS (2001) Stereo Vision Lip-Tracking for Audio-Video Speech Processing. In Proceedings of the 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing ICASSP 2001, Salt Lake City, USA

    Google Scholar 

  4. Gao W, Ma J, Wang R, Yao H (2000) Towards Robust Lipreading, In International Conference on Spoken Language Processing. pp. 15–19, Beijing, China, ISBN 7801501144

    Google Scholar 

  5. Chaloupka J (2004) Automatic Lips Reading for Audio-Visual Speech Processing and Recognition. In: Proc. of ICSLP 2004, Jeju Island, Korea, pp. 2505–2508, ISSN 1225-441x

    Google Scholar 

  6. Kroschel K, Heckmann M (2002) Lip Parameter Extraction for Speechreading. In Conf. El. Sprachsignalverarbeitung, Dresden, pp. 58–65

    Google Scholar 

  7. Duchnowski P, Meier U, Waibel A(1994) See me, hear me: Integration automatic speech recognition and lip-reading. In Proc. of ICSLP 94, Yokohoma, Japan, pp. 547–550

    Google Scholar 

  8. Bregler C., Konig Y (1994) Eigenlips for robust speech recognition. In Proc. of International Conference Acoustic, Speech and Signal Processing, Adelaide, Australia, pp. 669–672

    Google Scholar 

  9. Silovsky, J, Nouza J (2006) Speech, Speaker and Speaker’s Gender Identification in Automatically Processed Broadcast Stream. In: Radioengineering, Proceedings of Czech and Slovak Technical Universities and URSI Committees, Volume 15, Number 3, pp. 42–48, ISSN 1210–2512

    Google Scholar 

  10. Steve Y, Odel J, Ollason D, Valtchev V, Woodland P (1997) The HTK Book, version 2.1. In Cambridge University, United Kingdom

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chaloupka, J. (2007). Extraction of the Visual Features from the Audio-Visual Speech Signal and the Utilization of These Features for the Speaker Identification. In: Kurzynski, M., Puchala, E., Wozniak, M., Zolnierek, A. (eds) Computer Recognition Systems 2. Advances in Soft Computing, vol 45. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75175-5_52

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-75175-5_52

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-75174-8

  • Online ISBN: 978-3-540-75175-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics