Abstract
In this paper, we propose a new method based on lip motion sequence and the Unconstrained Minimum Average Correlation Energy (UMACE) filter as a classifier for person identification. UMACE filter has advantages in terms of their characteristics such as distortion-tolerant, shift-invariant and high discrimination ability. Therefore, executing UMACE filter provides an ideal application for person identification because we deal with the variations of the lip appearance in each frame sequence. The results obtained using a Digit Database show that the use of lip motion sequence and UMACE filter offer a good potential and can be an alternative technique for a person identification system.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Brunelli, R., Falavigna, D.: Personal Identification using Multiple Cue. IEEE Trans. on Pattern Analysis and Machine Intelligence 17(10), 955–966 (1995)
Zhang, D., Ghobakhlou, A., Kasabov, N.: An Adaptive Model of Person Identification Combining Speech and Image Information. In: IEEE International Conference on Control, Automation, Robotic and Vision, pp. 413–418 (2004)
Fox, N.A., Reilly, R.B.: Robust Multi-Modal Person Identification with Tolerance of Facial Expression. In: IEEE International Conference on System, Man and Cybernetics, pp. 580–585 (2004)
Wark, T., Sridharan, S.: A Syntactic Approach to Automatic Lip Feature Extraction for Speaker Identification. IEEE International Conference on Acoustics Speech and Signal Processing 6, 3693–3696 (1998)
Wark, T., Sridharan, S., Chandran, V.: The use of Speech and Lip Modalities for Robust Speaker Verification under Adverse Conditions. IEEE International Conference on Acoustics Speech and Signal Processing 6, 3061–3064 (1999)
Broun, C.C., Zhang, X., Mersereau, R.M., Clements, M.: Automatic Speechreading with Application to Speaker Verification. IEEE International Conference on Acoustics Speech and Signal Processing 1, 685–688 (2002)
Chetty, G., Wagner, M.: Liveness Verification in Audio-Video Speaker Authentication. In: Proceeding of International Conference on Spoken Language Processing ICSLP, pp. 2509–2512 (2004)
Chetty, G., Wagner, M.: Automated Lip Feature Extraction for Liveness Verification in Audio-Video Authentication. In: Proceeding of Image and Vision Computing, pp. 17–22 (2004)
Faraj, M.I., Bigun, J.: Person Verification by Lip-Motion. In: IEEE International Conference on Computer Vision and Pattern Recognition Workshop, pp. 37–43 (2006)
Hennecke, M.E., Stork, D.G., Prasad, K.V.: Visionary speech: Looking Ahead to Practical Speechreading Systems. Speechreading by Humans and Machines, pp. 331–349. Springer, Heidelberg (1996)
Potamianos, G., Neti, C., Gravier, G., Garg, A., Senior, A.W.: Recent Advances in Automatic Recognition of Audio-Visual Speech. Proceeding of the IEEE 91(9), 1306–1326 (2003)
Potamianos, G., Neti, C.: Improved ROI and Within Frame Discriminant Features for Lipreading, pp. 250–253 (2001)
Reynolds, D.A.: An Overview of Automatic Speaker Recognition Technology. Proceeding of IEEE on Acoustics Speech and Signal Processing 4, 4072–4075 (2002)
Campbell, W.M.: A SVM/HMM System for Speaker Recognition. Proceeding of IEEE on Acoustics Speech and Signal Processing 2, 209–212 (2003)
Savvides, M., Venkataramani, K., Vijaya Kumar, B.V.K.: Incremental Updating of Advanced Correlation Filters for Biometric Authentication System. Proceeding of ICME 3, 229–232 (2003)
Vijaya Kumar, B.V.K., Savvides, M., Venkataramani, K., Xie, C.: Spatial Frequency Domain Image Processing for Biometric Recognition. Proceeding of International. Conference on Image Processing (ICIP) 1, 53–56 (2002)
Savvides, M., Vijaya Kumar, B.V.K., Khosla, P.: Face Verification using Correlation Filters. Proceeding of Third IEEE Automatic Identification Advanced Technologies, pp. 56–61 (2002)
Venkataramani, K., Vijaya Kumar, B.V.K.: Fingerprint Verification using Correlation Filters. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 886–894. Springer, Heidelberg (2003)
Savvides, M., Vijaya Kumar, B.V.K.: Efficient Design of Advanced Correlation Filters for Robust Distortion-Tolerant Face Recognition. In: Proceeding of the IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS’03), pp. 229–232 (2003)
Sanderson, C., Paliwal, K.K.: Noise Compensation in a Multi-Modal Verification System. In: Proceedings of International Conference on Acoustics, Speech and Signal Processing, pp. 157–160 (2001)
Matthews, I., Cootes, J., Bangham, J., Cox, S., Harvey, R.: Extraction of visual features for Lipreading. IEEE Trans. on Pattern Analysis and Machine Intelligence 24(2), 198–213 (2002)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Samad, S.A., Ramli, D.A., Hussain, A. (2007). Person Identification Using Lip Motion Sequence. In: Apolloni, B., Howlett, R.J., Jain, L. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2007. Lecture Notes in Computer Science(), vol 4692. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74819-9_103
Download citation
DOI: https://doi.org/10.1007/978-3-540-74819-9_103
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74817-5
Online ISBN: 978-3-540-74819-9
eBook Packages: Computer ScienceComputer Science (R0)