Abstract
In this paper, an investigation is carried out regarding combination of 3D and 2D information for face recognition. A two-stage method, PCA and a Reduced Multivariate Polynomial Model (RMPM), is developed to fuse the appearance and depth information of face images in feature level where simplicity (number of polynomial coefficients increases linearly with model-order and input-dimension, i.e. no dimension explosion as in the case of full multivariate polynomials)and ease of use (can be easily formulated into recursive learning fashion) are major concerns. To cater for fast on-line registration capability when a new user arrives, the learning is formulated into recursive form. The improvement of the face recognition rate using this combination is quantified. The recognition rate by the combination is better than either appearance alone or depth alone. The performance of the algorithm is verified on both XM2VTS database and a real-time stereo vision system, showing that it is able to detect, track and recognize a person walking towards a stereo camera within reasonable time.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Beumier, C., Acheroy, M.: Face verification from 3D and grey level clues. Pattern Recognition Letters 22, 1321–1329 (2001)
Beumier, C., Acheroy, M.: Automatic face verification from 3D surface. In: Proceedings of British Machine Vision Conference, pp. 449–458 (1998)
Bruneli, R., Falavingna, D.: Person identification using multiple cues. IEEE Trans. on PAMI 17(10), 955–966 (1995)
Chellappa, R., Wilson, C.L., Sirohey, S.: Human and machine recognition of faces. Proceedings of the IEEE 83(5), 705–740 (1995)
Choudhury, T., Clarkson, B., Jebara, T., Pentland, A.: Multimodal, Person recognition using unconstrained audio and video. In: Proc. of AVBPA, pp. 176–181 (1999)
Gordon, G.: Face Recognition Based on Depth Maps and Surface Curvature. In: Proc. Of FGR, pp. 176–181 (1996)
Kittler, J., Hatef, M., Duin, R.P.W., Matas, J.: On combining classifiers. IEEE Trans. on PAMI 20(3), 226–239 (1998)
Videre Design. MEGA-D Megapixel Digital Stereo Head (2000), http://www.ai.sri.com/~konolige/svs
Socolinsky, D.A., Selinger, A., Neuheisel, J.D.: Face recognition with visible and thermal infrared imagery. Computer Vision and Image Understanding 91 (2003)
Toh, K.-A., Tran, Q.-L., Srinivasan, D.: Benchmarking a reduced multivariate polynomial pattern classifier. IEEE Trans. On PAMI 26(6), 740–755 (2004)
Taylor, S., Cristianini, N.: Kernel methods for pattern analysis. Cambridge University Press, Cambridge (2004)
Masser, K., Matas, J., Kittler, J., Luettin, J., Maitre, G.: XM2VTSDB: The extended M2VTS Database. In: AVBPA, pp. 72–77 (1999)
Chang, K.I., Bowyer, K.W., Flynn, P.J.: Multi-biometrics using facial appearance, shape and temperature. In: Proc. FGR, pp. 43–48 (2004)
Tsalakanidou, F., Tzovaras, D., Strintzis, M.G.: Use of depth and color eigenfaces for face recognition. Pattern Recognition Letters 24, 1427–1435 (2003)
Wang, J.-G., Kong, H., Venkateswarlu, R.: Improving face recognition rates by combining color and depth Fisherfaces. In: 6th Asian Conference on Computer Vision, pp. 126–131 (2004)
Wang, J.-G., Lim, E.T., Venkateswarlu, R.: Stereo face detection/tracking and recognition. In: IEEE International Conference on Image Processing, pp. 638–644 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, JG., Toh, KA., Venkateswarlu, R. (2005). Fusion of Appearance and Depth Information for Face Recognition. In: Kanade, T., Jain, A., Ratha, N.K. (eds) Audio- and Video-Based Biometric Person Authentication. AVBPA 2005. Lecture Notes in Computer Science, vol 3546. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11527923_96
Download citation
DOI: https://doi.org/10.1007/11527923_96
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27887-0
Online ISBN: 978-3-540-31638-1
eBook Packages: Computer ScienceComputer Science (R0)