Abstract
Face recognition in videos is a hot topic in computer vision and biometrics over many years. Compared to traditional face analysis, video based face recognition has advantages of more abundant information to improve accuracy and robustness, but also suffers from large scale variations, low quality of facial images, illumination changes, pose variations and occlusions. Related to applications, we divide the existing video based face recognition approaches into two categories: video-image based methods and video-video based methods, which are surveyed and analyzed in this paper.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Shakhnarovich, G., Fisher, J.W., Darrell, T.: Face Recognition from Long-Term Observations. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part III. LNCS, vol. 2352, pp. 851–865. Springer, Heidelberg (2002)
Liu, X., Chen, T., Thornton, S.M.: Eigenspace updating for non-stationary process and its application to face recognition. Pattern Recognition 36(9), 1945–1959 (2003)
Liu, X., Cheng, T.: Video-based face recognition using adaptive hidden markov models. In: Proceedings of 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. I–340. IEEE (2003)
Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Video-based face recognition using probabilistic appearance manifolds. In: Proceedings of 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. I–313. IEEE (2003)
Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Visual tracking and recognition using probabilistic appearance manifolds. Computer Vision and Image Understanding 99, 303–331 (2005)
Zhou, S., Krueger, V., Chellappa, R.: Probabilistic recognition of human faces from video q. Computer Vision and Image Understanding 91, 214–245 (2003)
Zhou, S.K., Chellappa, R., Moghaddam, B.: Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE Transactions on Image Processing 13(11), 1491–1506 (2004)
Aggarwal, G., Chowdhury, A.K.R., Chellappa, R.: A system identification approach for video-based face recognition. In: Proceedings of 17th International Conference on Pattern Recognition, ICPR 2004, vol. 4, pp. 175–178. IEEE Computer Society (2004)
Arandjelović, O., Cipolla, R.: Face recognition from face motion manifolds using robust kernel resistor-average distance. In: Conference on Computer Vision and Pattern Recognition Workshop, CVPRW 2004, p. 88. IEEE (2004)
Arandjelović, O., Shakhnarovich, G., Fisher, J., Cipolla, R., Darrell, T.: Face recognition with image sets using manifold density divergence (2005)
Cipolla, R., Arandjelović, O.: A pose-wise linear illumination manifold model for face recognition using video. Computer Vision and Image Understanding 113(1), 113–125 (2009)
Fukui, K., Yamaguchi, O.: Face recognition using multi-viewpoint patterns for robot vision. In: Robotics Research, pp. 192–201 (2005)
Nishiyama, M., Yamaguchi, O., Fukui, K.: Face Recognition with the Multiple Constrained Mutual Subspace Method. In: Kanade, T., Jain, A., Ratha, N.K. (eds.) AVBPA 2005. LNCS, vol. 3546, pp. 71–80. Springer, Heidelberg (2005)
Li, J., Wang, Y., Tan, T.: Video-Based Face Recognition Using A Metric of Average Euclidean Distance. In: Li, S.Z., Lai, J.-H., Tan, T., Feng, G.-C., Wang, Y. (eds.) SINOBIOMETRICS 2004. LNCS, vol. 3338, pp. 224–232. Springer, Heidelberg (2004)
Li, J., Wang, Y., Tan, T.: Video-Based Face Recognition Using Earth Mover’s Distance. In: Kanade, T., Jain, A., Ratha, N.K. (eds.) AVBPA 2005. LNCS, vol. 3546, pp. 229–238. Springer, Heidelberg (2005)
Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 1991, pp. 586–591. IEEE (1991)
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)
Satoh, S.: Comparative evaluation of face sequence matching for content-based video access. In: Proceedings of Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000, pp. 163–168. IEEE (2000)
Arca, S., Campadelli, P., Lanzarotti, R.: A face recognition system based on automatically determined facial fiducial points. Pattern Recognition 39(3), 432–443 (2006)
Stallkamp, J., Ekenel, H.K., Stiefelhagen, R.: Video-based face recognition on real-world data. In: IEEE 11th International Conference on Computer Vision, ICCV 2007, pp. 1–8. IEEE (2007)
Kokiopoulou, E., Frossard, P.: Video face recognition with graph-based semi-supervised learning. In: IEEE International Conference on Multimedia and Expo, ICME 2009, pp. 1564–1565. IEEE (2009)
Hu, C., Harguess, J., Aggarwal, J.K.: Patch-based face recognition from video. In: 2009 16th IEEE International Conference on Image Processing (ICIP), pp. 3321–3324. IEEE (2009)
Choi, J.Y., Ro, Y.M., Plataniotis, K.N.: Feature subspace determination in video-based mismatched face recognition. In: 8th IEEE International Conference on Automatic Face & Gesture Recognition, FG 2008, pp. 1–6. IEEE (2008)
Eidenberger, H.: Kalman filtering for pose-invariant face recognition. In: 2006 IEEE International Conference on Image Processing, pp. 2037–2040. IEEE (2006)
Park, U., Jain, A.K., Ross, A.: Face recognition in video: Adaptive fusion of multiple matchers. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2007)
Lapedriza, A., Masip, D., Vitria, J.: Face verification using external features. In: 7th International Conference on Automatic Face and Gesture Recognition, FGR 2006, pp. 132–137. IEEE (2006)
Mian, A.: Unsupervised learning from local features for video-based face recognition. In: 8th IEEE International Conference on Automatic Face & Gesture Recognition, FG 2008, pp. 1–6. IEEE (2008)
Wolf, L., Shashua, A.: Kernel principal angles for classification machines with applications to image sequence interpretation (2003)
Fan, W., Yeung, D.Y.: Locally linear models on face appearance manifolds with application to dual-subspace based classification (2006)
Moghaddam, B., Jebara, T., Pentland, A.: Bayesian face recognition. Pattern Recognition 33(11), 1771–1782 (2000)
Zhou, S.K., Chellappa, R.: From sample similarity to ensemble similarity: Probabilistic distance measures in reproducing kernel hilbert space. IEEE transactions on pattern analysis and machine intelligence, 917–929 (2006)
Fan, W., Wang, Y., Tan, T.: Video-Based Face Recognition Using Bayesian Inference Model. In: Kanade, T., Jain, A., Ratha, N.K. (eds.) AVBPA 2005. LNCS, vol. 3546, pp. 122–130. Springer, Heidelberg (2005)
Li, Y., Gong, S., Liddell, H.: Modelling faces dynamically across views and over time. In: Proceedings of Eighth IEEE International Conference on Computer Vision, ICCV 2001, vol. 1, pp. 554–559. IEEE (2001)
Li, Y., Gong, S., Liddell, H.: Video-based online face recognition using identity surfaces. ratfg-rts, 40 (2001)
Li, Y., Gong, S., Liddell, H.: Constructing facial identity surfaces in a nonlinear discriminating space (2001)
Liu, L., Wang, Y., Tan, T.: Online appearance model learning for video-based face recognition. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–7. IEEE (2007)
Kim, M., Kumar, S., Pavlovic, V., Rowley, H.: Face tracking and recognition with visual constraints in real-world videos. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008)
Matta, F., Dugelay, J.L.: Person recognition using facial video information: A state of the art. Journal of Visual Languages & Computing 20(3), 180–187 (2009)
Saeed, U., Matta, F., Dugelay, J.L.: Person recognition based on head and mouth dynamics. In: 2006 IEEE 8th Workshop on Multimedia Signal Processing, pp. 29–32. IEEE (2006)
Matta, F., Dugelay, J.L.: Video face recognition: a physiological and behavioural multimodal approach. In: IEEE International Conference on Image Processing, 2007. ICIP 2007, vol. 4, pp. IV–497. IEEE (2007)
Matta, F., Dugelay, J.-L.: Person recognition using human head motion information. In: Perales, F.J., Fisher, R.B. (eds.) AMDO 2006. LNCS, vol. 4069, pp. 326–335. Springer, Heidelberg (2006)
Huang, K.S., Trivedi, M.M.: Streaming face recognition using multicamera video arrays. In: Proceedings of 16th International Conference on Pattern Recognition 2002, vol. 4, pp. 213–216. IEEE (2002)
Gross, R., Shi, J.: The cmu motion of body (mobo) database (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, Z., Wang, C., Wang, Y. (2011). Video-Based Face Recognition: State of the Art. In: Sun, Z., Lai, J., Chen, X., Tan, T. (eds) Biometric Recognition. CCBR 2011. Lecture Notes in Computer Science, vol 7098. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25449-9_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-25449-9_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25448-2
Online ISBN: 978-3-642-25449-9
eBook Packages: Computer ScienceComputer Science (R0)