Skip to main content
Springer Nature Link
Log in

Video-Based Face Recognition Algorithms

  • Chapter
Handbook of Remote Biometrics

Part of the book series: Advances in Pattern Recognition ((ACVPR))

Abstract

Traditional face recognition systems have relied on a gallery of still images for learning and a probe of still images for recognition. While the advantage of using motion information in face videos has been widely recognized, computational models for video-based face recognition have only recently gained attention. This chapter reviews some recent advances in this novel framework. In particular, the utility of videos in enhancing performance of image-based tasks (such as recognition or localization) will be summarized. Subsequently, spatiotemporal video-based face recognition systems based on particle filters, hidden Markov models , and system theoretic approaches will be presented. Further, some useful face databases employable by researchers interested in this field will be described. Finally, some open research issues will be proposed and discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Aggarwal, G., Chowdhury, A.R., and Chellappa, R.: A system identification approach for video-based face recognition, In: Proceedings of the 17th International Conference on Pattern Recognition (ICPR), Cambridge, UK, 175–178, 2004.

    Chapter  Google Scholar 

  2. Aggarwal, G., Veeraraghavan, A., and Chellappa, R.: 3D facial pose tracking in uncalibrated videos, In: International Conference on Pattern Recognition and Machine Intelligence (PReMI), 2005.

    Google Scholar 

  3. Anderson, B. and Moore, J.: Optimal Filtering, Prentice Hall, Englewood Cliffs, New Jersey, 1979.

    MATH  Google Scholar 

  4. Arandjelovic, O., and Cipolla, R.: Face recognition from video using the generic shape-illumination manifold , In: Proc. 9th European Conference on Computer Vision, Graz (Austria) (May) Edited by A. Leonardis, H. Bischof and A. Pinz, volume LNCS 3954, 27–40, Springer, 2006.

    Google Scholar 

  5. Bailly-Bailliére, E., Bengio, S., Bimbot, F., Hamouz, M., Kittler, J., Mariéthoz, J., Matas, J., Messer, K., Popovici, V., Porée, F., Ruíz, B., and Thiran, J.P.: The BANCA database and evaluation protocol. Proc. of Audio Video-based Person Authentication, 625–638, 2003.

    Google Scholar 

  6. Bicego, M., Castellani, U., and Murino, V.: Using hidden Markov models and wavelets for face recognition. Proc. of IEEE Int. Conf. on Image Analysis and Processing 52–56, 2003.

    Google Scholar 

  7. Cascia, M.L., Sclaroff, S., and Athitsos, V.: Fast, reliable head tracking under varying illumination: An approach based on registration of texture-mapped 3D models, In: IEEE Trans. on Pattern Analysis and Machine Intelligence, 22 322–336, 2000.

    Article  Google Scholar 

  8. Chan, A.B. and Vasconcelos, N.: Probabilistic kernels for the classification of auto-regressive visual processes, In: IEEE Conference on Computer Vision and Pattern Recognition, 1 846–851, 2005.

    Google Scholar 

  9. Cock, K.D. and Moor, B.D.: Subspace angles between ARMA models, Systems and Control Letters, 46 265–270, 2002.

    Article  MATH  MathSciNet  Google Scholar 

  10. Chikuse, Y.: Statistics on special manifolds, Lecture Notes in Statistics. Springer, New York, 2003.

    Google Scholar 

  11. Doucet, A., Godsill, S.J., and Andrieu, C.: On sequential Monte Carlo sampling methods for Bayesian filtering, In: Statisical Computing, 10(3) 197–209, 2000.

    Article  Google Scholar 

  12. Doucet, A., Freitas, N.D., and Gordon, N.: Sequential Monte Carlo Methods in Practice, Springer-Verlag, New York, 2001.

    MATH  Google Scholar 

  13. Gordon, N.J., Salmond, D.J., and Smith, A.F.M.: Novel approach to nonlinear/non-gaussian Bayesian state estimation, In: IEE Proceedings on Radar and Signal Processing, 140 107–113, 1993.

    Article  Google Scholar 

  14. Hadid, A., and Pietikainen, M.: An experimental investigation about the integration of facial dynamics in video-based face recognition, Electronic Letters on Computer Vision and Image Analysis, 5(1):1–13, 2005

    Google Scholar 

  15. Hager, G.D. and Belhumeur, P.N.: Efficient region tracking with parametric models of geometry and illumination. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20 1025–1039, 1998.

    Article  Google Scholar 

  16. Ho, T.K., Hull, J.J., and Srihari, S.N.: Decision combination in multiple classifier systems, IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(1), 66–75, 1994.

    Article  Google Scholar 

  17. Isard, M. and Blake, A.: Contour tracking by stochastic propagation of conditional density, In: Proceedings of European Conference on Computer Vision 343–356, 1996.

    Google Scholar 

  18. Jebara, T.S. and Pentland, A.: Parameterized structure from motion for 3D adaptive feedback tracking of faces, In: IEEE Conference on Computer Vision and Pattern Recognition, 1997.

    Google Scholar 

  19. Kashyap, R.L.: A Bayesian comparison of different classes of dynamic models using empirical data, IEEE Transactions on Automatic Control, AC-22(5) 715–727, 1977.

    Article  MathSciNet  Google Scholar 

  20. Kitagawa, G.: Monte carlo filter and smoother for non-gaussian nonlinear state space models, In: Journal of Computational and Graphical Statistics, 5 1–25, 1996.

    Article  MathSciNet  Google Scholar 

  21. Kittler, J., Hatef, M., Duin, R.P.W. and Matas J.: On combining classifiers, IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(3) 226–239, 1998.

    Article  Google Scholar 

  22. Kohir, V.V. and Desai, U.B.: Face recognition using DCT-HMM approach, Proc. Workshop on Advances in Facial Image Analysis and Recognition Technology, 1998.

    Google Scholar 

  23. Lanitis, A., Taylor, C., and Cootes, T.: Automatic interpretation and coding of face images using flexible models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19 743–756, 1997.

    Article  Google Scholar 

  24. Lee, K.C., Ho, J., Yang, M.H., and Kriegman, D.: Video-based face recognition using probabilistic appearance manifolds, In: IEEE Conference on Computer Vision and Pattern Recognition, 2003.

    Google Scholar 

  25. Lee, K.C., Ho, J., Yang, M.H., and Kriegman, D.: Visual tracking and recognition using probabilistic appearance manifolds. Computer Vision and Image Understanding, 99(3): 303–331, 2005.

    Article  Google Scholar 

  26. Li, B. and Chellappa, R.: Face verification through tracking facial features, In: Journal of the Optical Society of America A, 18 2969–2981, 2001.

    Article  Google Scholar 

  27. Liu, J.S. and Chen, R.: Sequential Monte Carlo for dynamic systems, In: Journal of the American Statistical Association, 93 1031–1041, 1998.

    Google Scholar 

  28. Liu, X. and Chen, T.: Video-based face recognition using adaptive hidden Markov models , IEEE Conference on Computer Vision and Pattern Recognition, 2003.

    Google Scholar 

  29. Martin, R.J.: A metric for ARMA processes, In: IEEE Transactions on Signal Processing, 48(4), 1164–1170, 2000.

    Article  MATH  MathSciNet  Google Scholar 

  30. Messer, K., Kittler, J., Sadeghi, M., Hamouz, M., Kostin, A., Cardinaux, F., Marcel, S., Bengio, S., Sanderson, C., Poh, N., Rodriguez, Y., Czyz, J., Vandendorpe, L., McCool, C., Lowther, S., Sridharan, S., Chandran, V., Palacios, R.P., Vidal, E., Li Bai, LinLin Shen, Yan Wang, Chiang Yueh-Hsuan, Liu Hsien-Chang, Hung Yi-Ping, Heinrichs, A., Muller, M., Tewes, A., von der Malsburg, C., Wurtz, R., Zhenger Wang, Feng Xue, Yong Ma, Qiong Yang, Chi Fang, Xiaoqing Ding, Lucey, S., Goss, R., and Schneiderman, H.: Face Authentication Test on the BANCA Database . ICPR, 4 523–532, 2004.

    Google Scholar 

  31. Messer, K., Kittler, J., Sadeghi, M., Hamouz, M., Kostin, A., Marcel, S., Bengio, S., Cardinaux, F., Sanderson, C., Poh, N., Rodriguez, Y., Kryszczuk, K., Czyz, J., Vandendorpe, L., Ng, J., Cheung, H., and Tang, B.: Face authentication competition on the BANCA database . ICBA 8–15, 2004.

    Google Scholar 

  32. O’Toole, A.J., Roark, D., and Abdi, H.: Recognizing moving faces: A Psychological and Neural Synthesis, In: Trends in Cognitive Sciences, 6, 261–266, 2002.

    Article  Google Scholar 

  33. O’Toole, A.J., Harms, J., Snow, S.L., Hurst, D.R., Pappas, M.R., and Abdi, H.: A video database of moving faces and people. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(5) 812–816, 2005.

    Article  Google Scholar 

  34. Overschee, P.V. and Moor, B.D.: N4SID : Subspace algorithms for the identification of combined deterministic-stochastic systems, In: Automatica, 30 75–93, 1994.

    Article  MATH  Google Scholar 

  35. Rabiner, L.: A tutorial on Hidden Markov Models and selected applications in speech recognition, Proc. of IEEE, 77(2) 257–286, 1989.

    Article  Google Scholar 

  36. Roark, D.A., Barrett, S.E., O’Toole, A.J., and Abdi, H.: Learning the moves: The effect of familiarity and facial motion on person recognition across large changes in viewing format, In: Perception,35 761–773, 2006.

    Article  Google Scholar 

  37. Ross, A., Nandakumar, K., and Jain, A.K.: Handbook of Multibiometrics, Springer, New York, 2006.

    Google Scholar 

  38. Schwarz, G.: Estimating the dimension of a model. Annals of Statistics, 6(2):461–464, 1978.

    Article  MATH  MathSciNet  Google Scholar 

  39. Soatto, S., Doretto, G., and Wu, Y.N.: Dynamic textures, In: International Conference on Computer Vision, 2 439–446, 2001.

    Google Scholar 

  40. Smyth, P.: Clustering sequences with hidden Markov models, In: M. Mozer, M. Jordan, T. Petsche (Eds.), Advances in Neural Information Processing Systems, 9, MIT Press, Cambridge, MA, p. 648, 1997.

    Google Scholar 

  41. Tistarelli, M., Bicego, M., and Grosso, E.: Dynamic face recognition: From Human to Machine Vision, Image and Vision Computing, 27(3) 222–232, 2009.

    Article  Google Scholar 

  42. Turaga, P., Veeraraghavan, A., and Chellappa, R.: Statistical analysis on Stiefel and Grassmann manifolds with applications in computer vision, In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008.

    Google Scholar 

  43. Vishwanathan, S.V.N., Smola, A.J., and Vidal, R.: Binet-Cauchy kernels on dynamical systems and its application to the analysis of dynamic scenes, In: International Journal of Computer Vision, 73(1), 95–119, 2007.

    Article  Google Scholar 

  44. Zhou, S., Krueger, V., and Chellappa, R.: Probabilistic recognition of human faces from video , In: Computer Vision and Image Understanding (CVIU) (special issue on Face Recognition) 91 214–245, 2003.

    Article  Google Scholar 

  45. Zhou, S.K., Chellappa, R., and Moghaddam, B.: Visual tracking and recognition using appearance-adaptive models in particle filters, In: IEEE Transactions on Image Processing 13(11) 1491–1506, 2004.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering and Center for Automation Research, UMIACS University of Maryland, College Park, MD 20742, USA

    Rama Chellappa

  2. University of Verona, Verona, Italy

    Manuele Bicego

  3. Department of Electrical and Computer Engineering and Center for Automation Research, UMIACS University of Maryland, College Park, Maryland 20742, USA

    Pavan Turaga

Authors
  1. Rama Chellappa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manuele Bicego
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pavan Turaga
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rama Chellappa .

Editor information

Editors and Affiliations

  1. Universitá of Sassari, Dipto. Architettura e Pianificazione, Piazza Duomo, 6, 07041 Alghero SS, Italy

    Massimo Tistarelli (Prof.) (Prof.)

  2. Chinese Academy of Science Institute of Automation, Center Biometrics Research & Security, Room 1227, Zhongguancun 95, 100080 Beijing, China

    Stan Z. Li

  3. University of Maryland, Center for Automation Research, College Park, MD 20742-3275, USA

    Rama Chellappa

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag London Limited

About this chapter

Cite this chapter

Chellappa, R., Bicego, M., Turaga, P. (2009). Video-Based Face Recognition Algorithms. In: Tistarelli, M., Li, S.Z., Chellappa, R. (eds) Handbook of Remote Biometrics. Advances in Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-84882-385-3_8

Download citation

  • DOI: https://doi.org/10.1007/978-1-84882-385-3_8

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84882-384-6

  • Online ISBN: 978-1-84882-385-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics