Skip to main content

Face Detection, Tracking, and Recognition for Broadcast Video

  • Reference work entry
Encyclopedia of Multimedia

Synonyms

Face localization; Face grouping; Face identification; Face matching; Person information analysis

Definition

Face detection and tracking are techniques for locating faces in images and video sequences; face recognition is a technique for identifying or verifying unknown people using a stored database of known faces.

Introduction

Human face processing techniques for broadcast video, including face detection, tracking, and recognition, has attracted a lot of research interest because of its value in various applications, such as video structuring, indexing, retrieval, and summarization. The main reason for this is that the human face provides rich information for spotting the appearance of certain people of interest, such as government leaders in news video, the pitcher in a baseball video, or a hero in a movie, and is the basis for interpreting facts.

Face processing techniques have several applications. For example, Name-It [1] aims to associate names and faces appearing in...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 449.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.viewdle.com

  2. 2.

    http://opencvlibrary.sourceforge.net/

  3. 3.

    http://www.cs.colostate.edu/evalfacerec/

References

  1. S. Satoh, Y. Nakamura, and T. Kanade, “Name-It: Naming and Detecting Faces in News Videos,” IEEE MultiMedia, Vol. 6, No. 1, January–March 1999, pp. 22–35.

    Article  Google Scholar 

  2. D.-D. Le, S. Satoh, M.E. Houle, and D.P. Nguyen, “Finding Important People in Large News Video Databases Using Multimodal and Clustering Analysis,” Proceedings of the Second IEEE International Workshop on Multimedia Databases and Data Management, pp. 127–136, 2007.

    Google Scholar 

  3. M.-H. Yang, D. Kriegman, and N. Ahuja, “Detecting Faces in Images: A Survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, No. 1, January 2002, pp. 34–58.

    Article  Google Scholar 

  4. P. Viola and M. Jones, “Rapid Object Detection Using a Boosted Cascade of Simple Features,” Proceedings of the International Conference on Computer Vision and Pattern Recognition, Vol. 1, 2001, pp. 511–518.

    Google Scholar 

  5. H. Rowley, S. Baluja, and T. Kanade, “Neural Network-Based Face Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 20, No. 1, January 1998, pp. 23–38.

    Article  Google Scholar 

  6. A. Hadid, M. Pietikainen, and T. Ahonen, “A Discriminative Feature Space for Detecting and Recognizing Faces,” Proceedings of the International Conference on Computer Vision and Pattern Recognition, Vol. 2, 2004, pp. 797–804.

    Google Scholar 

  7. K. Levi and Y. Weiss, “Learning Object Detection from a Small Number of Examples: The Importance of Good Features,” Proceedings of the International Conference on Computer Vision and Pattern Recognition, Vol. 2, 2004, pp. 53–60.

    Google Scholar 

  8. C. Huang, H. Ai, Y. Li, and S. Lao, “Vector Boosting for Rotation Invariant Multi-View Face Detection,” Proceedings of the International Conference on Computer Vision, Vol. 1, 2005, pp. 446–453.

    Google Scholar 

  9. Sivic, M. Everingham, and A. Zisserman, “Person Spotting: Video Shot Retrieval for Face Sets,” Proceedings of the International Conference on Image and Video Retrieval, pp. 226–236, 2005.

    Google Scholar 

  10. M. Everingham, J. Sivic, and A. Zisserman, “Hello, My name is…Buffy’ – Automatic Naming of Characters in Tv Video,” Proceedings of the British Machine Vision Conference, 2006.

    Google Scholar 

  11. R. Choudhury, C. Schmid, and K. Mikolajczyk, “Face Detection and Tracking in a Video by Propagating Detection Probabilities,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, No. 10, 2003, pp. 1215–1228.

    Article  Google Scholar 

  12. G. Boccignone, V. Caggiano, G.D. Fiore, and A. Marcelli, “Probabilistic Detection and Tracking of Faces in Video,” Proceedings of the International Conference on Image Analysis and Processing, pp. 687–694, 2005.

    Google Scholar 

  13. Y. Li, H. Ai, C. Huang, and S. Lao, “Robust Head Tracking with Particles Based on Multiple Cues Fusion,” ECCV Workshop on HCI, pp. 29–39, 2006.

    Google Scholar 

  14. E. Arnaud, B. Fauvet, É. Mémin, and P. Bouthemy, “A Robust and Automatic Face Tracker Dedicated to Broadcast Videos,” Proceedings of the International Conference on Image Processing, pp. 429–432, 2005.

    Google Scholar 

  15. Z. Zhu and Q. Ji, “Robust Real-Time Eye Detection and Tracking Under Variable Lighting Conditions and Various Face Orientations,” Computer Vision and Image Understanding, Vol. 98, No. 1, April 2005, pp. 124–154.

    Article  Google Scholar 

  16. Y. Tong, Y. Wang, Z. Zhu, and Q. Ji, “Robust Facial Feature Tracking Under Varying Face Pose and Facial Expression,” Pattern Recognition, Vol. 40, No. 11, November 2007, pp. 3195–3208.

    Article  Google Scholar 

  17. F. Dornaika and J. Ahlberg, “Fast and Reliable Active Appearance Model Search for 3-D Face Tracking,” IEEE Transactions on Systems, Man, and Cybernetics, Vol. 34, No. 4, 2004, pp. 1838–1853.

    Article  Google Scholar 

  18. F. Dornaika and F. Davoine, “On Appearance Based Face and Facial Action Tracking,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 16, No. 9, 2006, pp. 1107–1124.

    Article  Google Scholar 

  19. W. Zhao, R. Chellappa, P.J. Phillips, and A. Rosenfeld, “Face Recognition: A Literature Survey,” ACM Computing Surveys, Vol. 35, No. 4, 2003, pp. 399–458.

    Article  Google Scholar 

  20. O. Arandjelovic and A. Zisserman, “Automatic Face Recognition for Film Character Retrieval in Feature-Length Films,” Proceedings of the International Conference on Computer Vision and Pattern Recognition, Vol. 1, 2005, pp. 860–867.

    Google Scholar 

  21. S. Satoh, “Comparative Evaluation of Face Sequence Matching for Content-Based Video Access,” Proceedings of the International Conference on Automatic Face and Gesture Recognition, pp. 163–168, 2000.

    Google Scholar 

  22. O. Arandjelovic and R. Cipolla, “Automatic Cast Listing in Feature-Length Films with Anisotropic Manifold Space,” in Proc. Intl. Conf. on Computer Vision and Pattern Recognition, vol. 2, 2006, pp. 1513–1520.

    Google Scholar 

  23. J. Yang and A.G. Hauptmann, “Naming every individual in news video monologues,” in Proc. ACM Int. Conf. on Multimedia, 2004, pp. 580–587.

    Google Scholar 

  24. O. Arandjelovic, G. Shakhnarovich, J. Fisher, R. Cipolla, and T. Darrell, “Face Recognition with Image Sets Using Manifold Density Divergence,” Proceedings of the International Conference on Computer Vision and Pattern Recognition, Vol. 1, 2005, pp. 581–588.

    Google Scholar 

  25. M. Turk and A. Pentland, “Face Recognition Using Eigenfaces,” Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 586–591, 1991.

    Google Scholar 

  26. O. Yamaguchi, K. Fukui, and K. Maeda, “Face Recognition Using Temporal Image Sequence,” Proceedings of the International Conference on Automatic Face and Gesture Recognition, pp. 318–323, 1998.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag

About this entry

Cite this entry

Le, DD., Wu, X., Satoh, S. (2008). Face Detection, Tracking, and Recognition for Broadcast Video. In: Furht, B. (eds) Encyclopedia of Multimedia. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-78414-4_79

Download citation

Publish with us

Policies and ethics