Abstract
This paper presents a novel approach for automatic person labelling in video sequences using costumes. The person recognition is carried out by extracting the costumes of all the persons who appear in the video. Then, their reappearance in subsequent frames is performed by searching the reappearance of their costume. Our contribution in this paper is a new approach for costume detection, without face detection, that allows the localization of costumes even if persons are not facing the camera. Actually face detection is also used because it presents a very accurate heuristic for costume detection, but in addition in each shot mean shift costume localization is carried out with the most relevant costume when face detection fails. Results are presented with TV broadcasts.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Yahiaoui, I.: Construction automatique de résumés vidéos. Thèse de doctorat, Télécom Paris, France (2003)
Nack, F.: AUTEUR: The Application of Video Semantics and Theme Representation for Automated Film Editing. PhD thesis, Lancaster University, UK (1996)
Bui Thi, M.P., Joly, P.: Describing video contents: the semiotic approach. In: Proceedings of the 2nd Content-Based Multimedia Indexing Workshop, Brescia, Italy, pp. 259–266 (2001)
Jaffré, G., Joly, P.: Costume: A New Feature for Automatic Video Content Indexing. In: Proceedings of RIAO - Coupling approaches, coupling media and coupling languages for information retrieval, Avignon, France, pp. 314–325 (2004)
Lerdsudwichai, C., Abdel-Mottaleb, M.: Algorithm for Multiple Faces Tracking. In: IEEE International Conference on Multimedia & Expo., Baltimore, Maryland, USA (2003)
Zhai, Y., Chao, X., Zhang, Y., Javed, O., Yilmaz, A., Rafi, F., Ali, S., Alatas, O., Khan, S., Shah, M.: University of Central Florida at TRECVID 2004. In: Proceedings of the TRECVID 2004 Workshop, Gaithersburg, Maryland, USA, pp. 217–224 (2004)
Broggi, A., Bertozzi, M., Chapuis, R., Chausse, F., Fascioli, A., Tibaldi, A.: Pedestrian Localization and Tracking System with Kalman Filtering. In: Proceedings of the IEEE Intelligent Vehicles Symposium, Parma, Italy, pp. 584–589 (2004)
Yang, H.D., Lee, S.W.: Multiple Pedestrian Detection and Tracking based on Weighted Temporal Texture Features. In: Proceedings of the 17th International Conference on Pattern Recognition, Cambridge, UK, vol. 4, pp. 248–251 (2004)
Yang, M.H., Kriegman, D., Ahuja, N.: Detecting faces in images: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 34–58 (2002)
Lienhart, R., Maydt, J.: An Extended Set of Haar-like Features for Rapid Object Detection. In: Proceedings of the IEEE International Conference on Image Processing, Rochester, New York, USA, vol. 1, pp. 900–903 (2002)
Swain, M., Ballard, D.: Color Indexing. International Journal of Computer Vision 7, 11–32 (1991)
Jaffré, G., Crouzil, A.: Non-Rigid Object Localization from Color Model using Mean Shift. In: Proceedings of the IEEE International Conference on Image Processing, Barcelona, Spain, vol. 3, pp. 317–320 (2003)
Comaniciu, D., Meer, P.: Mean Shift: A Robust Approach Toward Feature Space Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 603–619 (2002)
Duda, R., Hart, P., Stork, D.: Pattern Classification, 2nd edn. Wiley-Interscience, Hoboken (2001)
Andrews, H.: Introduction to Mathematical Techniques in Pattern Recognition. Wiley-Interscience, Hoboken (1972)
Aherne, F., Thacker, N., Rockett, P.: The Bhattacharyya Metric as an Absolute Similarity Measure for Frequency Coded Data. Kybernetika 32, 1–7 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jaffré, G., Joly, P. (2005). Improvement of a Person Labelling Method Using Extracted Knowledge on Costume. In: Gagalowicz, A., Philips, W. (eds) Computer Analysis of Images and Patterns. CAIP 2005. Lecture Notes in Computer Science, vol 3691. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11556121_60
Download citation
DOI: https://doi.org/10.1007/11556121_60
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28969-2
Online ISBN: 978-3-540-32011-1
eBook Packages: Computer ScienceComputer Science (R0)