Abstract
Information about the occurrence of objects in videos and their interactions conveys an important part of the semantics of audiovisual content and can be used to narrow the semantic gap in video analysis, retrieval and summarization. Object re-detection, which aims at finding occurrences of specific objects in a single video or a collection of still images and videos, is an object identification problem and can thus be more satisfactorily solved than a general object recognition problem. As structural information and color information are often complementary, we propose a combined object re-detection approach using SIFT and MPEG-7 color descriptors extracted around the same interest points. We evaluate the approach on two different data sets and show that the MPEG-7 ColorLayout descriptor performs best of the tested color descriptors and that the joint approach yields better results than the use of SIFT or color descriptors only.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abdel-Hakim, A., Farag, A.A.: Colored local invariant features for object description. In: Proceedings of the International Conference on Graphics, Vision and Image Processing, pp. 100–106 (2005)
Annesley, J., Orwell, J., Renno, J.P.: Evaluation of MPEG-7 color descriptors for visual surveillance retrieval. In: 2nd Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation (October 2005)
Bailer, W., Schober, C., Thallinger, G.: Video content browsing based on iterative feature clustering for rushes exploitation. In: Proceedings of TRECVID Workshop November 2006, pp. 230–239, Gaithersburg, MD, USA (2006)
Carneiro, G., Lowe, D.G.: Sparse flexible models of local features. In: European Conference on Computer Vision, pp. 29–43, Graz, Austria (May 2006)
Diplaros, A., Gevers, T., Patras, I.: Combining color and shape information for illumination-viewpoint invariant object recognition. IEEE Transactions on Image Processing 15(1), 1–11 (2006)
Eklundh, J.-O., Björkman, M.: Recognition of objects in the real world from a systems perspective. Künstliche Intelligenz (KI), Special Issue on Cognitive Vision (April 2005)
Geusebroek, J.M., van den Boomgaard, R., Smeulders, A.W.M., Geerts, H.: Color invariance. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(12), 1338–1350 (2001)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Manjunath, B.S., Ohm, J.-R., Vasudevan, V.V., Yamada, A.: MPEG-7 color and texture descriptors. IEEE Trans. Circuits and Systems for Video Technology 11, 703–715 (2001)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(10), 1615–1630 (2005)
Moreels, P., Perona, P.: Evaluation of features detectors and descriptors based on 3D objects. In: IEEE Conference on Computer Vision and Pattern Recognition (2004)
Quelhas, P., Odobez, J.-M.: Natural scene image modeling using color and texture visterims. In: International Conference on Image and Video Retrieval (2006)
Schaffalitzky, F., Zisserman, A.: Automated scene matching in movies. Proceedings of the International Conference on Image and Video Retrieval, pp. 186–197. Springer-Verlag, Heidelberg (2002)
Schmid, C., Mohr, R.: Local greyvalue invariants for image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(5), 530–535 (1997)
Sivic, J., Zisserman, A.: Video google: A text retrieval approach to object matching in videos. In: IEEE International Conference on Computer Vision, vol. 2 (2003)
Sorschag, R.: Object recognition for media monitoring with emphasis on didactical purpose. Master’s thesis, Department for Information Technology, Alpen-Adria Universität Klagenfurt, Austria (2006)
van de Weijer, J., Schmid, C.: Coloring local feature extraction. In: Proceedings of the European Conference on Computer Vision, pp. 334–348 (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Schügerl, P., Sorschag, R., Bailer, W., Thallinger, G. (2007). Object Re-detection Using SIFT and MPEG-7 Color Descriptors. In: Sebe, N., Liu, Y., Zhuang, Y., Huang, T.S. (eds) Multimedia Content Analysis and Mining. MCAM 2007. Lecture Notes in Computer Science, vol 4577. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73417-8_38
Download citation
DOI: https://doi.org/10.1007/978-3-540-73417-8_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73416-1
Online ISBN: 978-3-540-73417-8
eBook Packages: Computer ScienceComputer Science (R0)