skip to main content
10.1145/1386352.1386376acmconferencesArticle/Chapter ViewAbstractPublication PagescivrConference Proceedingsconference-collections
poster

A comparison of color features for visual concept classification

Published: 07 July 2008 Publication History

Abstract

Concept classification is important to access visual information on the level of objects and scene types. So far, intensity-based features have been widely used. To increase discriminative power, color features have been proposed only recently. As many features exist, a structured overview is required of color features in the context of concept classification.
Therefore, this paper studies 1. the invariance properties and 2. the distinctiveness of color features in a structured way. The invariance properties of color features with respect to photometric changes are summarized. The distinctiveness of color features is assessed experimentally using an image and a video benchmark: the PASCAL VOC Challenge 2007 and the Mediamill Challenge.
Because color features cannot be studied independently from the points at which they are extracted, different point sampling strategies based on Harris-Laplace salient points, dense sampling and the spatial pyramid are also studied.
From the experimental results, it can be derived that invariance to light intensity changes and light color changes affects concept classification. The results reveal further that the usefulness of invariance is concept-specific.

References

[1]
A. Bosch, A. Zisserman, and X. Munoz. Representing shape with a spatial pyramid kernel. In Proceedings of the ACM International Conference on Image and Video Retrieval, pages 401--408, Amsterdam, The Netherlands, 2007.
[2]
C.-C. Chang and C.-J. Lin. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
[3]
S.-F. Chang, D. Ellis, W. Jiang, K. Lee, A. Yanagawa, A. C. Loui, and J. Luo. Large-Scale Multimodal Semantic Concept Detection for Consumer Video. In Proceedings of the ACM SIGMM International Workshop on Multimedia Information Retrieval, pages 255--264, Augsburg, Germany, 2007.
[4]
M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results. http://www.pascal-network.org/challenges/VOC/voc2007/.
[5]
L. Fei-Fei and P. Perona. A bayesian hierarchical model for learning natural scene categories. In IEEE Conference on Computer Vision and Pattern Recognition, volume 2, pages 524--531, San Diego, USA, 2005.
[6]
R. Fergus, P. Perona, and A. Zisserman. Object class recognition by unsupervised scale-invariant learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, volume 2, pages 264--271, 2003.
[7]
J. M. Geusebroek, R. van den Boomgaard, A. W. M. Smeulders, and H. Geerts. Color invariance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(12):1338--1350, 2001.
[8]
G. Griffin, A. Holub, and P. Perona. Caltech-256 object category dataset. Technical Report 7694, California Institute of Technology, 2007.
[9]
Y.-G. Jiang, C.-W. Ngo, and J. Yang. Towards optimal bag-of-features for object categorization and semantic video retrieval. In Proceedings of the ACM International Conference on Image and Video Retrieval, pages 494--501, Amsterdam, The Netherlands, 2007.
[10]
F. Jurie and B. Triggs. Creating efficient codebooks for visual recognition. In IEEE International Conference on Computer Vision, pages 604--610, Beijing, China, 2005.
[11]
J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(3):226--239, 1998.
[12]
S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In IEEE Conference on Computer Vision and Pattern Recognition, volume 2, pages 2169--2178, New York, USA, 2006.
[13]
B. Leibe and B. Schiele. Interleaved object categorization and segmentation. In British Machine Vision Conference, pages 759--768, Norwich, UK, 2003.
[14]
T. K. Leung and J. Malik. Representing and recognizing the visual appearance of materials using three-dimensional textons. International Journal of Computer Vision, 43(1):29--44, 2001.
[15]
D. G. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2):91--110, 2004.
[16]
R. Marée, P. Geurts, J. Piater, and L. Wehenkel. Random subwindows for robust image classification. In IEEE Conference on Computer Vision and Pattern Recognition, volume 1, pages 34--40, San Diego, USA, 2005.
[17]
M. Marszalek, C. Schmid, H. Harzallah, and J. van de Weijer. Learning object representations for visual object class recognition, 2007. Visual Recognition Challenge workshop, in conjunction with IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil.
[18]
K. Mikolajczyk and C. Schmid. A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(10):1615--1630, 2005.
[19]
K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. Van Gool. A comparison of affine region detectors. International Journal of Computer Vision, 65(1-2):43--72, 2005.
[20]
F. Mindru, T. Tuytelaars, L. Van Gool, and T. Moons. Moment invariants for recognition under changing viewpoint and illumination. Computer Vision and Image Understanding, 94(1-3):3--27, 2004.
[21]
M. Naphade, J. R. Smith, J. Tesic, S.-F. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis. Large-scale concept ontology for multimedia. IEEE MultiMedia, 13(3):86--91, 2006.
[22]
E. Nowak, F. Jurie, and B. Triggs. Sampling strategies for bag-of-features image classification. In IEEE European Conference on Computer Vision, volume 4, pages 490--503, Graz, Austria, 2006.
[23]
J. Sivic and A. Zisserman. Video google: A text retrieval approach to object matching in videos. In IEEE International Conference on Computer Vision, pages 1470--1477, Nice, France, 2003.
[24]
A. F. Smeaton, P. Over, and W. Kraaij. Evaluation campaigns and trecvid. In Proceedings of the ACM SIGMM International Workshop on Multimedia Information Retrieval, pages 321--330, Santa Barbara, USA, 2006.
[25]
C. G. M. Snoek, M. Worring, J. C. van Gemert, J.-M. Geusebroek, and A. W. M. Smeulders. The challenge problem for automated detection of 101 semantic concepts in multimedia. In Proceedings of the ACM International Conference on Multimedia, pages 421--430, Santa Barbara, USA, 2006.
[26]
K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek. Evaluation of color descriptors for object and scene recognition. In IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, 2008.
[27]
J. van de Weijer, T. Gevers, and A. Bagdanov. Boosting color saliency in image feature detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(1):150--156, 2006.
[28]
D. Wang, X. Liu, L. Luo, J. Li, and B. Zhang. Video diver: generic video indexing with diverse features. In Proceedings of the ACM SIGMM International Workshop on Multimedia Information Retrieval, pages 61--70, Augsburg, Germany, 2007.
[29]
A. Yanagawa, S.-F. Chang, L. Kennedy, and W. Hsu. Columbia university's baseline detectors for 374 lscom semantic visual concepts. Technical Report 222-2006-8, Columbia University, 2007.
[30]
J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid. Local features and kernels for classification of texture and object categories: A comprehensive study. International Journal of Computer Vision, 73(2):213--238, 2007.

Cited By

View all
  • (2023)CC: Causality-Aware Coverage Criterion for Deep Neural NetworksProceedings of the 45th International Conference on Software Engineering10.1109/ICSE48619.2023.00153(1788-1800)Online publication date: 14-May-2023
  • (2022)Unveiling Hidden DNN Defects with Decision-Based Metamorphic TestingProceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering10.1145/3551349.3561157(1-13)Online publication date: 10-Oct-2022
  • (2019)A Color Moments-Based System for Recognition of Emotions Induced by Color Images2019 International Conference on Image and Vision Computing New Zealand (IVCNZ)10.1109/IVCNZ48456.2019.8961020(1-6)Online publication date: Dec-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIVR '08: Proceedings of the 2008 international conference on Content-based image and video retrieval
July 2008
674 pages
ISBN:9781605580708
DOI:10.1145/1386352
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. bag-of-features
  2. color
  3. concept classification
  4. invariance
  5. object and video retrieval
  6. spatial pyramid

Qualifiers

  • Poster

Conference

CIVR08

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)1
Reflects downloads up to 01 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)CC: Causality-Aware Coverage Criterion for Deep Neural NetworksProceedings of the 45th International Conference on Software Engineering10.1109/ICSE48619.2023.00153(1788-1800)Online publication date: 14-May-2023
  • (2022)Unveiling Hidden DNN Defects with Decision-Based Metamorphic TestingProceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering10.1145/3551349.3561157(1-13)Online publication date: 10-Oct-2022
  • (2019)A Color Moments-Based System for Recognition of Emotions Induced by Color Images2019 International Conference on Image and Vision Computing New Zealand (IVCNZ)10.1109/IVCNZ48456.2019.8961020(1-6)Online publication date: Dec-2019
  • (2018)Using semantic context for multiple concepts detection in still imagesPattern Analysis and Applications10.1007/s10044-018-0761-9Online publication date: 2-Nov-2018
  • (2017)Higher-Order Occurrence Pooling for Bags-of-WordsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2016.254566739:2(313-326)Online publication date: 1-Feb-2017
  • (2017)Bag-of-features based classification of dermoscopic images2017 4th International Conference on Opto-Electronics and Applied Optics (Optronix)10.1109/OPTRONIX.2017.8349977(1-6)Online publication date: Nov-2017
  • (2017)Saliency and KAZE features assisted object segmentationImage and Vision Computing10.1016/j.imavis.2017.02.00861:C(82-97)Online publication date: 1-May-2017
  • (2017)Fast aircraft detection using cascaded discriminative model in photoelectric sensing systemOptical Review10.1007/s10043-017-0334-y24:3(383-397)Online publication date: 22-Apr-2017
  • (2017)Fusion of Bag-of-Words Models for Image Classification in the Medical DomainAdvances in Information Retrieval10.1007/978-3-319-56608-5_11(134-145)Online publication date: 8-Apr-2017
  • (2015)Bag of frequent subgraphs approach for image classificationIntelligent Data Analysis10.5555/3184222.318422819:1(75-88)Online publication date: 1-Jan-2015
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media