short-paper

Knowledge propagation in large image databases using neighborhood information

Authors:

Michael E. Houle,

Vincent Oria,

Shin'ichi Satoh,

Jichao SunAuthors Info & Claims

MM '11: Proceedings of the 19th ACM international conference on Multimedia

Pages 1033 - 1036

https://doi.org/10.1145/2072298.2071931

Published: 28 November 2011 Publication History

Get Access

Abstract

The aim of this paper is to reduce to a minimum the level of human intervention in the semantic annotation process of images. Ideally, only one copy of each object of interest would be labeled manually, and the labels would then be propagated automatically to all other occurrences of the objects in the database. To that end, we propose a neighbor-based influence propagation approach KProp which builds a voting model and propagates the knowledge associated to some objects to similar objects. We show that KProp can perform efficiently through matrix computations and achieve better performance with fewer labeled examples per object.

References

[1]

N. Boujemaa, J. Fauqueur, M. Ferecatu, F. Fleuret, V. Gouet, B. L. Saux, and H. Sahbi. IKONA: Interactive Generic and Specific Image Retrieval. In International workshop on Multimedia Content-Based Indexing and Retrieval (MMCBIR'01), September 2001.

Google Scholar

[2]

L. Cao, A. Del Pozo, X. Jin, J. Luo, J. Han, and T. S. Huang. Rankcompete: simultaneous ranking and clustering of web photos. In Proceedings of the 19th international conference on World Wide Web, pages 1071--1072, 2010.

Digital Library

Google Scholar

[3]

C. Cusano, G. Ciocca, and R. Schettini. Image annotation using SVM. In Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, volume 5304, pages 330--338, December 2003.

Google Scholar

[4]

M. Everingham, J. Sivic, and A. Zisserman. "Hello! My name is... Buffy" -- automatic naming of characters in TV video. In Proceedings of the British Machine Vision Conference, 2006.

Crossref

Google Scholar

[5]

J.-M. Geusebroek, G. J. Burghouts, and A. W. M. Smeulders. The amsterdam library of object images. International Journal of Computer Vision, 61(1):103--112, January 2005.

Digital Library

Google Scholar

[6]

D. R. Hardoon, C. Saunders, S. Szedmák, and J. Shawe-Taylor. A correlation approach for automatic image annotation. In Advanced Data Mining and Applications, pages 681--692, 2006.

Digital Library

Google Scholar

[7]

G. Jeh and J. Widom. Simrank: a measure of structural-context similarity. In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 538--543, 2002.

Digital Library

Google Scholar

[8]

A. Makadia, V. Pavlovic, and S. Kumar. A new baseline for image annotation. In Proceedings of the 10th European Conference on Computer Vision: Part III, pages 316--329, 2008.

Digital Library

Google Scholar

[9]

S. Melacci and M. Belkin. Laplacian Support Vector Machines Trained in the Primal. Journal of Machine Learning Research, 12:1149--1184, March 2011.

Crossref

Google Scholar

[10]

L. Page, S. Brin, R. Motwani, and T. Winograd. The pagerank citation ranking: Bringing order to the web. Technical Report 1999--66, Stanford InfoLab, November 1999.

Google Scholar

[11]

R. Shi, C.-H. Lee, and T.-S. Chua. Enhancing image annotation by integrating concept ontology and text-based bayesian learning model. In Proceedings of the 15th international conference on Multimedia, pages 341--344, 2007.

Digital Library

Google Scholar

[12]

B. Sigurbjörnsson and R. van Zwol. Flickr tag recommendation based on collective knowledge. In Proceeding of the 17th international conference on World Wide Web, pages 327--336, 2008.

Digital Library

Google Scholar

Cited By

View all

Liang YHuang DWang CYu P(2024)Multi-View Graph Learning by Joint Modeling of Consistency and InconsistencyIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2022.319244535:2(2848-2862)Online publication date: Feb-2024
https://doi.org/10.1109/TNNLS.2022.3192445
Houle MOria VWali A(2017)Improving k-NN Graph Accuracy Using Local Intrinsic DimensionalitySimilarity Search and Applications10.1007/978-3-319-68474-1_8(110-124)Online publication date: 28-Sep-2017
https://doi.org/10.1007/978-3-319-68474-1_8
Houle MMa XOria VSun JKankanhalli MRueger SManmatha RJose Jvan Rijsbergen K(2014)Improving the Quality of K-NN Graphs for Image Databases through Vector SparsificationProceedings of International Conference on Multimedia Retrieval10.1145/2578726.2578730(89-96)Online publication date: 1-Apr-2014
https://dl.acm.org/doi/10.1145/2578726.2578730
Show More Cited By

Index Terms

Knowledge propagation in large image databases using neighborhood information
1. Information systems
  1. Information systems applications
    1. Multimedia information systems
      1. Multimedia databases

Recommendations

Annotation propagation in image databases using similarity graphs

The practicality of large-scale image indexing and querying methods depends crucially upon the availability of semantic information. The manual tagging of images with semantic information is in general very labor intensive, and existing methods for ...
Efficient large-scale image annotation by probabilistic collaborative multi-label propagation
MM '10: Proceedings of the 18th ACM international conference on Multimedia

Annotating large-scale image corpus requires huge amount of human efforts and is thus generally unaffordable, which directly motivates recent development of semi-supervised or active annotation methods. In this paper we revisit this notoriously ...
Automatic image annotation using semi-supervised generative modeling

Image annotation approaches need an annotated dataset to learn a model for the relation between images and words. Unfortunately, preparing a labeled dataset is highly time consuming and expensive. In this work, we describe the development of an ...

Comments

Information & Contributors

Information

Published In

MM '11: Proceedings of the 19th ACM international conference on Multimedia

November 2011

944 pages

ISBN:9781450306164

DOI:10.1145/2072298

General Chairs:
K. Selçuk Candan
Arizona State University, USA
,
Sethuraman Panchanathan
Arizona State University, USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA
,
Program Chairs:
Hari Sundaram
Arizona State University, USA
,
Wu-Chi Feng
Portland State University, USA
,
Nicu Sebe
University of Trento, Italy

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM '11

Sponsor:

SIGMM

MM '11: ACM Multimedia Conference

November 28 - December 1, 2011

Arizona, Scottsdale, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
205
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Liang YHuang DWang CYu P(2024)Multi-View Graph Learning by Joint Modeling of Consistency and InconsistencyIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2022.319244535:2(2848-2862)Online publication date: Feb-2024
https://doi.org/10.1109/TNNLS.2022.3192445
Houle MOria VWali A(2017)Improving k-NN Graph Accuracy Using Local Intrinsic DimensionalitySimilarity Search and Applications10.1007/978-3-319-68474-1_8(110-124)Online publication date: 28-Sep-2017
https://doi.org/10.1007/978-3-319-68474-1_8
Houle MMa XOria VSun JKankanhalli MRueger SManmatha RJose Jvan Rijsbergen K(2014)Improving the Quality of K-NN Graphs for Image Databases through Vector SparsificationProceedings of International Conference on Multimedia Retrieval10.1145/2578726.2578730(89-96)Online publication date: 1-Apr-2014
https://dl.acm.org/doi/10.1145/2578726.2578730
Houle MMa XOria VSun J(2014)Improving the quality of K-NN graphs through vector sparsification: application to image databasesInternational Journal of Multimedia Information Retrieval10.1007/s13735-014-0067-73:4(259-274)Online publication date: 21-Sep-2014
https://doi.org/10.1007/s13735-014-0067-7
Houle MOria VSatoh SSun J(2013)Annotation propagation in image databases using similarity graphsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/248773610:1(1-21)Online publication date: 27-Dec-2013
https://dl.acm.org/doi/10.1145/2487736
Fesnin AGouet-Brunet VKominen SOria VSun JCandan KPanchanathan SPrabhakaran BSundaram HFeng WSebe N(2011)Towards a privacy preserving personal photo album manager with semantic classification, indexing and querying capabilitiesProceedings of the 19th ACM international conference on Multimedia10.1145/2072298.2072483(835-836)Online publication date: 28-Nov-2011
https://dl.acm.org/doi/10.1145/2072298.2072483

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Annotation propagation in image databases using similarity graphs

Efficient large-scale image annotation by probabilistic collaborative multi-label propagation

Automatic image annotation using semi-supervised generative modeling

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations