skip to main content
10.1145/2510650.2510656acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

A non-parametric unsupervised approach for content based image retrieval and clustering

Published: 21 October 2013 Publication History

Abstract

Nowadays, there are available extremely large collections of images located on distributed and heterogeneous platforms over the web. The proliferation of billions of shared photos has outpaced the current technology for browsing such collections, but at the same time it spurred the emergence of new image retrieval techniques based not only on photos' visual information, but on geo-location tags and camera exif data. Although, additional image information may be proven very useful for preliminary image retrieval, the final retrieved result is necessary to be refined by exploiting visual information.
In this paper we present a process for refining image retrieval results by exploiting and fusing two unsupervised clustering techniques: DBSCAN and spectral clustering. DBSCAN algorithm is used to remove outliers from the initially retrieved image set, and spectral clustering finalizes retrieval process by clustering together visually similar images. However, DBSCAN and spectral clustering require manual tunning of their parameters, which usually requires a priori knowledge of the dataset. To overcome this problem we developed a tuning mechanism that automatically tunes the parameters of both algorithms. For the evaluation of the proposed approach we used thousands of images from Flickr downloaded using text queries for well known cultural heritage monuments.

References

[1]
S. Agarwal, N. Snavely, I. Simon, S. Seitz, and R. Szeliski. Building rome in a day. In 2009 IEEE 12th International Conference on Computer Vision, pages 72--79, 2009.
[2]
A. Arampatzis, K. Zagoris, and S. A. Chatzichristofis. Dynamic two-stage image retrieval from large multimedia databases. Information Processing & Management, 49(1):274--285, Jan. 2013.
[3]
Y. Avrithis, Y. Kalantidis, G. Tolias, and E. Spyrou. Retrieving landmark and non-landmark images from community photo collections. In Proceedings of the international conference on Multimedia, MM '10, pages 153--162, New York, NY, USA, 2010. ACM.
[4]
O. Chum, J. Philbin, J. Sivic, M. Isard, and A. Zisserman. Total recall: Automatic query expansion with a generative feature model for object retrieval. In IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007, pages 1--8, 2007.
[5]
M. Ester, H.-p. Kriegel, J. S, and X. Xu. A density-based algorithm for discovering clusters in large spatial databases with noise. pages 226--231. AAAI Press, 1996.
[6]
M. A. Fischler and R. C. Bolles. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM, 24(6):381--395, June 1981.
[7]
Y. Kalantidis, G. Tolias, Y. Avrithis, M. Phinikettos, E. Spyrou, P. Mylonas, and S. Kollias. VIRaL: visual image retrieval and localization. Multimedia Tools and Applications, 51(2):555--592, Jan. 2011.
[8]
D. H. B. Kekre, T. K. Sarode, S. D. Thepade, and V. Vaishali. Improved texture feature based image retrieval using kekre's fast codebook generation algorithm. In S. J. Pise, editor, Thinkquest 2010, pages 143--149. Springer India, Jan. 2011.
[9]
D. Lowe. Object recognition from local scale-invariant features. In The Proceedings of the Seventh IEEE International Conference on Computer Vision, 1999, volume 2, pages 1150--1157 vol.2, 1999.
[10]
D. G. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2):91--110, Nov. 2004.
[11]
U. v. Luxburg. A tutorial on spectral clustering. Statistics and Computing, 17(4):395--416, Dec. 2007.
[12]
R. Min and H. Cheng. Effective image retrieval using dominant color descriptor and fuzzy support vector machine. Pattern Recognition, 42(1):147--157, Jan. 2009.
[13]
V. S. V. S. Murthy, S. Kumar, and P. S. Rao. Content Based Image Retrieval using Hierarchical and K-Means Clustering Techniques, volume 2 of International Journal of Engineering Science and Technology (IJEST). 2010.
[14]
A. Y. Ng, M. I. Jordan, and Y. Weiss. On spectral clustering: Analysis and an algorithm. In ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS, pages 849--856. MIT Press, 2001.
[15]
J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman. Object retrieval with large vocabularies and fast spatial matching. In IEEE Conference on Computer Vision and Pattern Recognition, 2007. CVPR '07, pages 1--8, 2007.
[16]
I. Simon, N. Snavely, and S. Seitz. Scene summarization for online image collections. In IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007, pages 1--8, 2007.
[17]
C. Wu. Visualsfm: A visual structure from motion system. 2011.
[18]
C. Wu, S. Agarwal, B. Curless, and S. Seitz. Multicore bundle adjustment. In 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3057--3064, 2011.
[19]
C. Wu, S. Agarwal, B. Curless, and S. Seitz. Schematic surface reconstruction. In 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1498--1505, 2012.
[20]
C. Wu, J.-M. Frahm, and M. Pollefeys. Detecting large repetitive structures with salient boundaries. In K. Daniilidis, P. Maragos, and N. Paragios, editors, Computer Vision - ECCV 2010, number 6312 in Lecture Notes in Computer Science, pages 142--155. Springer Berlin Heidelberg, Jan. 2010.
[21]
C. Wu, J.-M. Frahm, and M. Pollefeys. Repetition-based dense single-view reconstruction. In 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3113--3120, 2011.
[22]
Y.-T. Zheng, M. Zhao, Y. Song, H. Adam, U. Buddemeier, A. Bissacco, F. Brucher, T.-S. Chua, and H. Neven. Tour the world: Building a web-scale landmark recognition engine. In IEEE Conference on Computer Vision and Pattern Recognition, 2009. CVPR 2009, pages 1085--1092, 2009.

Cited By

View all
  • (2018)4D Modelling in Cultural HeritageAdvances in Digital Cultural Heritage10.1007/978-3-319-75789-6_13(174-196)Online publication date: 16-Feb-2018
  • (2016)Applying Community Detection Methods to Cluster Tags in Multimedia Search Results2016 IEEE International Symposium on Multimedia (ISM)10.1109/ISM.2016.0106(467-474)Online publication date: Dec-2016
  • (2014)Semi-Supervised Image Meta-Filtering Using Relevance Feedback in Cultural Heritage ApplicationsInternational Journal of Heritage in the Digital Era10.1260/2047-4970.3.4.6133:4(613-627)Online publication date: 1-Dec-2014
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ARTEMIS '13: Proceedings of the 4th ACM/IEEE international workshop on Analysis and retrieval of tracked events and motion in imagery stream
October 2013
94 pages
ISBN:9781450323932
DOI:10.1145/2510650
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 October 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. dbscan
  2. image clustering
  3. image retrieval
  4. local descriptors
  5. spectral clustering

Qualifiers

  • Research-article

Conference

MM '13
Sponsor:
MM '13: ACM Multimedia Conference
October 21, 2013
Barcelona, Spain

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 23 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2018)4D Modelling in Cultural HeritageAdvances in Digital Cultural Heritage10.1007/978-3-319-75789-6_13(174-196)Online publication date: 16-Feb-2018
  • (2016)Applying Community Detection Methods to Cluster Tags in Multimedia Search Results2016 IEEE International Symposium on Multimedia (ISM)10.1109/ISM.2016.0106(467-474)Online publication date: Dec-2016
  • (2014)Semi-Supervised Image Meta-Filtering Using Relevance Feedback in Cultural Heritage ApplicationsInternational Journal of Heritage in the Digital Era10.1260/2047-4970.3.4.6133:4(613-627)Online publication date: 1-Dec-2014
  • (2014)Concept-based Image Clustering and Summarization of Event-related Image CollectionsProceedings of the 1st ACM International Workshop on Human Centered Event Understanding from Multimedia10.1145/2660505.2660507(23-28)Online publication date: 7-Nov-2014
  • (2014)Semi-supervised Image Meta-filtering in Cultural Heritage ApplicationsDigital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection10.1007/978-3-319-13695-0_10(102-110)Online publication date: 2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media