skip to main content
10.1145/1743384.1743456acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
demonstration

QbS: searching for known images using user-drawn sketches

Published: 29 March 2010 Publication History

Abstract

With the increasingly growing size of digital image collections, known image search is gaining more and more importance. Especially when the objects in such collections do not possess appropriate metadata (e.g., tags, annotations), content-based image retrieval (CBIR) is a promising approach. However, the application of CBIR to known item search usually suffers from the unavailability of query images that are good enough to express the user's information need.
In order to improve this situation, we propose the QbS system which provides an approach to content-based search in large image collections based on user-drawn sketches. By exploiting novel devices for human-computer interaction like interactive paper, tablet PCs, or graphic tablets, users are able to draw a sketch that reflects their information need and start a content-based search using this sketch. The QbS system provides query support and offers several invariances that allow the user-generated sketch to slightly deviate from the searched image in terms of rotation, translation, relative size, and/or unknown objects in the background. To illustrate the benefits of the approach, we show search results from the evaluation of QbS on the basis of the MIRFLICKR collection with 25'000 objects.

References

[1]
S. Berretti, A. Del Bimbo, and P. Pala. Retrieval by Shape Similarity with Perceptual Distance and Effective Indexing. IEEE Transactions on Multimedia, 2(4):225--239, 2000.
[2]
K. Bischoff, C. S. Firan, W. Nejdl, and R. Paiu. Can all Tags be used for Search? In CIKM'08, pages 193--202, 2008.
[3]
A. Chalechale, A. Mertins, and G. Naghdy. Edge Image Description using Angular Radial Partitioning. IEE Proc. on Vision, Image & Signal Processing, 151(2):93--101, 2004.
[4]
M. Eitz, K. Hildebrand, T. Boubekeur, and M. Alexa. PhotoSketch: A Sketch based Image Query and Compositing System. In SIGGRAPH, 2009.
[5]
M. Flickner et al. Query by Image and Video Content: The QBIC System. Computer, 28(9):23--32, 1995.
[6]
K. Hirata and T. Kato. Query by visual example. Advances in Database Technology EDBT, 92:56--71, 1992.
[7]
M. J. Huiskes and M. S. Lew. The MIR Flickr Retrieval Evaluation. In Proc. MIR'08, 2008.
[8]
M. C. Norrie, B. Signer, and N. Weibel. General Framework for the Rapid Development of Interactive Paper Applications. In Proc. CoPADD'06, pages 9--12, 2006.
[9]
M. Springmann, A. Dander, and H. Schuldt. Improving Efficiency and Effectiveness of the Image Distortion Model. Pattern Recognition Letters, 29(15):2018--2024, 2008.
[10]
M. Springmann, A. Ispas, H. Schuldt, M. C. Norrie, and B. Signer. Towards Query by Sketch. In Proc. of the 2nd Int'l DELOS Conference, 2007.
[11]
L. von Ahn and L. Dabbish. Labeling Images with a Computer Game. In Proc. SIGCHI, pages 319--326, 2004.
[12]
R. Weber, H.-J. Schek, and S. Blott. A Quantitative Analysis and Performance Study for Similarity-Search Methods in High-Dimensional Spaces. In VLDB, 1998.
[13]
H. I. Xie. Planned and Situated Aspects in Interactive IR: Patterns of User Interactive Intentions and Information Seeking Strategies. In Proc. ASIS, pages 101--110, 1997.

Cited By

View all
  • (2016)Design of Sketch-Based Image Search UI for Finger Gesture2016 10th International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS)10.1109/CISIS.2016.140(516-521)Online publication date: Jul-2016
  • (2016)A Sketch-Based User Interface for Image Search Using Sample PhotosHuman Interface and the Management of Information: Information, Design and Interaction10.1007/978-3-319-40349-6_34(361-370)Online publication date: 21-Jun-2016
  • (2014)CineastProceedings of the 2014 IEEE International Symposium on Multimedia10.1109/ISM.2014.38(18-23)Online publication date: 10-Dec-2014
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MIR '10: Proceedings of the international conference on Multimedia information retrieval
March 2010
600 pages
ISBN:9781605588155
DOI:10.1145/1743384
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 March 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. content-based image retrieval
  2. known item search
  3. query by sketch

Qualifiers

  • Demonstration

Conference

MIR '10
Sponsor:
MIR '10: International Conference on Multimedia Information Retrieval
March 29 - 31, 2010
Pennsylvania, Philadelphia, USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 21 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2016)Design of Sketch-Based Image Search UI for Finger Gesture2016 10th International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS)10.1109/CISIS.2016.140(516-521)Online publication date: Jul-2016
  • (2016)A Sketch-Based User Interface for Image Search Using Sample PhotosHuman Interface and the Management of Information: Information, Design and Interaction10.1007/978-3-319-40349-6_34(361-370)Online publication date: 21-Jun-2016
  • (2014)CineastProceedings of the 2014 IEEE International Symposium on Multimedia10.1109/ISM.2014.38(18-23)Online publication date: 10-Dec-2014
  • (2014)SKETCHify – An Adaptive Prominent Edge Detection Algorithm for Optimized Query-by-Sketch Image RetrievalAdaptive Multimedia Retrieval: Semantics, Context, and Adaptation10.1007/978-3-319-12093-5_14(231-247)Online publication date: 29-Oct-2014
  • (2011)Query by sketch: An asymmetric sketch-vs-image retrieval system2011 4th International Congress on Image and Signal Processing10.1109/CISP.2011.6100457(1368-1372)Online publication date: Oct-2011
  • (2010)Image retrieval at memory's edgeProceedings of the 19th ACM international conference on Information and knowledge management10.1145/1871437.1871648(1465-1468)Online publication date: 26-Oct-2010

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media