demonstration

Sketch-based image similarity search with a pen and paper interface

Authors:

SIGIR '12: Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval

Page 1014

https://doi.org/10.1145/2348283.2348439

Published: 12 August 2012 Publication History

Get Access

Abstract

We present a novel and innovative user interface for query-by-sketching based image retrieval that exploits emergent interactive paper and digital pen technology. Users can draw sketches with a digital pen on interactive paper in a user-friendly way. The pen is able to capture the stroke vectors and to interactively stream them to the underlying content-based image retrieval (CBIR) system via the pen's Bluetooth interface. We present the integration of interactive paper/digital pen technology with QbS, our CBIR system tailored to Query-by-Sketching, and we demonstrate the use of the paper and pen interface together with QbS for three different collections: MIRFLICKR-25K, a cartoon collection, and a collection of medieval paper watermarks.

References

[1]

R. Kreuzer, M. Springmann, I. A. Kabary, and H. Schuldt. An Interactive Paper and Digital Pen Interface for Query-by-Sketch Image Retrieval. In Proc. ECIR'12, pages 317--328, Barcelona, Spain, Apr. 2012.

Digital Library

Google Scholar

[2]

G. Kurtenbach. Pen-based Computing. ACM Crossroads, 16(4):14--20, 2010.

Digital Library

Google Scholar

Cited By

View all

Tian JXu XWang KCao ZCai XShen HAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)Structure-Aware Semantic-Aligned Network for Universal Cross-Domain RetrievalProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3532061(278-289)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3532061
Kabary IGiangreco ISchuldt HMatulic FNorrie M(2013)QUESTProceedings of the 2013 IEEE International Symposium on Multimedia10.1109/ISM.2013.84(433-438)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1109/ISM.2013.84
Kabary ISchuldt H(2013)Towards Sketch-Based Motion Queries in Sports VideosProceedings of the 2013 IEEE International Symposium on Multimedia10.1109/ISM.2013.60(309-314)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1109/ISM.2013.60

Index Terms

Sketch-based image similarity search with a pen and paper interface
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information retrieval

Recommendations

An interactive paper and digital pen interface for query-by-sketch image retrieval
ECIR'12: Proceedings of the 34th European conference on Advances in Information Retrieval

A major challenge when dealing with large collections of digital images is to find relevant objects, especially when no metadata on the objects is available. Content-based image retrieval (CBIR) addresses this problem but usually lacks query images that ...
Image retrieval based on indexing and relevance feedback

In content based image retrieval (CBIR) system, search engine retrieves the images similar to the query image according to a similarity measure. It should be fast enough and must have a high precision of retrieval. Indexing scheme is used to achieve a ...
Content-based sub-image retrieval using relevance feedback
MMDB '04: Proceedings of the 2nd ACM international workshop on Multimedia databases

This paper presents the use of relevance feedback to the problem of content-based sub-image retrieval (CBsIR). Relevance feedback is used to improve the accuracy of successive retrievals via a tile re-weighting scheme that assigns penalties to each tile ...

Comments

Information & Contributors

Information

Published In

SIGIR '12: Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval

August 2012

1236 pages

ISBN:9781450314725

DOI:10.1145/2348283

General Chair:
William Hersh
Oregon Health & Science University, USA
,
Program Chairs:
Jamie Callan
Carnegie Mellon University, USA
,
Yoelle Maarek
Yahoo! Research, Israel
,
Mark Sanderson
Royal Melbourne Institute of Technology, Australia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 August 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

SIGIR '12

Sponsor:

SIGIR

SIGIR '12: The 35th International ACM SIGIR conference on research and development in Information Retrieval

August 12 - 16, 2012

Oregon, Portland, USA

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
258
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Tian JXu XWang KCao ZCai XShen HAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)Structure-Aware Semantic-Aligned Network for Universal Cross-Domain RetrievalProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3532061(278-289)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3532061
Kabary IGiangreco ISchuldt HMatulic FNorrie M(2013)QUESTProceedings of the 2013 IEEE International Symposium on Multimedia10.1109/ISM.2013.84(433-438)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1109/ISM.2013.84
Kabary ISchuldt H(2013)Towards Sketch-Based Motion Queries in Sports VideosProceedings of the 2013 IEEE International Symposium on Multimedia10.1109/ISM.2013.60(309-314)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1109/ISM.2013.60

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

An interactive paper and digital pen interface for query-by-sketch image retrieval

Image retrieval based on indexing and relevance feedback

Content-based sub-image retrieval using relevance feedback

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations