demonstration

Interactive image search by 2D semantic map

Authors:

Hao Xu,

Jingdong Wang,

Xian-Sheng Hua,

Shipeng LiAuthors Info & Claims

WWW '10: Proceedings of the 19th international conference on World wide web

Pages 1321 - 1324

https://doi.org/10.1145/1772690.1772912

Published: 26 April 2010 Publication History

Get Access

Abstract

In this demo, we present a novel interactive image search system, image search by 2D semantic map. This system enables users to indicate what semantic concepts are expected to appear and even how these concepts are spatially distributed in the desired images. To this end, we design an intuitive interface for users to formulate a query in the form of 2D semantic map, called concept map, by typing textual queries in a blank canvas. In the ranking process, by interpreting each textual concept as a set of representative visual instances, the concept map query is translated into a visual instance map, which is then used for comparison with the images in the database. Besides, in this demo, we also show an image search system with a simplest semantic map, a 2D color map, where the concepts are limited from the colors.

References

[1]

J. Cui, F. Wen, and X. Tang. Intentsearch: interactive on-line image search re-ranking. In ACM Multimedia, pages 997--998, 2008.

Digital Library

Google Scholar

[2]

R. Datta, D. Joshi, J. Li, and J. Z. Wang. Image retrieval: Ideas, influences, and trends of the new age. ACM Comput. Surv., 40(2), 2008.

Digital Library

Google Scholar

[3]

B. J. Frey and D. Dueck. Clustering by passing messages between data points. Science, 315(5814):972, 2007.

Crossref

Google Scholar

[4]

R. Jain. Multimedia information retrieval: watershed events. In Multimedia Information Retrieval, pages 229--236, 2008.

Digital Library

Google Scholar

[5]

M. S. Lew, N. Sebe, C. Djeraba, and R. Jain. Content-based multimedia information retrieval: State of the art and challenges. TOMCCAP, 2(1):1--19, 2006.

Digital Library

Google Scholar

[6]

T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, and H.-Y. Shum. Learning to detect a salient object. IEEE Trans. Pattern Anal. Mach. Intell., to appear.

Digital Library

Google Scholar

[7]

Y. Luo, W. Liu, J. Liu, and X. Tang. Mqsearch: image search by multi-class query. In CHI, pages 49--52, 2008.

Digital Library

Google Scholar

[8]

G. P. Nguyen and M. Worring. Optimization of interactive visual-similarity-based search. TOMCCAP, 4(1), 2008.

Digital Library

Google Scholar

[9]

R. Yan, A. Natsev, and M. Campbell. Multi-query interactive image and video retrieval: theory and practice. In CIVR, pages 475--484, 2008.

Digital Library

Google Scholar

[10]

Z.-J. Zha, L. Yang, T. Mei, M. Wang, and Z. Wang. Visual query suggestion. In ACM Multimedia, pages 15--24, 2009.

Digital Library

Google Scholar

Cited By

View all

Mailthody VQureshi ZLiang WFeng Zde Gonzalo SLi YFranke HXiong JHuang JHwu W(2019)DeepStoreProceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture10.1145/3352460.3358320(224-238)Online publication date: 12-Oct-2019
https://dl.acm.org/doi/10.1145/3352460.3358320
Dey SDutta AGhosh SValveny ELladós JPal U(2019)Aligning Salient Objects to Queries: A Multi-modal and Multi-object Image Retrieval FrameworkComputer Vision – ACCV 201810.1007/978-3-030-20890-5_16(241-255)Online publication date: 2-Jun-2019
https://doi.org/10.1007/978-3-030-20890-5_16
Zhang YChen XLin LXia CZou D(2016)High-level representation sketch for video event retrievalScience China Information Sciences10.1007/s11432-015-5494-459:7Online publication date: 15-Jun-2016
https://doi.org/10.1007/s11432-015-5494-4
Show More Cited By

Index Terms

Interactive image search by 2D semantic map
1. Information systems
  1. Information retrieval
    1. Document representation

Recommendations

Image search by concept map
SIGIR '10: Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval

In this paper, we present a novel image search system, image search by concept map. This system enables users to indicate not only what semantic concepts are expected to appear but also how these concepts are spatially distributed in the desired images. ...
Interactive Image Search by Color Map

The availability of large-scale images from the Internet has made the research on image search attract a lot of attention. Text-based image search engines, for example, Google/Microsoft Bing/Yahoo! image search engines using the surrounding text, have ...
Kit-build concept map for automatic diagnosis
AIED'11: Proceedings of the 15th international conference on Artificial intelligence in education

In this paper, we describe a framework of Kit-Build Concept Map (we call it as KB map) that can diagnose. The task to make a concept map is divided into two sub-tasks: 1) "segmentation task" where parts of the concept map are extracted and 2) "...

Comments

Information & Contributors

Information

Published In

WWW '10: Proceedings of the 19th international conference on World wide web

April 2010

1407 pages

ISBN:9781605587998

DOI:10.1145/1772690

General Chairs:
Michael Rappa
North Carolina State University, USA
,
Paul Jones
University of North Carolina at Chapel Hill, USA
,
Program Chairs:
Juliana Freire
University of Utah, USA
,
Soumen Chakrabarti
Indian Institute of Technology, India

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

WWW '10

WWW '10: The 19th International World Wide Web Conference

April 26 - 30, 2010

North Carolina, Raleigh, USA

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
483
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Mailthody VQureshi ZLiang WFeng Zde Gonzalo SLi YFranke HXiong JHuang JHwu W(2019)DeepStoreProceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture10.1145/3352460.3358320(224-238)Online publication date: 12-Oct-2019
https://dl.acm.org/doi/10.1145/3352460.3358320
Dey SDutta AGhosh SValveny ELladós JPal U(2019)Aligning Salient Objects to Queries: A Multi-modal and Multi-object Image Retrieval FrameworkComputer Vision – ACCV 201810.1007/978-3-030-20890-5_16(241-255)Online publication date: 2-Jun-2019
https://doi.org/10.1007/978-3-030-20890-5_16
Zhang YChen XLin LXia CZou D(2016)High-level representation sketch for video event retrievalScience China Information Sciences10.1007/s11432-015-5494-459:7Online publication date: 15-Jun-2016
https://doi.org/10.1007/s11432-015-5494-4
Kajiyama T(2016)An improved botanical search application for middle- and high-school studentsEducation and Information Technologies10.1007/s10639-015-9421-521:6(1821-1836)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1007/s10639-015-9421-5
Cheng ZShen JMiao H(2016)The effects of multiple query evidences on social image retrievalMultimedia Systems10.1007/s00530-014-0432-722:4(509-523)Online publication date: 1-Jul-2016
https://dl.acm.org/doi/10.1007/s00530-014-0432-7
Qian XXue YYang XTang YHou XMei T(2015)Landmark Summarization With Diverse ViewpointsIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2014.236973125:11(1857-1869)Online publication date: Nov-2015
https://doi.org/10.1109/TCSVT.2014.2369731
Kajiyama TSatoh SKankanhalli MRueger SManmatha RJose Jvan Rijsbergen K(2014)An Application Search Interface Including Sense-related Search FacetsProceedings of International Conference on Multimedia Retrieval10.1145/2578726.2578794(463-466)Online publication date: 1-Apr-2014
https://dl.acm.org/doi/10.1145/2578726.2578794
Kajiyama THourcade JSawhney NReardon E(2013)An educational application for botanical study in science classes at elementary schoolsProceedings of the 12th International Conference on Interaction Design and Children10.1145/2485760.2485853(511-514)Online publication date: 24-Jun-2013
https://dl.acm.org/doi/10.1145/2485760.2485853
Wang PZhang DWang JWu ZHua XLi SBabaguchi NAizawa KSmith JSatoh SPlagemann THua XYan R(2012)Color filter for image searchProceedings of the 20th ACM international conference on Multimedia10.1145/2393347.2396467(1327-1328)Online publication date: 29-Oct-2012
https://dl.acm.org/doi/10.1145/2393347.2396467
Xue YQian X(2012)Visual summarization of landmarks via viewpoint modeling2012 19th IEEE International Conference on Image Processing10.1109/ICIP.2012.6467499(2873-2876)Online publication date: Sep-2012
https://doi.org/10.1109/ICIP.2012.6467499
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

EPUB

View this article in ePub.

ePub

Abstract

References

Cited By

Index Terms

Recommendations

Image search by concept map

Interactive Image Search by Color Map

Kit-build concept map for automatic diagnosis

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

EPUB

Share

Share this Publication link

Share on social media

Affiliations