skip to main content
10.1145/1835449.1835583acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
poster

Multi-modal query expansion for web video search

Published: 19 July 2010 Publication History

Abstract

Query expansion is an effective method to improve the usability of multimedia search. Most existing multimedia search engines are able to automatically expand a list of textual query terms based on text search techniques, which can be called textual query expansion (TQE). However, the annotations (title and tag) around web videos are generally noisier for text-only query expansion and search matching. In this paper, we propose a novel multi-modal query expansion (MMQE) framework for web video search to solve the issue. Compared with traditional methods, MMQE provides a more intuitive query suggestion by transforming tex-tual query to visual presentation based on visual clustering. Paral-lel to this, MMQE can enhance the process of search matching with strong pertinence of intent-specific query by joining textual, visual and social cues from both metadata and content of videos. Experimental results on real web videos from YouTube demon-strate the effectiveness of the proposed method.

References

[1]
B. Frey, et al. Clustering by passing messages between data points, Science, 319(5814):726, 2007.
[2]
D.Y Zhou, et al. Ranking on data manifold, Proc. NIPS, 169--176, 2003.
[3]
D. Tjondronegoro, et al. Multimedia web searching on a meta-search engine, Proc. ADCS, 80--83, 2007.
[4]
J. Cao, et al. MCG-WEBV: A benchmark dataset for web video analysis, Technical report, ICT-MCG-09-001, 2009.
[5]
Z.J. Zha, et al. Visual query suggestion, Proc. MM, 15--24, 2008.

Cited By

View all
  • (2023)RbQE: An Efficient Method for Content-Based Medical Image Retrieval Based on Query ExpansionJournal of Digital Imaging10.1007/s10278-022-00769-736:3(1248-1261)Online publication date: 26-Jan-2023
  • (2020)Query Expansion Based on Top-Ranked Images for Content-Based Medical Image RetrievalIEEE Access10.1109/ACCESS.2020.30335048(194541-194550)Online publication date: 2020
  • (2018)Tracking topic evolution via salient keyword matching with consideration of semantic broadness for Web video discoveryMultimedia Tools and Applications10.1007/s11042-017-5404-477:16(20297-20324)Online publication date: 1-Aug-2018
  • Show More Cited By

Index Terms

  1. Multi-modal query expansion for web video search

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGIR '10: Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
    July 2010
    944 pages
    ISBN:9781450301534
    DOI:10.1145/1835449
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 July 2010

    Check for updates

    Author Tags

    1. query expansion
    2. web video search

    Qualifiers

    • Poster

    Conference

    SIGIR '10
    Sponsor:

    Acceptance Rates

    SIGIR '10 Paper Acceptance Rate 87 of 520 submissions, 17%;
    Overall Acceptance Rate 792 of 3,983 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)6
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)RbQE: An Efficient Method for Content-Based Medical Image Retrieval Based on Query ExpansionJournal of Digital Imaging10.1007/s10278-022-00769-736:3(1248-1261)Online publication date: 26-Jan-2023
    • (2020)Query Expansion Based on Top-Ranked Images for Content-Based Medical Image RetrievalIEEE Access10.1109/ACCESS.2020.30335048(194541-194550)Online publication date: 2020
    • (2018)Tracking topic evolution via salient keyword matching with consideration of semantic broadness for Web video discoveryMultimedia Tools and Applications10.1007/s11042-017-5404-477:16(20297-20324)Online publication date: 1-Aug-2018
    • (2017)Query Expansion for Content-Based Similarity Search Using Local and Global FeaturesACM Transactions on Multimedia Computing, Communications, and Applications10.1145/306359513:3(1-23)Online publication date: 31-May-2017
    • (2016)User Intent in Multimedia SearchACM Computing Surveys10.1145/295493049:2(1-37)Online publication date: 13-Aug-2016
    • (2016)Tracking hierarchical structure of web video groups based on salient keyword matching including semantic broadness estimation2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP)10.1109/GlobalSIP.2016.7906039(1238-1242)Online publication date: Dec-2016
    • (2014)SuMACC Project’s CorpusText, Speech and Dialogue10.1007/978-3-319-10816-2_4(29-36)Online publication date: 2014
    • (2012)Image retrieval method using visual query suggestion and relevance feedback2012 International Conference on Wireless Communications and Signal Processing (WCSP)10.1109/WCSP.2012.6542907(1-6)Online publication date: Oct-2012
    • (2012)Exploiting short query expansion for images retrieval2012 International Conference on Computer & Information Science (ICCIS)10.1109/ICCISci.2012.6297268(352-356)Online publication date: Jun-2012
    • (2010)Topic-based awareness computing model for video-sharing service2010 2nd International Symposium on Aware Computing10.1109/ISAC.2010.5670453(44-50)Online publication date: Nov-2010

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media