skip to main content
10.1145/1291233.1291295acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Segregated feedback with performance-based adaptive sampling for interactive news video retrieval

Published: 29 September 2007 Publication History

Abstract

Existing video research incorporates the use of relevance feedback based on user-dependent interpretations to improve the retrieval results. In this paper, we segregate the process of relevance feedback into 2 distinct facets: (a) recall-directed feedback; and (b) precision-directed feedback. The recall-directed facet employs general features such as text and high level features (HLFs) to maximize efficiency and recall during feedback, making it very suitable for large corpuses. The precision-directed facet on the other hand uses many other multimodal features in an active learning environment for improved accuracy. Combined with a performance-based adaptive sampling strategy, this process continuously re-ranks a subset of instances as the user annotates. Experiments done using TRECVID 2006 dataset show that our approach is efficient and effective.

References

[1]
R. Yong, T. S. Huang, M. M. Ortega, "Relevance feedback: a power tool for interactive content-based image retrieval," IEEE Trans on Circuits and Systems for Video Technology, 644--655, Sep 1998.
[2]
X. Zhou and T. S. Huang, "Small Sample Learning during Multimedia Retrieval using BiasMap," in IEEE Conference Computer Vision and Pattern Recognition, 2001.
[3]
T.-S. Chua, S.-Y. Neo, H.-K. Goh, M. Zhao, Y. Xiao, G. Wang, "TRECVID 2005 by NUS PRIS," TREC Video Retrieval Evaluation Online Proceedings, TRECVID 2005.
[4]
TRECVID, TREC Video Retrieval Evaluation, http://www.-nlpir.nist.gov/projects/trecvid.
[5]
A. G. Hauptmann, M.-Y. Chen, et al., "Multi-Lingual Broadcast News Retrieval," TREC Video Retrieval Evaluation Online Proceedings, TRECVID 2006.
[6]
C. G. M. Snoek, J. C. van Gemert, et al., "The MediaMill TRECVID 2006 semantic video search engine," TREC Video Retrieval Evaluation Online Proceedings, TRECVID 2006.
[7]
M. Campbell, S. Ebadollahi, et al., "IBM research TRECVID-2006 video retrieval system," TREC Video Retrieval Evaluation Online Proceedings, TRECVID 2006.
[8]
T.-S. Chua, S.-Y. Neo, Y. Zheng, H.-K. Goh, Y. Xiao, and M. Zhao, "TRECVID 2006 by NUS-I2R," TREC Video Retrieval Evaluation Online Proceedings, TRECVID 2006.
[9]
S.-Y. Neo, J., M. Kan, T.-S. Chua, "Video Retrieval Using High-level features: Exploiting Query-matching and Confidence-based Weighting," International Conference on Image and Video Retrieval, Arizona, USA, July 2006.
[10]
Robertson S. E. and Sparck Jones K., "Relevance Weighting of Search Terms," Journal of the American Society for Information Science, 27(3), 129--146, 1976.
[11]
E. Y. Chang, S. Tong, K.-S. Goh, and C.-W. Chang, "Support Vector Machine Concept-Dependent Active Learning for Image Retrieval," IEEE Transactions on Multimedia 2005.

Cited By

View all
  • (2013)Active Bucket Categorization for High Recall Video RetrievalIEEE Transactions on Multimedia10.1109/TMM.2013.223789415:4(898-907)Online publication date: 1-Jun-2013
  • (2012)Efficient targeted search using a focus and context video browserACM Transactions on Multimedia Computing, Communications, and Applications10.1145/2379790.23797938:4(1-19)Online publication date: 30-Nov-2012
  • (2012)A consumer video search system by audio-visual concept classification2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops10.1109/CVPRW.2012.6239341(39-44)Online publication date: Jun-2012
  • Show More Cited By

Index Terms

  1. Segregated feedback with performance-based adaptive sampling for interactive news video retrieval

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '07: Proceedings of the 15th ACM international conference on Multimedia
    September 2007
    1115 pages
    ISBN:9781595937025
    DOI:10.1145/1291233
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 September 2007

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. active learning
    2. news video retrieval
    3. relevance feedback

    Qualifiers

    • Article

    Conference

    MM07

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)1
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 30 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2013)Active Bucket Categorization for High Recall Video RetrievalIEEE Transactions on Multimedia10.1109/TMM.2013.223789415:4(898-907)Online publication date: 1-Jun-2013
    • (2012)Efficient targeted search using a focus and context video browserACM Transactions on Multimedia Computing, Communications, and Applications10.1145/2379790.23797938:4(1-19)Online publication date: 30-Nov-2012
    • (2012)A consumer video search system by audio-visual concept classification2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops10.1109/CVPRW.2012.6239341(39-44)Online publication date: Jun-2012
    • (2011)Size matters! how thumbnail number, size, and motion influence mobile video retrievalProceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II10.5555/1950054.1950082(230-240)Online publication date: 5-Jan-2011
    • (2011)Cross media hyperlinking for search topic browsingProceedings of the 19th ACM international conference on Multimedia10.1145/2072298.2072331(243-252)Online publication date: 28-Nov-2011
    • (2011)A Survey on Visual Content-Based Video Indexing and RetrievalIEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews10.1109/TSMCC.2011.210971041:6(797-819)Online publication date: 1-Nov-2011
    • (2011)VisionGoInformation Sciences: an International Journal10.1016/j.ins.2011.05.018181:19(4197-4213)Online publication date: 1-Oct-2011
    • (2011)Size Matters! How Thumbnail Number, Size, and Motion Influence Mobile Video RetrievalAdvances in Multimedia Modeling10.1007/978-3-642-17829-0_22(230-240)Online publication date: 2011
    • (2010)Browsing Video Along Multiple ThreadsIEEE Transactions on Multimedia10.1109/TMM.2009.203738812:2(121-130)Online publication date: 1-Feb-2010
    • (2009)Concept-Based Video RetrievalFoundations and Trends in Information Retrieval10.1561/15000000142:4(215-322)Online publication date: 1-Apr-2009
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media