skip to main content
10.1145/1180639.1180659acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Building concept ontology for medical video annotation

Published: 23 October 2006 Publication History

Abstract

Most existing systems for content-based video retrieval (CBVR) are now amenable to support automatic low-level video content analysis and feature extraction, but they have limited effectiveness from a user's perspective. To support semantic video retrieval via keywords, we have proposed a novel framework by incorporating the concept ontology to enable more effective modeling and representation of semantic video concepts. Specifically, this novel framework includes: (a) Using the salient objects to achieve a middle-level understanding of the semantics of video contents; (b) Building a domain dependent concept ontology to enable multi-level modeling and representation of semantic video concepts; (c) Developing a multi-task boosting technique to achieve hierarchical video classifier training for automatic multi-level video annotation. The experimental results in a certain domain of medical education videos are also provided.

References

[1]
W. H. Adams, G. Iyengar, C., Y. Lin, M.R. Naphade, C. Neti, H. J. Nock, and J. R. Smith. Semantic indexing of multimedia content using visual, audio and text cues. EURASIP JASP, 2:170--185, 2003.
[2]
A. B. Benitez, J. R. Smith, S., and F. Chang. Medianet: A multimedia information network for knowledge representation. Proc. SPIE, 4210, 2000.
[3]
A. Jaimes et. al. Modal keywords, ontologies, and reasoning for video understanding. CIVR, 2003.
[4]
J. Fan, H. Luo, and A. K. Elmagarmid. Concept-oriented indexing of video databases: towards semantic sensitive retrieval and browsing. IEEE Trans. on Image Processing, 13:974--992, 2004.
[5]
A. Hauptmann. Machine learning for video classification and retrieval. ECML, 2003.
[6]
L. Holink, M. Worring, and A. Th. Schreiber. Building a visual ontology for video retrieval. ACM Multimedia, 2005.
[7]
J. Hunter. Enhancing the semantic interoperability of multimedia through a core ontology.
[8]
J. R. Smith and S. F. Chang. Visually searching the web for content. IEEE Multimedia, 1997.
[9]
A. Torralba, K. Murphy, and W. Freeman. Sharing features: efficient boosting procedures for multiclass object detection. CVPR, 2004.

Cited By

View all

Index Terms

  1. Building concept ontology for medical video annotation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '06: Proceedings of the 14th ACM international conference on Multimedia
    October 2006
    1072 pages
    ISBN:1595934472
    DOI:10.1145/1180639
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 October 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. concept ontology
    2. hierarchical video classification
    3. multi-task boosting

    Qualifiers

    • Article

    Conference

    MM06
    MM06: The 14th ACM International Conference on Multimedia 2006
    October 23 - 27, 2006
    CA, Santa Barbara, USA

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)1
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 24 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2019)Boosting for transfer learning from multiple data sourcesPattern Recognition Letters10.1016/j.patrec.2011.11.02333:5(568-579)Online publication date: 6-Jan-2019
    • (2019)A novel learning approach to multiple tasks based on boosting methodologyPattern Recognition Letters10.1016/j.patrec.2010.05.01931:12(1693-1700)Online publication date: 6-Jan-2019
    • (2018)A comprehensive representation scheme for video semantic ontology and its applications in semantic concept detectionNeurocomputing10.1016/j.neucom.2011.05.04495(29-39)Online publication date: 31-Dec-2018
    • (2018)Personalized video similarity measureMultimedia Systems10.1007/s00530-010-0223-817:5(421-433)Online publication date: 26-Dec-2018
    • (2014)Semantic Concept Annotation of Consumer Videos at Frame-Level Using AudioProceedings of the 15th Pacific-Rim Conference on Advances in Multimedia Information Processing --- PCM 2014 - Volume 887910.1007/978-3-319-13168-9_12(113-122)Online publication date: 1-Dec-2014
    • (2013)Annotation of endoscopic videos on mobile devicesProceedings of the 4th ACM Multimedia Systems Conference10.1145/2483977.2483996(141-145)Online publication date: 28-Feb-2013
    • (2010)SARACEN: A platform for adaptive, socially aware multimedia distribution over P2P networks2010 IEEE Globecom Workshops10.1109/GLOCOMW.2010.5700159(1356-1360)Online publication date: Dec-2010
    • (2009)On the Influence of Region Mismatch at Training and Testing in Region-Related Concept DetectionProceedings of the 2009 International Conference on Computational Intelligence and Natural Computing - Volume 0110.1109/CINC.2009.42(42-46)Online publication date: 6-Jun-2009
    • (2009)Video Annotation System Based on Categorizing and Keyword LabellingProceedings of the 14th International Conference on Database Systems for Advanced Applications10.1007/978-3-642-00887-0_68(764-767)Online publication date: 16-Mar-2009
    • (2008)Selection of Concept Detectors for Video Search by Ontology-Enriched Semantic SpacesIEEE Transactions on Multimedia10.1109/TMM.2008.200138210:6(1085-1096)Online publication date: 1-Oct-2008
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media