Welcome to the InfoSci Platform
Reference Hub2
Multimodal Information Fusion for Semantic Video Analysis

Multimodal Information Fusion for Semantic Video Analysis

Elvan Gulen, Turgay Yilmaz, Adnan Yazici
Copyright: © 2012 |Volume: 3 |Issue: 4 |Pages: 23
ISSN: 1947-8534|EISSN: 1947-8542|EISBN13: 9781466613607|DOI: 10.4018/jmdem.2012100103
Cite Article Cite Article

MLA

Gulen, Elvan, et al. "Multimodal Information Fusion for Semantic Video Analysis." IJMDEM vol.3, no.4 2012: pp.52-74. http://doi.org/10.4018/jmdem.2012100103

APA

Gulen, E., Yilmaz, T., & Yazici, A. (2012). Multimodal Information Fusion for Semantic Video Analysis. International Journal of Multimedia Data Engineering and Management (IJMDEM), 3(4), 52-74. http://doi.org/10.4018/jmdem.2012100103

Chicago

Gulen, Elvan, Turgay Yilmaz, and Adnan Yazici. "Multimodal Information Fusion for Semantic Video Analysis," International Journal of Multimedia Data Engineering and Management (IJMDEM) 3, no.4: 52-74. http://doi.org/10.4018/jmdem.2012100103

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

Multimedia data by its very nature contains multimodal information in it. For a successful analysis of multimedia content, all available multimodal information should be utilized. Additionally, since concepts can contain valuable cues about other concepts, concept interaction is a crucial source of multimedia information and helps to increase the fusion performance. The aim of this study is to show that integrating existing modalities along with the concept interactions can yield a better performance in detecting semantic concepts. Therefore, in this paper, the authors present a multimodal fusion approach that integrates semantic information obtained from various modalities along with additional semantic cues. The experiments conducted on TRECVID 2007 and CCV Database datasets validates the superiority of such combination over best single modality and alternative modality combinations. The results show that the proposed fusion approach provides 16.7% relative performance gain on TRECVID dataset and 47.7% relative performance improvement on CCV database over the results of best unimodal approaches.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.