Nikolaos Gkalelis
Ioannis Kompatsiaris
ABSTRACT
In this paper a joint content-event model for the automatic indexing of multimedia content with events is proposed. This model treats events as first class entities and provides a referencing mechanism for automatically linking event elements (represented using the event part of the model) with content segments (described using the content part of the model). The emphasis of the paper is on this mechanism, which uses trained concept detectors to represent content segments with model vectors, and the subclass discriminant analysis algorithm to derive a discriminant subspace facilitating the indexing of content segments with event elements. The use of this referencing mechanism for associating multimedia content with five sport events is demonstrated on the MediaMill dataset.
- Basic geo (wgs84 lat/long) vocabulary. http://www.w3.org/2003/01/geo/, accessed 2010-04-07.Google Scholar
- Date and time formats. http://www.w3.org/TR/NOTE-datetime, accessed 2010-04-07.Google Scholar
- International Press Telecommunications Council. http://www.iptc.org, accessed 2010-04-07.Google Scholar
- J. F. Allen. Maintaining knowledge about temporal intervals. Communications of the ACM, 26(11):832--843, Nov. 1983. Google ScholarDigital Library
- P. K. Atrey. A hierarchical model for representation of events in multimedia observation systems. In Proc. 1st ACM Int. Workshop on Events in Multimedia (EiMM '09), pages 57--64, Oct. 2009. Google ScholarDigital Library
- L. Ballan, M. Bertini, A. D. Bimbo, and G. Serra. Video event classification using string kernels. Multimedia Tools Appl., 48(1):69--87, May 2010. Google ScholarDigital Library
- W.-H. Cheng, Y. Chuang, B.-Y. Chen et. al. Semantic-event based analysis and segmentation of wedding ceremony videos. In Proc. Int. Workshop on Multimedia Information Retrieval (MIR'07), pages 95--104, Sept. 2007. Google ScholarDigital Library
- R. Duda, P. Hart, and D. Stork. Pattern Classification, (2nd ed.). John Wiley & Sons, Inc., New York, USA, 2001. Google ScholarDigital Library
- A. Francois, R. Nevatia, J. Hobbs, and R. Bolles. VERL: An ontology framework for representing and annotating video events. IEEE Multimedia, 12(4):76--86, Oct. 2005. Google ScholarDigital Library
- A. Gangemi, N. Guarino, C. Masolo, A. Oltramari, and L. Schneider. Sweetening ontologies with DOLCE. In Proc. 13th Int. Conf. on Knowledge Engineering and Knowledge Management (EKAW '02), pages 166--181, London, UK, Oct. 2002. Google ScholarDigital Library
- J. Kittler, M. Hatef, R. Duin, and J. Matas. On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell., 20(3):226--239, Mar. 1998. Google ScholarDigital Library
- J. Lu, K. Plataniotis, and A. Venetsanopoulos. Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans. Neural Netw., 14(1):117--126, Jan. 2003. Google ScholarDigital Library
- J. Molina, V. Mezaris, P. Villegas et. al. MESH participation to TRECVID2008 HLFE. In Proc. TRECVID 2008 Workshop, USA, Nov. 2008.Google Scholar
- D. A. Randell, Z. Cui, and A. G. Cohn. A spatial logic based on regions and connection. In Proc. 3rd Int. Conf. on Knowledge Representation and Reasoning, pages 165--176, Jan. 1992.Google ScholarDigital Library
- A. Scherp, T. Franz, C. Saathoff, and S. Staab. F-a model of events based on the foundational ontology dolce+dns ultralight. In Proc. 5th Int. Conf. on Knowledge Capture (K-CAP '09), pages 137--144, Redondo Beach, California, USA, Sep. 2009. Google ScholarDigital Library
- P. Sidiropoulos, V. Mezaris, I. Kompatsiaris, H. Meinedo, and I. Trancoso. Multi-modal scene segmentation using scene transition graphs. In Proc. ACM Multimedia, pages 665--668, Beijing, China, Oct. 2009. Google ScholarDigital Library
- J. Smith, M. Naphade, and A. Natsev. Multimedia semantic indexing using model vectors. In Proc. Int. Conf. on Multimedia and Expo (ICME '03), pages 445--448, Baltimore, MD, USA, July 2003. Google ScholarDigital Library
- C. G. Snoek, M. Worring, J. C. van Gemert, J. Geusebroek, and A. W. Smeulders. The challenge problem for automated detection of 101 semantic concepts in multimedia. In Proc. ACM Multimedia, pages 421--430, Oct. 2006. Google ScholarDigital Library
- E. Tsamoura, V. Mezaris, and I. Kompatsiaris. Gradual transition detection using color coherence and other criteria in a video shot meta-segmentation framework. In Proc. IEEE ICIP Workshop on Multimedia Information Retrieval (ICIP-MIR 2008), pages 45--48, San Diego, CA, USA, Oct. 2008.Google ScholarCross Ref
- X. Wang and X.-P. Zhang. Ice hockey shot event modeling with mixture hidden markov model. In Proc. 1st ACM Int. Workshop on Events in Multimedia (EiMM'09), pages 25--32, Oct. 2009. Google ScholarDigital Library
- U. Westermann and R. Jain. Toward a common event model for multimedia applications. IEEE Multimedia, 14(1):19--29, Jan. 2007. Google ScholarDigital Library
- J.M. Zacks, T.S. Braver, M.A. Sheridan et. al. Human brain activity time-locked to perceptual event boundaries. Nature Neuroscience, 4(6):651--655, June 2001.Google ScholarCross Ref
- M. Zhu and A. Martinez. Subclass discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell., 28(8):1274--1286, Aug. 2006.. Google ScholarDigital Library
Index Terms
- Automatic event-based indexing of multimedia content using a joint content-event model
Recommendations
A Joint Content-Event Model for Event-Centric Multimedia Indexing
ICSC '10: Proceedings of the 2010 IEEE Fourth International Conference on Semantic ComputingIn this paper, a joint content-event model for indexing multimedia data is proposed. The event part of the model follows a number of formal principles to represent several aspects of real-life events, whereas the content part is used to describe the ...
Propagation of Event Content Modification in Business Processes
Service-Oriented ComputingAbstractBusiness processes are composed mainly of activities and events. The latter has gained much focus recently which has resulted in the drift towards Event-Driven Business Process Management (EDBPM). Events are used in both monitoring and controlling ...
Content adaptation of multimedia delivery and indexing using MPEG-7
MULTIMEDIA '02: Proceedings of the tenth ACM international conference on MultimediaThis work introduces a framework for adapting MPEG-4 intra- and inter-Elementary Streams and for encoding the results in an MPEG-7 stream to be used for resource adaptation on the delivery path to the user.
Comments