Skip to main content
SpringerLink
Log in

Ontology-Based Semantic Indexing for MPEG-7 and TV-Anytime Audiovisual Content

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we describe a framework that we have developed for the support of ontology-based semantic indexing and retrieval of audiovisual content following the MPEG-7 and TV-Anytime standard specifications for metadata descriptions. Our work aims to provide a methodology to enhance the retrieval effectiveness of audiovisual content, while maintaining compatibility with the international multimedia standards.

In our framework, domain-specific ontologies guide the definition of both the application-specific metadata and the instance-description metadata that describe the contents of audiovisual programs and/or their segments. The ontologies are also used in order to provide compatible descriptions in both audiovisual content standards (MPEG-7 and TV-Anytime) for the same content. This approach allows indexing compatibility and interoperability of TV-Anytime and digital library applications.

We describe the design and implementation of a system supporting this framework. The components of the system include a segmentation tool for segmenting audiovisual information, which also provides ontology-based semantic indexing capabilities, and an appropriate API for semantic query support. An application testbed for the domain of soccer games has been developed on top of this system. An ontology for soccer games has been defined and used for indexing and retrieval of soccer games that have been stored in the system database.

The methodology we developed opens up a wide opportunity for the creation of MPEG-7 and TV-Anytime services offering structured domain-specific ontologies that can be integrated to these standards for enhancing audiovisual content retrieval performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Q. Al-Khatib, F. Day, A. Ghafoor, and B. Berra, “Semantic modelling and knowledge representation in multimedia databases,” IEEE Transactions on Knowledge and Data Engineering, Vol. 11, No. 1, pp. 64–80, 1999.

    Google Scholar 

  2. A. Analyti and S. Christodoulakis, “Multimedia object modelling and content-based querying,” in Proc. Advanced Course Multimedia Databases in Perspective, Twente, Netherlands, 1995, pp. 213–238.

  3. Carnegie Mellon University, “Informedia project,” http://www.informedia.cs.cmu.edu.

  4. S. Christodoulakis, N. Pappas, G. Kyriakaki, I. Maragoudakis, Y. Mavraganis, and C. Tsinaraki, “The KYDONIA multimedia information server,” in Proc. ECMAST, Milan, Italy, pp. 491–506, 1997.

  5. DELOS Network of Excellence in Digital Libraries, http://delos-noe.iei.pi.cnr.it/.

  6. S. Eickeler, K. Biatov, M. Larson, and J. Koehler, “Two novel applications of speech recognition methods for robust spoken document retrieval,” Chania, Greece, 2003, MDL workshop proceedings, http://www.music.tuc.gr/MDL/.

  7. D. Fallside, “XML Schema Part 0: Primer,” W3C Recommendation, 2001, http://www.w3.org/TR/xmlschema-0/.

  8. Federation Internationale de Football (FIFA), “Football Game Rules,” 2003, http://www.fifa.org

  9. J. Gemmell, J. Han, R. Beaton, and S. Christodoulakis, “Delay-sensitive multimedia on disks,” IEEE Multimedia, Vol. 1, No. 3, pp. 56–67, 1994.

    Google Scholar 

  10. W. Grosky, “Managing multimedia information in databasesystems,” Communications of the ACM, Vol. 40, No. 12, pp. 73–80, 1997.

    Google Scholar 

  11. N. Guarino, “Formal ontology and information systems,” in Proc. of FOIS ‘98, Trento, Italy, 1998, pp. 3–15.

  12. D. Mc Guiness, F. van Harmelen, “OWL web ontology language overview,” W3C Candidate Recommendation, 2003, http://www.w3.org/TR/owl-features/.

  13. M.-S. Hacid, C. Decleir, and J. Kouloumdjian, “A database approach for modeling and querying video data,” IEEE Transactions on Knowledge and Data Engineering, Vol. 12, No. 5, 2000.

  14. IBM Japan, “Video Enrichment project,” http://www.tri.ibm.com/projects/video/index_e.htm.

  15. ISO/IEC JTC 1/SC 29/WG 11/N3966, “Text of 15938-5 FCD information technology—multimedia content description interface—Part 5 multimedia description schemes,” Singapore, 2001.

  16. A. Jaimes, T. Echigo, M. Teraguchi, and F. Satoh, “Learning personalized video highlights from detailed mpeg-7 metadata,” in Proc. of ICIP, Rochester, NY, USA, 2002.

  17. H. Jiang and A. Elmagarmid, “WVTDB—A semantic content-based database system on the World Wide Web,” IEEE Transactions on Knowledge and Data Engineering, Vol. 10, No. 6, pp. 947–966, 1998.

    Google Scholar 

  18. F. de Jong and T. Westerveld, “MUMIS: Multimedia indexing and searching,” in Proc. of CBMI Workshop, Brescia, Italy, 2001, pp. 423–425.

  19. F. Kazasis, N. Moumoutzis, and N. Pappas, “Informative annex: Generic architecture for handling TVA metadata using relational databasetechnologies,” contribution TV-Anytime Forum/Metadata WG, 2nd Implementer’s workshop, Geneva, 2002.

  20. F. Kazasis, N. Moumoutzis, N. Pappas, A. Karanastasi, and S. Christodoulakis, “Designing ubiquitous personalized TV-anytime services,” in Proc. of CAiSE workshops (UMICS), Velden, Austria, 2003, pp. 136–149.

  21. Kyriakaki G., “MPEG information management services for audiovisualapplications,” Master Thesis, Technical University of Crete, 2000.

  22. C. Brandt, G. Kyriakaki, W. Lamotte, R. Lüling, I. Maragoudakis, Y. Mavraganis, K. Meyer, and N. Pappas, “The SICMA multimedia server and the virtual museum application,” in Proceedings of the European Conference on Multimedia Applications Services and Techniques—ECMAST 98, Berlin, 1998, pp. 85–97.

  23. MPEG Group, “MPEG-7 (Multimedia Content Description Interface),” http://www.chiariglione.org/mpeg/index.htm.

  24. The OntoWeb project, http://www.ontoweb.org/.

  25. N. Pappas, F. Kazasis, N. Moumoutzis, C. Tsinaraki, and S. Christodoulakis, “Personalized and ubiquitous information services for TVprograms,” MDL workshop proceedings, Chania, Greece, 2003, http://www.music.tuc.gr/MDL/.

  26. N. Pappas and S. Christodoulakis, “Design & development of a stream service in a heterogeneous client environment,” in Proc. VLDB, Cairo, Egypt, 2000, pp. 578–579.

  27. R. Singh, M. Seltzer, B. Raj, and R. Stern, “Speech in noisy environments: Robust automatic segmentation, feature extraction and hypothesis combination,” ICASSP, Salt Lake City, UT, 2001.

    Google Scholar 

  28. C. Tsinaraki and S. Christodoulakis, “Integration of OWL ontologies in MPEG-7 and TV-Anytime compliant SemanticIndexing,” submitted for publication.

  29. C. Tsinaraki, E. Fatourou and S. Christodoulakis, “An ontology-driven framework for the management of semantic metadata describing audiovisual information,” in Proc. of CAiSE, Velden, Austria, 2003, pp. 340–356.

  30. C. Tsinaraki, S. Papadomanolakis, and S. Christodoulakis, “A video metadata model supporting personalization & recommendation in video-based services,” in Proc. of MDDE Workshop, Lyon France, 2001, pp. 104–109.

  31. C. Tsinaraki, S. Papadomanolakis, and S. Christodoulakis, “Towards a two—layered Video Metadata Model,” in Proc. of DEXA Workshop—DLib, Munich, Germany, 2001, pp. 937–941.

  32. TV-Anytime Forum, http://www.tv-anytime.org/.

  33. UP-TV project site, http://www.up-tv.de/.

Download references

Author information

Authors and Affiliations

  1. Lab. of Distributed Multimedia Information Systems and Applications (MUSIC/TUC), Technical University of Crete Campus, 73100, Kounoupidiana, Chania, Greece

    Chrisa Tsinaraki, Panagiotis Polydoros, Fotis Kazasis & Stavros Christodoulakis

Authors
  1. Chrisa Tsinaraki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Panagiotis Polydoros
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fotis Kazasis
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Stavros Christodoulakis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chrisa Tsinaraki.

Additional information

The work presented in this paper was partially funded in the scope of the EU-funded project (IST-1999-20751) UP-TV: “Ubiquitous personalized interactive Multimedia TV Systems and Services” [33] and the DELOS II Network of Excellence in Digital Libraries [5].

Chrisa Tsinaraki holds a diploma (1995) and a M.Eng degree (2000) in Computer Engineering. She is a Ph.D. student and has been working as a researcher at the Technical University of Crete and has been involved in many European RTD projects. Her research focus is on interoperability support for multimedia content services, based on MPEG-7/21 and ontologies.

Panagiotis Polydoros holds a diploma (2004) in Computer Engineering. He is a M.Eng student and works as a researcher at the Technical University of Crete. His research focus is on Multimedia Information Management Systems & Applications.

Fotis G. Kazasis holds a diploma (1990) and a M.Eng degree (1995) in Computer Engineering. He is a senior researcher at the Technical University of Crete and has been involved in many European RTD projects. His research interests include the design and implementation of Multimedia Information Management Systems & Applications.

Stavros Christodoulakis is Professor of the Department of Electronic and Computer Engineering of the Technical University of Crete, Greece, and Director of the Laboratory of Distributed Multimedia Information Systems and Applications (TUC/MUSIC). He holds a Ph.D. in Computer Science from the Department of Computer Science of the University of Toronto.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tsinaraki, C., Polydoros, P., Kazasis, F. et al. Ontology-Based Semantic Indexing for MPEG-7 and TV-Anytime Audiovisual Content. Multimed Tools Appl 26, 299–325 (2005). https://doi.org/10.1007/s11042-005-0894-x

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-005-0894-x

Keywords

Search

Navigation