Skip to main content

Abstract

This chapter summarises the approach and main achievements of the research project BOEMIE (Bootstrapping Ontology Evolution with Multimedia Information Extraction). BOEMIE introduced a new approach towards the automation of knowledge acquisition from multimedia content. In particular, it developed and demonstrated the notion of evolving multimedia ontologies, which is used for the extraction, fusion and interpretation of information from content of various media types (audio, video, images and text). BOEMIE adopted a synergistic approach that combines multimedia extraction and ontology evolution in a bootstrapping process. This process involves, on the one hand, the continuous extraction of semantic information from multimedia content in order to populate and enrich the ontologies and, on the other hand, the deployment of these ontologies to enhance the robustness of the extraction system. Thus, in addition to annotating multimedia content with semantics, the extracted knowledge is used to expand our understanding of the domain and extract even more useful knowledge. The methods and technologies developed in BOEMIE were tested in the domain of athletics, using large sets of annotated content and evaluation by domain experts. The evaluation has proved the value of the technology, which is applicable in a wide spectrum of domains that are based on multimedia content.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Anthimopoulos, M., Gatos, B., Pratikakis, I.: Multiresolution text detection in video frames. In: Proceedings of the 2nd International Conference on Computer Vision Theory and Applications (VISAPP), Barcelona, Spain, pp. 161–166 (March 2007)

    Google Scholar 

  2. Benitez, A.B., Chang, S.-F., Smith, J.R.: Imka: A multimedia organization system combining perceptual and semantic knowledge. In: Proceedings of the Ninth ACM International Conference on Multimedia (MULTIMEDIA), pp. 630–631 (2001)

    Google Scholar 

  3. Berger, T., Kaplunova, A., Kaya, A., Möller, R.: Towards a scalable and efficient middleware for instance retrieval inference services. In: Proceedings of the 3rd International Workshop on OWL: Experiences and Directions (OWLED), co-located with the 4th European Semantic Web Conference (ESWC 2007), Innsbruck, Austria (June 2007)

    Google Scholar 

  4. Biatov, K.: Two level discriminative training for audio event recognition in sport broadcasts. In: Proceedings of the 12th International Conference on Speech and Computer (SPECOM), Moscow, Russia (October 2007)

    Google Scholar 

  5. Biatov, K., Hesseler, W., Kohler, J.: Audio data retrieval and recognition using model selection criterion. In: Proceedings of the 2nd International Conference on Signal Processing and Communication Systems, Gold Coast, Australia (December 2008)

    Google Scholar 

  6. Castano, S., Ferrara, A., Lorusso, D., Montanelli, S.: The hmatch 2.0 suite for ontology matchmaking. In: Proceedings of the 4th Italian Workshop on Semantic Web Applications and Perspectives (SWAP), Bari, Italy (December 2007)

    Google Scholar 

  7. Castano, S., Ferrara, A., Lorusso, D., Montanelli, S.: On the ontology instance matching problem. In: Proceedings of the 19th International Conference on Database and Expert Systems Applications (DEXA), pp. 180–184 (2008)

    Google Scholar 

  8. Castano, S., Ferrara, A., Montanelli, S.: Evolving multimedia ontologies: the bsm tool environment. In: Proceedings of 17th Italian Symposium on Advanced Database Systems (SEBD), Camogli, Italy (June 2009)

    Google Scholar 

  9. Castano, S., Ferrara, A., Montanelli, S., Lorusso, D.: Instance matching for ontology population. In: Proceedings of the Sixteenth Italian Symposium on Advanced Database Systems (SEBD), Mondello, Italy (June 2008)

    Google Scholar 

  10. Castano, S., Peraldi, S.E., Ferrara, A., Karkaletsis, V., Kaya, A.: Multimedia interpretation for dynamic ontology evolution. Journal of Logic and Computation 19(5), 859–897 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  11. Dasiopoulou, S., Tzouvaras, V., Kompatsiaris, I., Strintzis, M.G.: Capturing mpeg-7 semantics. In: International Conference on Metadata and Semantics Research (MTSR), Corfu, Greece, pp. 113–122 (2007)

    Google Scholar 

  12. Dasiopoulou, S., Tzouvaras, V., Kompatsiaris, I., Strintzis, M.G.: Enquiring mpeg-7 based ontologies. Multimedia Tools and Applications 46(2), 331–370 (2010)

    Article  Google Scholar 

  13. Ferrara, A., Montanelli, S., Varese, S.C.G.: Ontology knowledge authoring by natural language empowerment. In: IEEE Proceedings of the 1st DEXA Int. Workshop on Modelling and Visualization of XML and Semantic Web Data (MoViX), Linz, Austria (September 2009)

    Google Scholar 

  14. Fragkou, P., Petasis, G., Theodorakos, A., Karkaletsis, V., Spyropoulos, C.D.: Boemie ontology-based text annotation tool. In: Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC), Marrakech, Morocco (May 2008)

    Google Scholar 

  15. Peraldi, S.E., Kaya, A.: Ontology and rule design patterns for multimedia interpretation. In: Yamaguchi, T. (ed.) PAKM 2008. LNCS (LNAI), vol. 5345. Springer, Heidelberg (2008)

    Google Scholar 

  16. Peraldi, S.E., Kaya, A., Melzer, S., Möller, R.: On ontology based abduction for text interpretation. In: Gelbukh, A. (ed.) CICLing 2008. LNCS, vol. 4919, pp. 194–205. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  17. Peraldi, S.E., Kaya, A., Melzer, S., Möller, R., Wessel, M.: Towards a media interpretation framework for the semantic web. In: Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence (WI), Silicon Valley, USA, pp. 374–380 (November 2007)

    Google Scholar 

  18. Petasis, G., Karkaletsis, V., Krithara, A., Paliouras, G., Spyropoulos, C.D.: Semi-automated ontology learning: the boemie approach. In: Proceedings of the First ESWC Workshop on Inductive Reasoning and Machine Learning on the Semantic Web, Heraklion, Greece (June 2009)

    Google Scholar 

  19. Petasis, G., Fragkou, P., Theodorakos, A., Karkaletsis, V., Spyropoulos, C.D.: Segmenting html pages using visual and semantic information. In: Proceedings of the 4th Web as Corpus Workshop: Can we do better than Google?, at the 6th International Conference on Language Resources and Evaluation (LREC), Marrakech, Morocco (May 2008)

    Google Scholar 

  20. Petasis, G., Karkaletsis, V., Paliouras, G., Spyropoulos, C.D.: Learning context-free grammars to extract relations from text. In: Proceedings of the 18th European Conference on Artificial Intelligence (ECAI), Patras, Greece, pp. 303–307 (July 2008)

    Google Scholar 

  21. Petridis, S., Perantonis, S.J.: Semantics extraction from multimedia data: an ontology-based machine learning approach. In: Cutsuridis, A.H.V., Taylor, J.G. (eds.) Perception-action Cycle: Models, Architectures and Hardware (2011)

    Google Scholar 

  22. Tsapatsoulis, N., Petridis, S., Perantonis, S.J.: On the use of spatial relations between objects for image classification. In: Proceedings of the 4th IFIP Conference on Artificial Intelligence Applications and Innovations (AIAI), Athens, Greece (September 2007)

    Google Scholar 

  23. Vamvakas, G., Gatos, B., Pratikakis, I., Stamatopoulos, N., Roniotis, A., Perantonis, S.J.: Hybrid off-line ocr for isolated handwritten greek characters. In: Proceedings of the 4th IASTED International Conference on Signal Processing, Pattern Recognition, and Applications (SPPRA), Innsbruck, Austria (February 2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Paliouras, G., Spyropoulos, C.D., Tsatsaronis, G. (2011). Bootstrapping Ontology Evolution with Multimedia Information Extraction. In: Paliouras, G., Spyropoulos, C.D., Tsatsaronis, G. (eds) Knowledge-Driven Multimedia Information Extraction and Ontology Evolution. Lecture Notes in Computer Science(), vol 6050. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20795-2_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-20795-2_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-20794-5

  • Online ISBN: 978-3-642-20795-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics