Skip to main content
SpringerLink
Log in

A knowledge-based framework for multimedia adaptation

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Personalized delivery of multimedia content over the Internet opens new business perspectives for future multimedia applications and thus plays an important role in the ongoing MPEG-7 and MPEG-21 multimedia standardization efforts. Based on these standards, next-generation multimedia services will be able to automatically prepare the digital content before delivery according to the client's device capabilities, the network conditions, or even the user's content preferences. However, these services will have to deal with a variety of different end user devices, media formats, as well as with additional metadata when adapting the original media resources. In parallel, an increasing number of commercial or open-source media transformation tools will be available, capable of exploiting such descriptive metadata or dealing with new media formats; thus it is not realistic that a single tool will support all possible transformations.

In this paper, we present a novel, fully knowledge-based approach for building such multimedia adaptation services, addressing the above mentioned issues of openness, extensibility, and concordance with existing and upcoming standards. In our approach, the original media is transformed in multiple adaptation steps performed by an extensible set of external tools, where the construction of adequate adaptation sequences is solved in an Artificial Intelligence planning process. The interoperability issue is addressed by exploiting standardized Semantic Web Services technology. This technology allows us to express tool capabilities and execution semantics in a declarative and well-defined form. In this context, existing multimedia standards serve as a shared domain ontology.

The presented approach was implemented and successfully evaluated in an official ISO/IEC MPEG (Moving Picture Experts Group) Core Experiment and is currently under further evaluation by the standardization body.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. M. Addis, M. Boniface, S. Goodall, P. Grimwood and S. KimP. Lewis, K. Martinez,and A. Stevenson, “SCULPTEUR: Towards a new paradigm for multimediamuseum information handling.” in Proceedings of the International Semantic Web Conference2003, FL, USA, Lecture Notes in Computer Science, 2870, pp. 582–596, 2003.

  2. T. Berners-Lee, J. Hendler and O. Lassila, “The semantic web,” Scientific American, Vol. 284, pp. 34–43, 2001.

    Google Scholar 

  3. E. Bertino and E. Ferrariand M. Stolf, “MPGS: An interactive tool for thespecification and generation of multimedia presentations,” IEEE Transactions on Knowledge and Data Engineering, Vol.12, No. 1, pp. 102–125, 1994.

    Google Scholar 

  4. A. Blum and M. Furst“Fast planning through planning graph analysis,” Artificial Intelligence, Vol. 90, pp. 281–300, 1997.

    Article  Google Scholar 

  5. L. Boeszoermeny, H. Hellwagner, H. Kosch and M. Libsieand S. Podlipnig, “Metadata Driven Adaptation in the ADMITS Project.” EURASIP Signal Processing: Image Communication, Special Issue on Multimedia Adaptation, Vol. 18, pp. 749–766, 2003.

    Google Scholar 

  6. B. Bonet and H. Geffner“Faster heuristic search algorithms forplanning with uncertainty and full feedback,”in Int. Joint Conference on Artificial Intelligence(IJCAI-2003). Acapulco, Mexico, pp. 1233–1238, 2003.

  7. J. Bormans (ed.), MPEG-21 Requirements v 1.5 ISO/IEC JTC 1/SC 29/WG11 N5873, Trondheim: Norway, 2003.

    Google Scholar 

  8. I. Bratko Prolog Programming for Artificial Intelligence, 3rdedn., Addison-Wesley, 2000.

  9. I. Burnett, R.V. de Walle, K. Hill and J. Bormansand F. Pereira,“MPEG-21: Goals and achievements,” IEEE MultiMedia Magazine, Vol. 10, No. 6, pp. 60–70, 2003.

    Google Scholar 

  10. T. Bylander “The computational complexity of propositional STRIPSplanning,” Artificial Intelligence, Vol. 69, Nos. 1/2, pp. 165–204, 1994.

    MATH  MathSciNet  Google Scholar 

  11. J.M.L. Cobo and S. Losada,Ó. Corcho, V.R. Benjamins, M. Ni,ño, and J.Contreras, “SWS for Financial Overdrawn Alerting,” in International Semantic Web Conference, pp. 782–796, 2004.

  12. H. Eidenberger and C. Breiteneder“VizIR,—A Framework for VisualInformation Retrieval,” Journal of Visual Languages and Computing, Vol. 14, pp. 443–469, 2003.

    Google Scholar 

  13. M. Fox and D. Long“PDDL2.1: An extension to PDDL for expressingtemporal planning domains,” Journal on Artificial Intelligence Research, Vol. 20, pp. 61–124, 2003.

    Google Scholar 

  14. J. Gecsei “Adaptation in distributed multimedia systems,”IEEE MultiMedia, Vol. 4, No. 2, pp. 58–66, 1997.

    Article  Google Scholar 

  15. ISO/IEC 15938-5:2003, Information Technology—Multimedia ContentDescription Interface,—Part 5: Multimedia Description Schemes, 2003.

  16. ISO/IEC 21000-5:2003, Information Technology,—MultimediaFramework,—Part 5: Rights Expression Language, 2003.

  17. ISO/IEC 21000-6:2003, Information Technology,—MultimediaFramework,—Part 6: Rights Data Dictionary, 2003.

  18. ISO/IEC 21000-7:2004, Information Technology - MultimediaFramework,—Part 7: Digital Item Adaptation, 2004.

  19. D. Jannach and K. Leopold“A multimedia adaptation framework based onsemantic web technology,” in Workshop on Multimedia and the Semantic Web, held inconjunction with 2nd European Semantic Web Conference, 2005.

  20. D. Jannach and K. Leopoldand H. Hellwagner, “An extensible framework forknowledge-based multimedia adaptation,” in Proceedings of 14th Conference on Industrial and EngineeringApplications of Artificial Intelligence and Expert Systems (IEA/AIE), LectureNotes in Artificial Intelligence 2070, pp. 434–444, 2004.

  21. I. Kompatsiaris and V. Mezarisand M.G. Strintzis, “Multimedia contentindexing and retrieval using an object ontology” in G. Stamou (ed.), Multimedia Content and Semantic Web,—Methods, Standards and Tools, New York, USA, 2004.

  22. J.M. Martinez and R. Koenenand F. Pereira, “MPEG-7,—The GenericMultimedia Content Description Standard, Part 1.” IEEE MultiMedia, Vol. 9, No. 2, pp. 78–87, 2002.

    Article  Google Scholar 

  23. D.L. McGuiness F. van Harmelen (eds.), “OWL Web ontology languageoverview. Technical report,” http://www.w3.org/TR/owl-features/. 2004.

  24. S. McIlraith and T. Sonand H. Zeng, “Semantic Web Services” IEEE Intelligent Systems, Special Issue on the Semantic Web,Vol. 16, pp. 46–53, 2001.

    Google Scholar 

  25. V. Mezaris and I. Kompatsiarisand M.G. Strintzis, “Region-based imageretrieval using an object ontology and relevance feedback,” EURASIP Journal on Applied Signal Processing, Special Issue on Object-Based and Semantic Image and Video Analysis, pp. 886–901, 2004.

  26. Y. Qu X. Zhang and H. Li, “OREL: AN ontology-based rights expressionlanguage,” in Proceedings of the 2004 ACM World Wide Web Conference(WWW,'2004) Alternate Track Papers and Posters, pp. 324–425, 2004.

  27. G. Rust and C. Barlas“The MPEG-21 Rights data dictionary” IEEE Transactions on Multimedia, Vol. 7, No. 2. 2005.

  28. P. Schojer, L. Boeszoermenyi, H. Hellwagner and B. Penzand S. Podlipnig, “Architecture of a quality based intelligent proxy (QBIX) for MPEG-4videos,” in Proceedings of the 2003 ACM World Wide Web Conference (WWW,'2003), Budapest, Hungary, pp. 394–402, 2003.

  29. M. Sheshagiri and N. Sadehand F. Gandon, “Using semantic Web Services for context-aware mobile applications,” in Proceedings of MobiSys2004 Workshop on Context Awareness. Boston, USA, pp. 782–796, 2004.

  30. P. Soetens and M.D. Geyter, “Applying domain knowledge to multi-step media adaptation based on Semantic Web Services,” in Proceedings of Workshop on Image Analysis for Multi-media Interactive Systems (WIAMIS)Montreux, Switzerland, 2005.

  31. O. Steiger and D.M. Sanjunand T. Ebrahimi, “MPEG-based personalized content delivery,” in Proc. of the IEEE Int. Conf. on Image Processing, ICIP 2003, Barcelona, Spain, pp. 14–16, 2003.

  32. The OWL Services Coalition, “OWL-S: Semantic markup for Web Services. Technical report,”http://www.daml.org/services/owl-s/1.0/. http://www.daml.org/services/owl-s/1.0/., 2004.

  33. C., Timmerer, T. DeMartini, and C. Barlas (eds.), Information Technology—Multimedia Framework (MPEG-21),—Part 7: Digital Item Adaptation, AMENDMENT 1: DIA Conversions and Permissions, 2005.

  34. A. Vetro and C. Christopoulosand T. Ebrahami (eds.), IEEE Signal Processing Magazine, Special Issue on Universal Multimedia Access, Vol. 20, 2003.

  35. A. Vetro and C. Christopoulosand H. Sun, “Video transcoding architectures and techniques: An overview,” IEEE Signal Processing Magazine, Vol. 20, No. 2, pp. 18–29, 2003.

    Google Scholar 

  36. A. Vetro and C. Timmerer “Digital item adaptation: Overview of standardization and research activities,” IEEE Transactions on Multimedia, Vol. 7, No. 2, 2005.

  37. X. Wang, T. DeMartini and B. Wraggand M. Paramasivam, “The MPEG-21 rights expression language,” IEEE Transactions on Multimedia, Vol. 7, No. 2, 2005.

Download references

Author information

Authors and Affiliations

  1. Universität Klagenfurt, A-9020, Austria

    Dietmar Jannach, Klaus Leopold, Christian Timmerer & Hermann Hellwagner

Authors
  1. Dietmar Jannach
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Klaus Leopold
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Christian Timmerer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hermann Hellwagner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dietmar Jannach.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jannach, D., Leopold, K., Timmerer, C. et al. A knowledge-based framework for multimedia adaptation. Appl Intell 24, 109–125 (2006). https://doi.org/10.1007/s10489-006-6933-0

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-006-6933-0

Keywords

Search

Navigation