Abstract
Adaptation of media resources is an emerging field due to the growing amount of multimedia content on the one hand and an increasing diversity in usage environments on the other hand. Furthermore, to deal with a plethora of coding and metadata formats, format-independent adaptation systems are important. In this paper, we present a new format-independent adaptation system. The proposed adaptation system relies on a model that takes into account the structural metadata, semantic metadata, and scalability information of media bitstreams. The model is implemented using the web ontology language. Existing coding formats are mapped to the structural part of the model, while existing metadata standards can be linked to the semantic part of the model. Our new adaptation technique, which is called RDF-driven content adaptation, is based on executing SPARQL Protocol and RDF Query Language queries over instances of the model for media bitstreams. Using different criteria, RDF-driven content adaptation is compared to other adaptation techniques. Next to real-time execution times, RDF-driven content adaptation provides a high abstraction level for the definition of adaptations and allows a seamless integration with existing semantic metadata standards.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig1_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig2_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig3_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig4_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig5_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig6_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig7_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig8_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig9_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig10_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig11_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig12_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig13_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig14_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig15_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig16_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Figa_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Figb_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig17_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig18_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig19_HTML.gif)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-009-0178-9/MediaObjects/530_2009_178_Fig20_HTML.gif)
Similar content being viewed by others
Notes
The amount of RDF triples to represent the scalability information and semantic metadata is in this case negligible in comparison with the amount of triples needed for the structural metadata. Note that in our configuration, one triple took approximately 90 bytes of disk usage.
Version 1.3.1 of the BSDL reference software and version 2008-03-09 of the STX engine Joost were used.
A Bitstream Syntax Schema describes the high-level structure of a specific coding format.
Version 2.0.1 of Sesame was used.
In our case, a simple soccer ontology was used, including concepts such as SoccerMatch and SoccerScene, as well as properties such as levelOfImportance.
References
Amielh, M., Devillers, S.: Multimedia content adaptation with XML. In: Proceedings of 8th International Conference on Multimedia Modeling, pp. 127–145. Amsterdam, The Netherlands (2001)
Arndt, R., Troncy, R., Staab, S., Hardman, L., Vacura, M.: COMM: Designing a Well-Founded Multimedia Ontology for the Web. In: 6th International Semantic Web Conference (ISWC 2007). Busan, Korea (2007)
Bulterman, D., Grassel, G., Jansen, J., Koivisto, A., Layaïda, N., Michel, T., Mullender, S., Zucker, D. (eds.): Synchronized Multimedia Integration Language (SMIL 2.1). W3C Recommendation. World Wide Web Consortium (2005). http://www.w3.org/TR/SMIL2/
Burnett, I., Pereira, F., Van de Walle, R., Koenen, R. (eds.): The MPEG-21 Book. Wiley, NY (2006)
Cimprich, P., et al.: Streaming Transformations for XML (2004). Available on http://stx.sourceforge.net/documents/spec-stx-20040701.html
De Bruyne, S., De Schrijver, D., De Neve, W., Van Deursen, D., Van de Walle, R.: Enhanced shot-based video adaptation using MPEG-21 generic bitstream syntax schema. In: Proceedings of the 2007 IEEE Symposium Series on Computational Intelligence, 6 pp on CD–rom. Honolulu, Hawai (2007)
De Neve, W., Van Deursen, D., De Schrijver, D., De Wolf, K., Lerouge, S., Van de Walle, R.: BFlavor: a harmonized approach to media resource adaptation, inspired by MPEG-21 BSDL and XFlavor. Signal Process. Image Commun. 21(10), 862–889 (2006)
De Neve, W., Van Deursen, D., De Schrijver, D., De Wolf, K., Van de Walle, R.: Using Bitstream Structure Descriptions for the Exploitation of Multi-layered Temporal Scalability in H.264/MPEG-4 AVC’s Base Specification. Lecture Notes in Computer Science, Advances in Multimedia Information Processing, vol. 3767, pp. 641–652 (2005)
Decker, S., Melnik, S., van Harmelen, F., Fensel, D., Klein, M.C.A., Broekstra, J., Erdmann, M., Horrocks, I.: The semantic web: the roles of XML and RDF. IEEE Internet Comput 4(5), 63–74 (2000)
Devillers, S., Timmerer, C., Heuer, J., Hellwagner, H.: Bitstream Syntax Description-Based Adaptation in Streaming and Constrained Environments. IEEE Trans. Multimedia 7(3), 463–470 (2005)
Hannuksela, M.M., Wang, Y.K., Gabbouj, M.: Isolated regions in video coding. IEEE Trans. Multimedia 6, 259–267 (2004)
Hong, D., Eleftheriadis, A.: XFlavor: bridging bits and objects in media representation. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 4 on CD–rom. Lausanne, Switzerland (2002)
Hunter, J.: Adding multimedia to the semantic web—building an MPEG-7 ontology. In: First Semantic Web Working Symposium (SWWS), Proceedings, pp. 261–281. Stanford, USA (2001)
ISO/IEC: 21000-7:2004 Information Technology—Multimedia Framework (MPEG-21)—Part 7: Digital Item Adaptation (2004)
Kay, M.: XSLT Programmers’s Reference, 2nd edn. Wrox Press Ltd., Birmingham (2001)
Klyne, G., Carroll, J.J. (eds.): Resource Description Framework (RDF): Concepts and Abstract Syntax. W3C Recommendation. World Wide Web Consortium (2004). http://www.w3.org/TR/rdf-concepts/
Lerouge, S., Lambert, P., Van de Walle, R.: Multi-criteria Optimization for Scalable Bitstreams. Lecture Notes in Computer Science, Visual Content Processing and Representation, vol. 2849, pp. 122–130 (2003)
Magalhães, J., Pereira, F.: Using MPEG standards for multimedia customization. Signal Process. Image Commun. 19(5), 437–456 (2004)
McGuinness, D., van Harmelen, F. (eds.): OWL Web Ontology Language: Overview. W3C Recommendation. World Wide Web Consortium (2004). http://www.w3.org/TR/owl-features/
Mukherjee, D., Delfosse, E., Kim, J.G., Wang, Y.: Optimal adaptation decision-taking for terminal and network quality of service. IEEE Trans. Multimedia 7(3), 454–462 (2005)
Mukherjee, D., Said, A.: Structured scalable meta-formats (SSM) for digital Item adaptation. In: Internet Imaging IV, Proceedings of SPIE, vol. 5018 (2003)
Ohm, J.R.: Advances in scalable video coding. Proc. IEEE 93(1), 42–56 (2005)
Palmer, S.B.: Pondering RDF Path (2003). http://infomesh.net/2003/rdfpath
Prud’hommeaux, E., Seaborne, A. (eds.): SPARQL Query Language for RDF. W3C Recommendation. World Wide Web Consortium (2007). http://www.w3.org/TR/rdf-sparql-query/
Seaborne, A., Manjunath, G.: SPARQL/Update: A Language for Updating RDF Graphs (2008). http://jena.hpl.hp.com/~afs/SPARQL-Update.html
Souzis, A.: RxPath: a mapping of RDF to the XPath Data Model. In: Extreme Markup Language 2006. Montreal, Canada (2006)
Thomas-Kerr, J., Burnett, I., Ritz, C.: Format-independent multimedia streaming. In: Proceedings of 2006 IEEE International Conference on Multimedia and Expo (ICME), pp. 1509–1512 (2006)
Timmerer, C., Frank, T., Hellwagner, H.: Efficient processing of MPEG-21 metadata in the binary domain. In: Proceedings of SPIE International Symposium ITCom 2005 on Multimedia Systems and Applications VIII. Boston, Massachusetts (2005)
Timmerer, C., Panis, G., Kosch, H., Heuer, J., Hellwagner, H., Hutter, A.: Coding format independent multimedia content adaptation using XML. In: Proceedings of SPIE International Symposium ITCom 2003 on Internet Multimedia Management Systems IV, vol. 5242, pp. 92–103. Orlando (2003)
Van Deursen, D., De Schrijver, D., De Bruyne, S., Van de Walle, R.: Fully format agnostic media resource adaptation using an abstract model for scalable bitstreams. In: Proceedings of the 2007 IEEE International conference on Multimedia and Expo, pp. 240–243. Beijing (2007)
Van Lancker, W., De Sutter, R., De Schrijver, D., Van de Walle, R.: A Framework for transformations of XML within the binary domain. In: Proceedings of the IASTED international conference on Internet and Multimedia Systems and Applications, pp. 29–34 on CD–rom. Innsbruck, Austria (2006)
Vetro, A., Christopoulos, C., Ebrahimi, T.: Universal multimedia access. IEEE Signal Process. Mag. 20(2), 16 (2003)
W3C Multimedia Semantics Incubator Group: Available on http://www.w3.org/2005/Incubator/mmsem/
Walsh, N.: RDF Twig: accessing RDF graphs in XSLT. In: Extreme Markup Language 2003. Montreal, Canada (2003)
Acknowledgments
The research activities that have been described in this paper were funded by Ghent University, the Interdisciplinary Institute for Broadband Technology (IBBT), the Institute for the Promotion of Innovation by Science and Technology in Flanders (IWT-Flanders), the Fund for Scientific Research-Flanders (FWO-Flanders), and the European Union.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Dick Bulterman.
Rights and permissions
About this article
Cite this article
Van Deursen, D., Van Lancker, W., De Bruyne, S. et al. Format-independent and metadata-driven media resource adaptation using semantic web technologies. Multimedia Systems 16, 85–104 (2010). https://doi.org/10.1007/s00530-009-0178-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-009-0178-9