Jack Jansen
Pablo Cesar
ABSTRACT
Inclusion of content with temporal behavior in a structured document leads to such a document gaining temporal semantics. If we then allow changes to the document during its presentation, this brings with it a number of fundamental issues that are related to those temporal semantics. In this paper we study modifications of active multimedia documents and the implications of those modifications for temporal consistency. Such modifications are becoming increasingly important as multimedia documents move from being primarily a standalone presentation format to being a building block in a larger application.
We present a categorization of modification operations, where each category has distinct consistency and implementation implications for the temporal semantics. We validate the model by applying it to the SMIL language, categorizing all possible editing operations. Finally, we apply the model to the design of a teleconferencing application, where multimedia composition is only a small component of the whole application, and needs to be reactive to the rest of the system.
The primary contribution of this paper is the development of a temporal editing model and a general analysis which we feel can help application designers to structure their applications such that the temporal impact of document modification can be minimized.
- }}Behr, J., Eschler, P., Jung, Y., and Zöllner, M. 2009. X3DOM: a DOM-based HTML5/X3D integration model. In Proceedings of the Iinternational Conference on 3D Web Technology, pp. 127--135. DOI= http://doi.acm.org/10.1145/1559764.1559784 Google Scholar
Digital Library
- }}Boll S., and Klas W. 2001. ZYX-A Multimedia Document Model for Reuse and Adaptation of Multimedia Content, IEEE Transactions On Knowledge and Data Engineering, 13(3): 361--382. Google ScholarDigital Library
- }}Bouvin, N. O., Zellweger, P. T., Grønbæk, K., and Mackinlay, J. D. 2002. Fluid annotations through open hypermedia: using and extending emerging web standards. In Proceedings of the International Conference on World Wide Web, pp. 160--171. DOI= http://doi.acm.org/10.1145/511446.511468 Google ScholarDigital Library
- }}Buchanan, M. C. and Zellweger, P. T. 2005. Automatic temporal layout mechanisms revisited. ACM Transactions on Multimedia Computing, Communications, and Applications, 1(1): 60--88. Google ScholarDigital Library
- }}Bulterman, D. and Rutledge, L. 2008. Interactive Multimedia for the Web, Mobile Devices and Daisy Talking Books. Springer-Verlag, Heidelberg, Germany, ISBN: 3--540--20234-X.Google Scholar
- }}Bulterman, D. et al. 2008. Synchronized Multimedia Integration Language (SMIL 3.0). W3C. URL=http://www.w3.org/TR/SMIL/Google Scholar
- }}Cattelan, R.G., Teixeira, C., Goluarte, R., and Pimentel, M.G.C. 2008. Watch-and-Comment as a Paradigm toward Ubiquitous Interactive Video Editing. ACM Transactions on Multimedia Computing, Communications, and Applications, 4(4) Google ScholarDigital Library
- }}Cesar, P., Bulterman, D.C.A., and Jansen, J. 2006. The Ambulant Annotator: Empowering Viewer-Side Enrichment of Multimedia Content. Proceedings of the ACM Symposium on Document Engineering, pp. 186--187. Google ScholarDigital Library
- }}Cesar, P., et al. 2008. Multimedia adaptation in ubiquitous environments: benefits of structured multimedia documents. Proceedings of the ACM Symposium on Document Engineering, pp. 275--284. Google ScholarDigital Library
- }}Costa, R.M.R., Moreno, M.F., Rodrigues, R.F., Soares, L.F. 2006. Live editing of hypermedia documents. Proceedings of the ACM Symposium on Document Engineering, pp. 165--172. Google ScholarDigital Library
- }}Jansen, J. and Bulterman, D. C. 2008. Enabling adaptive time-based web applications with SMIL state. In Proceeding of the ACM Symposium on Document Engineering, pp. 18--27. DOI= http://doi.acm.org/10.1145/1410140.1410146 Google ScholarDigital Library
- }}Jourdan, M., Layaida, N., Roisin, C., Sabry-Ismaïl, L., and Tardif, L. 1998. Madeus, and authoring environment for interactive multimedia documents. Proceedings of the ACM International Conference on Multimedia, pp. 267--272. Google ScholarDigital Library
- }}Lemlouma, T., and Layaida, N. 2003. Adapted Content Delivery for Different Contexts. 2003. Proceedings of the International Symposium of Applications and the Internet. Google ScholarDigital Library
- }}Meyerovich, L. A. and Bodik, R. 2010. Fast and parallel webpage layout. In Proceedings of the International Conference on World Wide Web, pp. 711--720. DOI= http://doi.acm.org/10.1145/1772690.1772763 Google ScholarDigital Library
- }}Nanard, M., Nanard, J., King, P.R. and Gaillard, L. 2007. Genre Driven Multimedia Document Production by Means of Incremental Transformation. Proceedings of the ACM Symposium on Document Engineering, pp. 111--120. Google ScholarDigital Library
- }}Ossenbruggen, J.V., Hardman, L., Geurts, J., and Rutledge, L. 2003. Towards a Multimedia Formatting Vocabulary. In Proceedings of the World Wide Web Conference, pp. 384--393. Google ScholarDigital Library
- }}Pellan, B. and Concolato, C. 2008. Adaptation of scalable multimedia documents. In Proceeding of the ACM Symposium on Document Engineering, pp. 32--41. DOI= http://doi.acm.org/10.1145/1410140.1410148 Google ScholarDigital Library
- }}Pihkala, K., and Vuorimaa, P. 2006. Nine methods to extend SMIL for Multimedia Applications. Multimedia Tools and Applications, 28(1): 51--67. Google ScholarDigital Library
- }}Rogge, B., and Bekaert, J., and Walle, R.V. 2004. Timing Issues in Multimedia Formats: Review of the Principles and Comparison of Existing Formats. IEEE Transactions on Multimedia, 6(6): 910 - 924. Google ScholarDigital Library
- }}Silva, H., Rodrigues, R.F., Soares, L.F.G., and Muchaluat-Saade, D.C. 2004. NCL 2.0: integrating new concepts to XML modular languages. Proceedings of the ACM Symposium on Document Engineering, pp. 188--197. Google ScholarDigital Library
- }}Scherp, A., and Boll, S. 2005. MM4U: A Framework for Creating Personalized Multimedia Content, Managing Multimedia Semantics, IRM Press, pp. 246--287.Google Scholar
- }}Thiessen, P. and Chen, C. 2007. Ajax live regions: chat as a case example. Proceedings of the International Cross-Disciplinary Conference on Web Accessibility, pp. 7--14. DOI= http://doi.acm.org/10.1145/1243441.1243450 Google ScholarDigital Library
- }}Williams, D., Ursu, M. F., Cesar, P., Bergström, K., Kegel, I., and Meenowa, J. 2009. An emergent role for TV in social communication. Proceedings of the European Conference on Interactive Television,19--28. DOI= http://doi.acm.org/10.1145/1542084.154208 Google ScholarDigital Library
Index Terms
- A model for editing operations on active temporal multimedia documents
Recommendations
Multimedia Document Models: Sealed Fate or Setting Out for New Shores?
Existing multimedia document models like HTML, MHEG, SMIL, and HyTime lack appropriate modeling primitives to fit the needs of next generation multimedia applications which bring up requirements like reusability of multimedia content in different ...
Design of Consistent SMIL Documents for Distributed Multimedia Presentation Using Temporal Algebra
ICPADS '05: Proceedings of the 11th International Conference on Parallel and Distributed Systems - Volume 01We aim to develop an intelligent multimedia presentation system that supports the presence of multiple distributed multimedia objects, as well as human-computer interaction. We develop a temporal algebra system as multimedia synchronization model to ...
Comments