Abstract
This paper presents a synchronization model for hypermedia presentations. Several media, continuous, like video and audio files, and non-continuous, like text pages and images, are delivered separately in a distributed environment like the World Wide Web, and presented to the user in a coordinated way.
The model is based on a set of synchronization relationships which define media behavior during presentation playback, channels in which to play them, and the effects of user interaction. The model is suited for a wide range of applications, among which self and distance education, professional training, Web advertising, cultural heritage promotion and news-on-demand are good representatives. The model is formally described in terms of changes in the presentation state due to media-related events. A virtual exhibition is analyzed as a test bed to validate the model.
Similar content being viewed by others
References
J.F. Allen, “Maintaining knowledge about temporal intervals,” Comm. ACM, Vol. 26, No. 11, pp. 832–843, 1983.
E. Bertino and E. Ferrari, “Temporal Synchronization Models for Multimedia Data,” IEEE Transactions on Knowledge and Data Engineering, Vol. 10, No. 4, pp. 612–631, 1998.
S. Boll and W. Klas, “ZYX, a Multimedia Document Model for Reuse and Adaption of Multimedia Content,” IEEE Transaction on Knowledge and Data Engineering, DS–8 Special Issue, Vol. 13, No. 3, pp. 361–382, 2001.
L.A. Carr, D.W. Barron, H.C. Davis, and W. Hall. “Why use HyTime?” Electronic Publishing—Origination, Dissemination, and Design, Vol. 7, No. 3, pp. 163–178, 1994.
A. Celentano and O. Gaggi, “Querying and Browsing Multimedia Presentations,” in Second International Workshop on Multimedia Databases and Image Communication, M.Tucci (Ed.), number 2184 in LNCS, Springer Verlag: Amalfi, Italy, Sept. 2001, pp. 105–116.
A. Celentano and O. Gaggi, “Template-based generation of multimedia presentations,” international Journal of Software Engineering and Knowledge Engineering, Vol. 13, No. 4, pp. 419–445, 2002.
A. Celentano, O. Gaggi, and M.L. Sapino, “Retrieval in Multimedia Presentations,” Multimedia Systems, Vol. 10, No. 1, pp. 146–154, 2004.
D.C. Fallside (Ed.), “XML Schema Part 0: Primer,” http://www.w3.org/TR/xmlschema-0/, May 2001.
O. Gaggi and A. Celentano, “A Visual Authoring Environment for Multimedia Presentations on the World Wide Web,” in IEEE International Symposium on Multimedia Software Engineering (MSE2002), Newport Beach, California, Dec. 2002, pp. 206–213.
L. Hardman, “Using the Amsterdam Hypermedia Model for Abstracting Presentation Behavior,” in Electronic Proceedings of the ACM Workshop on Effective Abstractions in Multimedia, San Francisco, CA, Nov. 1994.
L. Hardman, “ Modelling and Authoring Hypermedia Documents,” PhD thesis, CWI, University of Amsterdam, 1998.
L. Hardman, D.C.A. Bulterman, and G. van Rossum, “The Amsterdam Hypermedia Model: Adding Time, Structure and Context to Hypertext,” Communications of the ACM, Vol. 37, No. 2, pp. 50–62, 1994.
L. Hardman, J. van Ossenbruggen, L. Rutledge, K. Sjoerd Mullemder, and D.C.A. Bulterman, “Do you Have the Time? Composition and Linking in Time-based Hypermedia,” in ACM Conference on Hypertext and Hypermedia’99, Darmstadt, Germany, Feb. 1999, pp. 189–196.
M. Jourdan, N. Laya“da, C. Roisin, L. Sabry-Ismail, and L. Tardif, “Madeus, an Authoring Environment for Interactive Multimedia Documents,” in ACM Multimedia 1998, Bristol, UK, Sep. 1998, pp. 267–272.
P. King, H. Cameron, H. Bowman, and S. Thompson, “Synchronization in Multimedia Documents,” in Electronic Publishing, Artistic Imaging, and Digital Typography, Lecture Notes in Computer Science, J. Andre (Ed.), Springer-Verlag, May 1998, Vol. 1375, pp. 355–369.
MPEG ISO’IEC Joint Technical Committee. MPEG-4 Overview, ISO/IEC JTC1/SC29/WG11 N4668, March 2002.
S.R. Newcomb, N.A. Kipp, and V.T. Newcomb, “The HyTime: Hypermedia/Time-Based document structuring language,” Communications of the ACM, Vol. 34, No. 11, pp. 67–83, 1991.
Palazzo Grassi, The Maya Exhibition, Venice, Italy, 1999. http://www.palazzograssi.it/eng/mostre/mostre_maya.html
J.A. Schnepf, J.A. Konstan, and D. Hung-Chang Du, “Doing FLIPS: FLexible Interactive Presentation Synchronization,” IEEE Journal on Selected Areas of Communications, Vol. 14, No. 1, pp. 114–125, 1996.
J. Schnepf, Y. Lee, D. Du, L. Lai, and L. Kang, “Building a Framework for FLexible Interactive Presentations,” in Pacific Workshop on Distributed Multimedia Systems (Pacific DMS 96), Hong Kong, June 1996, pp. 296–305
Synchronized Multimedia Working Group of W3C, Synchronized Multimedia Integration Language (SMIL) 2.0 Specification, http://www.w3.org/TR/smil20, August 2001.
M. Vazirgiannis, Y. Theodoridis, and T. Selling, “Spatio-temporal composition and indexing for large multimedia applications,” Multimedia Systems, Vol. 6, No. 4, pp. 284–298, 1998.
Jin Yu, “A Simple, Intuitive Hypermedia Synchronization Model and its Realization in the Browser/Java environment,” in Asia Pacific Web Conference, Hong Kong, Sept. 1998, pp. 209–218.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gaggi, O., Celentano, A. Modelling Synchronized Hypermedia Presentations. Multimed Tools Appl 27, 53–78 (2005). https://doi.org/10.1007/s11042-005-2714-8
Issue Date:
DOI: https://doi.org/10.1007/s11042-005-2714-8