Skip to main content
SpringerLink
Log in

Interactive Multimedia Documents: A Modeling, Authoring and Rendering Approach

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper we present our research and development experience in the context of Interactive Multimedia Documents (IMDs). We define a rich model for such documents covering the issues of interaction and spatiotemporal compositions as means of representing the functionality of an IMD. We exploit the event concept to represent interaction, while complex interactions are covered by a rich algebraic and spatiotemporal event composition scheme. Based on the model we implemented an authoring methodology. Thereafter we present a generic framework for rendering (presenting) IMDs putting emphasis to the handling of interaction and to the temporal synchronization of media objects. The rendering system is implemented as a client-server architecture using Java and accompanying technologies. The implementation is suitable for WWW enabled interactive multimedia documents.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. J.F. Allen, “Maintaining knowledge about temporal intervals,” Communications of the ACM, Vol. 26, No. 11, pp. 832–843, 1983.

    Google Scholar 

  2. J. Bein, R. King, and N. Kamel, MOBY: “Anarchitecture for distributed expert database systems,” in Proceedings of the Thirteenth Conference on Very Large Databases, Brighton, England, 1987.

  3. G. Blakowski and R. Steinmetz, “A media synchronization survey: Reference model, specification, and case studies,” IEEE Journal on Selected Areas in Communications, Vol. 14, No. 1, Jan. pp. 5–35, 1996.

    Google Scholar 

  4. M.C. Buchanan, P.T. Zellweger, “Automatic temporal layout mechanisms,” in Proc. ACM Multimedia’ 93, Anaheim, CA, August 1993, pp. 341–350.

  5. J. Buford, “Evaluating HyTime: An examination and implementation experience,” in proceedings of ACM Hypertext'96 Conference, 1996.

  6. D.C.A. Bulterman, L. Hardman, J. Jansen, K.S. Mullender, and L. Rutledge, “GRiNS: A GRaphical INterface for creating and playing SMIL documents,” in Proceedings of Seventh International World Wide Web Conference (WWW7), April 1998.

  7. K.S. Candan, P. Prabhakaran, and V.S. Subrahmanian, “Retrieval schedules based on resource availability and flexible presentation specifications,” ACM Multimedia Systems Journal, Vol. 6, No. 4, pp. 232–250, 1998.

    Google Scholar 

  8. S. Chakravarthy and D. Mishra, “Rule management and evaluation: An active DBMS prospective,” in [27].

  9. S. Chakravarthy and D. Mishra, “Snoop: An expressive event specification language for active databases,” Technical Report, UF-CIS-TR-93-00, University of Florida, 1993.

  10. A. Duda and C. Keramane, “Structured temporal composition of multimedia data,” CNRS-IMDG, Grenoble, France 1995.

    Google Scholar 

  11. S. Gatziou, “Events in active object-oriented database system,” Technical Report, ETH, Zurich, 1994.

  12. N.H. Gehani, H.V. Jagadish, and O. Shmueli, “Composite event specification in an active databases: Model & implementation,” in Proceedings of VLDB Conference, 1992, pp. 327–338.

  13. M. Handl, “A new multimedia synchronization model,” IEEE Journal on Selected Areas in Communications, Vol. 14, No. 1, pp. 73–83, 1996.

    Google Scholar 

  14. I. Herman, N. Correia, D.A. Duce, D.J. Duke, G.J. Reynolds, and J. van Loo, “Astandard model for multimedia synchronization: PREMO synchronization objects,” ACM Multimedia Systems Journal, Vol. 6, No. 2, pp. 88–101, 1998.

    Google Scholar 

  15. N. Hirzalla, B. Falchuk, and A. Karmouch, “A temporal model for interactive multimedia scenarios,” IEEE Multimedia, Fall, Vol. 2, No. 3, pp. 24–31, 1995.

    Google Scholar 

  16. M.Iino, Y.F. Day, and A. Ghafoor, “Anobject oriented model for spatiotemporal synchronization of multimedia information,” in Proc. IEEE Int. Conf. Multimedia Computing and Systems, Boston MA, 1994, pp. 110–119.

  17. International Standard Organization, “Hypermedia/time-based document structuring language (HyTime),” ISO/IEC IS 10744, April 1992.

  18. ISO/IEC, JTC 1/SC 29, “Coded representation of multimedia and hypermedia information objects (MHEG),” Part I, Committee Draft 13522–1, June 1993. ISO/IEC 10031.

  19. Java-Remote Method Invocation, available at: http://java.sun.com:81/marketing/collateral/rmi_ds.html.

  20. Java-Media Framework available at: <http://www.javasoft.com/products/java-media/jmf/>.

  21. A. Karmouch and J. Emery, “A playback schedule model for multimedia documents,” IEEE Multimedia, Vol. 3, No. 1, pp. 50–63, 1996.

    Google Scholar 

  22. I. Kostalas, T. Sellis, and M. Vazirgiannis, “Spatiotemporal specification & verification of multimedia scenarios,” in The Proceedings of the IFIP-DS-8 Conference on Multimedia Semantics, January 1999.

  23. T. Little and A. Ghafoor, “Interval-based conceptual models for time-dependent multimedia data,” IEEE Transactions on Data and Knowledge Engineering, Vol. 5, No. 4, pp. 551–563, 1993.

    Google Scholar 

  24. D.P. Miranker, TREAT: “A new and efficient match algorithm for AI production systems,” Ph.D. Thesis, Department of Computer Science, Columbia University, New York, 1986.

    Google Scholar 

  25. I. Mirbel, B. Pernici, and M. Vazirgiannis, “Temporal integrity constraints in interactive multimedia documents,” in The Proceedings of IEEE-International Conference on Multimedia Computing and Systems (ICMCS'99), Florence, Italy, June 1999.

  26. A.J. Pasik, “A methodology for programming production systems and its implications on parallelism,” Ph.D. Thesis, Department of Computer Science, Columbia University, New York, 1989.

    Google Scholar 

  27. R. Braden et al., “Resource ReSerVation protocol (RSVP)-Version 1 Functional Specification,” RFC 2205, September 1997.

  28. T. Sellis (Ed.), “Special issue on rule management and processing in expert database systems,” SIGMOD Record Vol. 18, No. 3, 1989.

  29. J. Srivastava, K.-W. Hwang, and J.N. Tan, “Parallelism in database production systems,” in Proceedings of the 6th IEEE International Conference on Data Engineering, 1990.

  30. J. Schnepf, A. Kosntan, and D.H. Du, “Doing FLIPS: FLexible interactive presentation synchronisation,” IEEE Journal on Selected Areas in Communications, Vol. 14, No. 1, pp. 114–125, 1996.

    Google Scholar 

  31. G. Schloss and M. Wynblatt, “Providing definition and temporal structure from multimedia data,” Multimedia Systems Journal, Vol. 3, pp. 264–277, 1995.

    Google Scholar 

  32. Synchronized Multimedia Integration Language (SMIL) 1.0 Specification, W3C, Proposed Recommendation.http://www.w3.org/TR/REC-smil/.

  33. M. Stonebraker, E.N. Hanson, and S. Potamianos, “The POSTGRES rule manager,” IEEE Transactions on SoftwareEngineering, Vol. 14, No. 7, 1988.

  34. H. Thimm, W. Klas, Jo. Walpole, C. Pu, and C. Cowan, “Managing adaptive presentation executions in distributed multimedia database systems,” in Proceedings of InternationalWorkshop on Multimedia Database Systems, Blue Mountain Lake, NY, 1995.

  35. M. Vazirgiannis, “Multimedia data base object and application modelling issues and an object oriented model,” in Multimedia Database Systems: Design and Implementation Strategies, K.C. Nwosu, B. Thuraisingham, and P.B. Berra (Eds.), Kluwer Academic Publishers, 1996, pp. 208–250.

  36. M. Vazirgianni and S. Boll, “Events in interactive multimedia applications: Modeling and implementation design,” in The Proceedings of IEEE International Conference on Multimedia Computing and Systems (ICMCS'97), Ottawa, Canada, June 1997.

  37. M. Vazirgiannis and M. Hatzopoulos, “A script based approach for interactive multimedia applications,” in Proc. of the MMM (International Conference of Multi-Media Modeling) Conference, Singapore, 1993, pp. 80–89.

  38. M. Vazirgiannis and C. Mourlas, “An object oriented model for interactive multimedia applications,” The Computer Journal, British Computer Society, Vol. 36, No. 1, 1/1993.

  39. M. Vazirgiannis and T. Sellis, “Event and action representation and composition for multimedia application scenario modelling,” in The Procedings of ERCIMWorkshop on Interactive Distributed Multimedia Systems and Services, Berlin, 3/1996.

  40. M. Vazirgiannis, Y. Theodoridis, and T. Sellis, “Spatio temporal composition in multimedia applications,” in proceedings of the IEEE-ICSE’ 96 International Workshop on Multimedia Software Development, Berlin, 3/1996.

  41. M. Vazirgiannis, Y. Theodoridis, and T. Sellis, “Spatiotemporal composition and indexing for large multimedia applications,” ACM/Springer-Verlag Multimedia Systems Journal, Vol. 6, No. 4, pp. 284–298, 1997.

    Google Scholar 

  42. T. Wahl and K. Rothermel, “Representing time in multimedia systems,” in Proc. of IEEE Conference on Multimedia Computing and Systems, Boston, MA, 1994, pp. 538–543.

  43. T. Wahl, S. Wirag, and K. Rothermel, “TIEMPO: Temporal modelling and Authoring of Interactive Multimedia,” in Proc. IEEE Int. Conference on Multimedia Computing and Systems, Washington, D.C., 1995, pp. 274–277.

  44. Jin Yu, Yuanyuan Xiang, “Hypermedia presentation and authoring system,” in Proceedings of the 6th International World Wide Web Conference, April 1997, pp. 153–164.

Download references

Author information

Authors and Affiliations

  1. Department of Informatics, Athens Economic and Bussiness University, Patision 76, 10434, Athens, Greece

    M. Vazirgiannis

  2. Department of Informatics, University of Athens, TYPA buildings, University Campus, 15771 Ilisia, Athens, Greece

    D. Tsirikos, Th. Markousis, M. Trafalis, Y. Stamati & M. Hatzopoulos

  3. Computer Science Division, Department of Electrical and Computer Engineering, National Technical University of Athens, 15773 Zographou, Athens, Greece

    T. Sellis

Authors
  1. M. Vazirgiannis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. D. Tsirikos
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Th. Markousis
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. M. Trafalis
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Y. Stamati
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. M. Hatzopoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. T. Sellis
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Vazirgiannis, M., Tsirikos, D., Markousis, T. et al. Interactive Multimedia Documents: A Modeling, Authoring and Rendering Approach. Multimedia Tools and Applications 12, 145–188 (2000). https://doi.org/10.1023/A:1009615607646

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1009615607646

Search

Navigation