Skip to main content
SpringerLink
Log in

Multimedia layout adaptation through grammatical specifications

  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract.

Online multimedia presentations, such as news, need to be constantly updated. Increasing demands are also being made for accessing online multimedia documents from mobile devices such as PDAs. There is an urgent need for a sound but practical formalism that supports automatic adaptation to the change of media content, display environments, and user intention. This paper presents a visual language approach to the layout adaptation of multimedia objects. The underlying theory of our approach is a context-sensitive graph grammar formalism enriched with facilities for spatial representation and specification. The paper focuses on the issues and techniques for size adaptation and style adaptation in response to the change of device requirements and user interactions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Allen JF (1983) Maintaining knowledge about temporal intervals. Commun ACM 26(11):832-843

    Article  Google Scholar 

  2. Andre E, Finkler W, Graf W, Rist T, Schauder A, Wahlster W (1993) WIP: The automatic synthesis of multimodal presentations. In: MayBury M (ed) Intelligent multimedia interfaces. AAAI Press/MIT Press, Cambridge, MA, pp 75-93

  3. Bjork S, Redstrom J, Ljungstrand P, Holmquist LE (2000) PowerView - using information links and information views to navigate and visualize information on small displays. In: Proc. HUC’2000, pp 46-62

  4. Borning A, Lin RK, Marriott K (2000) Constraint-based document layout for the Web. Multimedia Syst 8:177-189

    Google Scholar 

  5. Bulterman DCA, Rutledge L (2004) SMIL 2.0 - interactive multimedia for Web and mobile devices. Springer, Berlin Heidelberg New York

  6. Burnett MM (2004) Visual language research bibliography. http://www.cs.orst.edu~burnett vpl.html

  7. Casanova M, Tucherman L, Lima M, Rodriguez N Soares L (1991) The nested context model for hyperdocuments. In: Proc. Hypertext, San Antonio, TX, pp 193-201

  8. Cruz IF, Lucas WT (1997) A visual approach to multimedia querying and presentation. In: Proc. ACM Multimedia’97, Seattle, November 1997, pp 8-14

  9. Di Battista G, Eades P, Tamassia R, Tollis IG (1999) Graph drawing: algorithms for the visualization of graphs. Prentice Hall, Englewood Cliffs, NJ

    Google Scholar 

  10. Feiner S, McKeown K (1993) Automating the generation of coordinated multimedia explanations. In: MayBury M (ed) Intelligent multimedia interfaces. AAAI Press/MIT Press, Cambridge, MA, pp 117-138

  11. Golin EJ (1991) A method for the specification and parsing of visual languages. Ph.D. thesis, Brown University, Providence, RI, May 1991

  12. Guan SU, Yu H-Y, Yang J-S (1998) A prioritized Petri Net model and its application in distributed multimedia systems. IEEE Trans Comput 47(4):477-481

    Google Scholar 

  13. Herman I, Melancon G, Marshall MS (2000) Graph visualization and navigation in information visualization. IEEE Trans Visual Comput Graph 6(1):24-43

    Google Scholar 

  14. Ishizaki S (2003) Improvisational design - continuous responsive design communication. MIT Press, Cambridge, MA

  15. Kaul M (1982) Parsing of graphs in linear time. In: Proc. 2nd international workshop on graph grammars and their application to computer science. Lecture notes in computer science, vol 153. Springer, Berlin Heidelberg New York, pp 206-218

  16. Kong J, Zhang K (2003) Spatial graph grammars for graphical user interfaces. Technical report, UTDCS-47-03, Computer Science Department, University of Texas at Dallas, October 2003

  17. Mankoff J, Abowd GD, Hudson SE (2000) OOPS: A toolkit supporting mediation techniques for resolving ambiguity in recognition-based interfaces. Comput Graph 24(6):819-834

    Google Scholar 

  18. Marriott K, Meyer B, Tardif L (2002) Fast and efficient client-side adaptability for SVG. In: Proc. WWW 2002, Hawaii, 7-11 May 2002, pp 496-507

  19. Minas M, Viehstaedt G (1993) Specification of diagram editors providing layout adjustment with minimal change. In: Proc. IEEE symposium on visual languages, pp 324-329

  20. Muchaluat DC, Rodrigues RF, Soares LFG (1998) WWW fisheye-view graphical browser. In: Proc. IEEE Multimedia Modeling

  21. Myers BA (1998) Authoring interactive behaviors for multimedia. In: Proc. 9th NEC research symposium, Nara, Japan, August-September 1998

  22. Pietriga E, Vion-Dury J-Y, Quint V (2001) VXT: A visual approach to XML transformations. ACM symposium on document engineering, Atlanta, GA, 9-10 November 2001, pp 1-10

  23. Pimental M, Abowd G, Ishiguro Y (2000) Linking by interacting: a paradigm for authoring hypertext and hypermedia. In: Proc. Hypertext 2000, Austin, TX, pp. 39-48

  24. Prabhakaran B (2000) Multimedia authoring and presentation techniques, guest editor’s introduction. Multimedia Syst 8:157

    Google Scholar 

  25. Rozenberg G, Welzl E (1986) Boundary NLC graph grammars - basic definitions, normal forms, and complexity. Inf Control 69:136-167

    Google Scholar 

  26. Rozenberg G (ed) (1997) Handbook on graph grammars and computing by graph transformation: foundations, vol 1. World Scientific, Singapore

    Google Scholar 

  27. Sarkar M, Brown MH (1994) Graphical fisheye views. Commun ACM 37(12):73-84

    Google Scholar 

  28. Six JM, Kakoulis KG, Tollis IG (2000) Techniques for the refinement of orthogonal graph drawings. J Graph Algor Appl 4(3):75-103

    Google Scholar 

  29. Soares LFG, Rodrigues RF, Saade DCM (2000) Modeling, authoring and formatting hypermedia documents in the HyperProp system. Multimedia Syst 8:118-134

    Google Scholar 

  30. Vazirgiannis M, Kostalas I, Sellis T (1999) Specifying and authoring multimedia scenarios. IEEE Multimedia, July-September 1999, pp 24-37

  31. Vazirgiannis M, Theodoridis Y, Sellis T (1998) Spatio-temporal composition and indexing for large multimedia applications. Multimedia Syst 6:284-298

    Article  Google Scholar 

  32. Weitzman L, Wittenburg K (1998) Grammar-based articulation for multimedia document design. In: Maybury MT, Wahlster W (eds) Readings in intelligent user interfaces. Morgan Kauffmann, San Francisco, CA, pp 310-327

  33. Wittenburg K, Weitzman L (1996) Relational Grammars: Theory and practice in a visual language interface for process modeling. In: Proc. AVI’96, Gubbio, Italy, 27-29 May 1996

  34. Wills LM (1992) Automated program recognition by graph parsing. Ph.D. thesis, MIT AI Lab, Cambridge, MA

  35. W3C (2001) Synchronized multimedia integration language (SMIL 2.0). http://www.w3.org TR 2001 REC-smil20-20010807/, August 2001

  36. W3C (2004) Cascading Style Sheets (CSS). http://www.w3.org Style CSS/

  37. W3C (1999) XSL Transformation (XSLT). http://www.w3.org TR xslt

  38. Zhang K, Zhang DQ, Cao J (2001) Design, construction and application of a generic visual language generation environment. IEEE Trans Softw Eng 27(4):289-307

    Google Scholar 

  39. Zhang DQ, Zhang K, Cao J (2001) A context-sensitive graph grammar formalism for the specification of visual languages. Comput J 44(3):186-200

    Google Scholar 

  40. Zhang K, Zhang DQ, Deng Y (2001) Graphical transformation of multimedia XML documents. Ann Softw Eng 12:119-137

    Google Scholar 

  41. Zhang KB, Zhang K (1999) An incremental approach to graph layout based on grid drawing. In: Proc. 3rd workshop on software visualization (SoftVis’99), University of Technology, Sydney, 3-4 December 1999

  42. Zhang KB, Zhang K, Orgun MA (2002) Grammar-based layout for a visual programming language generation system. In: Proc. 2nd international conference on the theory and application of diagrams (Diagrams’02), Atlanta, GA, 18-20 April 2002. Lecture notes in computer science, vol 2317. Springer, Berlin Heidelberg New York, pp 106-108

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, The University of Texas at Dallas, 75083-0688, Richardson, Texas, USA

    Kang Zhang, Jun Kong, Meikang Qiu & Guang-Lei Song

Authors
  1. Kang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jun Kong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Meikang Qiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Guang-Lei Song
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kang Zhang.

Additional information

Published online: 2 February 2005

Correspondence to: Kang Zhang

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, K., Kong, J., Qiu, M. et al. Multimedia layout adaptation through grammatical specifications. Multimedia Systems 10, 245–260 (2005). https://doi.org/10.1007/s00530-004-0155-2

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-004-0155-2

Keywords:

Search

Navigation