Abstract
This paper describes an approach to the problem of articulating multimedia information based on parsing and syntax-directed translation that uses Relational Grammars. This translation is followed by a constraint-solving mechanism to create the final layout. Grammatical rules provide the mechanism for mapping from a representation of the content and context of a presentation to forms that specify the media objects to be realized. These realization forms include sets of spatial and temporal constraints between elements of the presentation. Individual grammars encapsulate the “look and feel” of a presentation and can be used as generators of such a style. By making the grammars sensitive to the requirements of the output medium, parsing can introduce flexibility into the information realization process.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aho AV, Sethi R, Ullman JD (1986) Compilers: principles, techniques, and tools. Addison-Wesley, Reading
Allen J (1983) Maintaining knowledge about temporal intervals. Commun ACM 26:832–843
Andre E, Finkler W, Graf W, Rist T, Schauder A, Wahlster W (1993) WIP: the automatic synthesis of multimodal presentations. In: Maybury M (ed) Intelligent multimedia interfaces. AAAI Press/MIT Press, Cambridge, pp 75–93
Arens Y, Miller L, Shapiro S, Sondheimer N (1988) Automatic construction of user-interface displays. Proceedings of the American Association of Artificial Intelligence, St. Paul, Minn., pp 808–813
Brandenburg F (1989) On polynomial time graph grammars. In: Goos G, Hartmanis J (eds) STACS 88: 5th Annual Symposium on Theoretical Aspects of Computer Science, Lecture notes on computer science 294, Springer, Berlin Heidelberg New York, pp 227–236
Brandenburg F (1994) Designing graph drawings by layout graph grammars. In: Tamassia R, Tollis IG (eds) Graph drawing: DIMACS International Workshop, Lecture notes in computer science 894, Springer, Berlin Heidelberg New York, pp 416–427
Cypher A, (1993) Watch what I do: programming by demonstration. MIT Press, Cambridge, Mass
Feiner S (1988) A grid-based approach to automating display layout. Proceedings of Graphics Interface ’88, Edmonton, Canada pp 192–197
Feiner S, McKeown K (1993) Automating the generation of coordinated multimedia explanations. In: Maybury M (ed) Intelligent multimedia interfaces, AAAI Press/MIT Press, Cambridge, Mass., pp 117–138
Foley J, McMath C (1986) Dynamic process visualization, IEEE Comput Graph Appl 6:16–25
Foley J, Kim W, Kovacevic S, Murray K (1991) UIDE an intelligent user interface design environment. In: Sullivan J, Tyler S (eds) Architectures for intelligent interfaces: elements and prototypes, Addison-Wesley, Reading pp 339–384
Freeman-Benson B, Maloney J, Borning A (1990) An incremental constraint solver. Commun ACM 33:54–63
Helm R, Marriott K (1991) A declarative specification and semantics for visual languages. J Vis Lang Comput 2:311–331
Henkenius M (1993) Surface wiring. Popular mechanics 170:63–66
Hollan J, Hutchins E, Weitzman L (1984) Steamer: an interactive inspectable simulation-based training system. AI Magazine 5:15–28
Hurlburt A (1978) The grid. Van Nostrand Reinhold, New York
Karp P, Feiner S (1990) Issues in the automated generation of animated presentations. Proceedings of Graphics Interface, Halifax, Canada, Canadian Information Processing Society, Toronto, pp 39–48
Kim W, Foley J (1993) Providing high-level control and expert assistance in the user interface presentation design. Proceedings of INTERCHI’93, Amsterdam, The Netherlands, Association for Computing Machinery Press, New York, pp 430–437
Knuth DE (1968) Semantics of context-free languages. Math Syst Theor 2:127–146
Kochhar S, Friedell M (1990) User control in cooperative computeraided design. Symposium on User Interface Software and Technology, Snowbird, Utah, Association for Computing Machinery Press, New York, pp 143–151
Kochhar S, Marks J, Friedell M (1991) Interaction paradigms for human-computer cooperation in graphical-object modeling, Proceedings of Graphics Interface ’91, Calgary, Canada, Canadian Information Processing Society, Toronto, pp 180–191
Mackinlay J (1986) Automating the design of graphical presentations of relational information. ACM Trans on Graph 5:110–141
Maloney J (1991) Using constraints for user interface construction. PhD Dissertation, University of Washington, Technical Report 91-08-12, Seattle, Wash
Marks J (1990) A syntax and semantics for network diagrams. Proceedings of the IEEE Workshop on Visual Languages, Skokie, Ill., IEEE Computer Society Press, Los Alamitos, CA, pp 104–110
Maybury M (1993) Intelligent multimedia interfaces, AAAI Press/MIT Press, Cambridge, Mass
Mitchell W, Steadman J, Liggett R (1976) Synthesis and optimization of small rectangular floor plans. Environment and Planning B: Planning and Design 3:37–70
National Center for Supercomputing Applications (NCSA) (1993) Internet manuscript, mosaic@ncsa.uiuc.edu
Oxman R, Gero J (1987) Using an expert system for design diagnosis and design synthesis. Expert Systems 4:4–15
Rosenfeld A (1990) Array, tree, and graph grammars. In: Bunke H, Sanfeliu A (eds) Syntactic and structural pattern recognition: theory and applications, World Scientific, Singapore
Rosenstein M, Weitzman L (1990) Icon Editor: the specification of graphic behavior without coding. Proceedings of the 23rd Annual Hawaii International Conference on Systems Sciences, Kailua-Kona, Hawaii, IEEE Computer Society Press, Los Alamitos, CA, pp 523–530
Seligmann D, Feiner S (1991) Automated generation of intent-based 3D illustrations. Proceedings of ACM Siggraph Las Vegas, Association for Computing Machinery Press, New York, pp 123–132
Scientific American (1992) Special issue on Mind and brain 267:4
Weitzman L (1995) Architecture of information: interpretation and presentation of information in dynamic environments. PhD dissertation, MIT Media Laboratory, Cambridge, Mass
Weitzman L, Wittenburg K (1993) Relational grammars for inter-active design. IEEE Symposium on Visual Languages, Bergen, Norway, IEEE Computer Society Press, Los Alamitos, CA, pp 4–11
Weitzman L, Wittenburg K (1994) Automatic presentation of multimedia documents using relational grammars. ACM Multimedia’94, San Francisco, Calif., Association for Computing Machinery Press, New York, pp 443–451
Wiecha C, Bennett W, Boies S, Gould J, Greene S (1990) ITS: a tool for rapidly developing interactive applications. ACM Trans Inform Syst 8:204–236 Wired (1994)
Wired (1994) 2.01:13
Wired WWW Server. http://www.wired.com
Wittenburg K (1992) Earley-style parsing for relational grammars. Proceedings of IEEE Workshop on Visual Languages, Seattle, Wash., IEEE Computer Society Press, Los Alamitos, CA, pp 192–199
Wittenburg K (1993) Adventures in multidimensional parsing: cycles and disorders. Proceedings of the 3rd International Workshop on Parsing Technology, Tilburg, The Netherlands, and Durbuy, Belgium, Tilburg University, Tilburg, The Netherlands, pp 333–348
Wittenburg K (1996) Predictive parsing for unordered relational languages. In: Bunt H, Tomita M (eds) Recent advances in parsing technologies. Kluwer Academic, Boston Dordrecht London
Wittenburg K, Weitzman L, Talley J (1991) Unification-based grammars and tabular parsing for graphical languages. J Vis Lang Comput 2:347–370
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Weitzman, L., Wittenburg, K. Grammar-based articulation for multimedia document design. Multimedia Systems 4, 99–111 (1996). https://doi.org/10.1007/s005300050015
Issue Date:
DOI: https://doi.org/10.1007/s005300050015