Abstract
Language visualisation consists of using consistent and systematic mappings between language expressions and graphical forms, where the graphical forms constitute or convey the meaning of the expressions. Primitive-based applications are described for both natural and artificial language (story visualisation and program visualisation, respectively). On the basis of these and other applications some foundational concepts are identified in a bottom-up theory of visualisation. A universal visualisation system architecture is proposed, as is a basic visual object taxonomy for classifying any visualisation object. Also, preliminary steps are taken towards constructing a top-down theory.
Similar content being viewed by others
References
Al-Asady, R. & Narayanan, A. (1993). More Notes on ‘A Clash of Intuitions’. In Proceedings ofThe 13th International Joint Conference on Artificial Intelligence (IJCAI93), 682–687.
Balbiani, P. & del Cerro, L. F. (1992). A Tableaux-Based Engine for Geometrical Reasoning. In Aurnague, M., Borillo, A., M. B. & Byas, M. (eds.)Semantics of Time, Space, Movement and Spatio-Temporal Reasoning, 407–418. Groupe LRC Toulouse. Working papers of the 4th International Workshop.
Beardon, C. (1992). CD-Icon: An Iconic Language Based on Conceptual Dependency.Intelligent Tutoring Media 3(4): 111–116.
Beardon, C. (1995). Discourse Structures in Iconic Communication.Artificial Intelligence Review 9(2–3), 189–203 (this volume).
Buschbeck-Wolf, B. (1992). A Semantic Approach to the Translation of Locative Prepositions. In Aurnague, M., Borillo, A., M. B. & Byas, M. (eds.)Semantics of Time, Space, Movement and Spatio-Temporal Reasoning, 53–67. Group LRC Toulouse. Working papers of the 4th International Workshop.
Cai, W., Pian, T. L. & Turner, S. J. (1994). A Framework for Visual Parallel Programming. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 288.
Cox, K. C. & Roman, G. C. (1994). A Characterization of the Computational Power of Rule-Based Visualization.Journal of Visual Languages and Computing 5(1): 5–28.
Davis, M. (1994). Knowledge Representation for Video. In Proceedings ofThe 12th National Conference on Artificial Intelligence (AAAI-94), 120–127. American Association for Artificial Intelligence.
Ford, L. (1993a). Automatic Software Visualization Using Visual arts Techniques. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 279.
Ford, L. (1993b). Goofy Animation System. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 266.
Ford, L. (1993c). How Programmers Visualize Programs. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 271.
Ford, L. (1994). Interactive Learning and Researching with Visualization. In Franklin, S. D., Stubberud, A. R. & Wiedeman, L. (eds.)University Education Uses of Visualization in Scientific Computing (IFIP Transactions A-48). Elsevier Science.
Ford, L. & Tallis, D. (1993). Interactive Visual Abstractions of Programs. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 273.
Gapp, K.-P. & Maass, W. (1994). Spatial Layout Identification and Incremental Descriptions. InIntegration of Natural Language and Vision Processing: Workshop Notes, 145–132. American Association for Artificial Intelligence. AAAI-94 Workshop Program.
Herzog, G. (1992). Utilizing Interval-Based Event Representations for Incremental High-level Scene Analysis. In Aurnague, M., Borillo, A., M. B. & Byas, M. (eds.)Semantics of Time, Space, Movement and Spatio-Temporal Reasoning, 453–463. Group LRC Toulouse. Working papers of the 4th International Workshop.
Jayez, J. (1992). Some Problems About Hybrid Symbolic Representations Based on French Motion Verbs. In Aurnague, M., Borillo, A., M. B. & Byas, M. (eds.)Semantics of Time, Space, Movement and Spatio-Temporal Reasoning, 89–103. Groupe LRC Toulouse. Working papers of the 4th International Workshop.
Manuel, D. (1994). The Use of Art Media Techniques in Computer Visualizations and the Creation of Partially Automated Visualization Systems. Master's thesis, University of Exeter Department of Computer Science, Exeter, EX4 4PT, UK.
Mc Kevitt, P. (1994). Visions for Language. InIntegration of Natural Language and Vision Processing: Workshop Notes, 47–57. American Association for Artificial Intelligence. AAAI-94 Workshop Program.
Narayanan, A., Ford, L., Manuel, D., Tallis, D. & Yazdani, M. (1994). Animating Language. InIntegration of Natural Language and Vision Processing: Workshop Notes, 58–65. American Association for Artificial Intelligence. AAAI-94 Workshop Program.
Narayanan, A. & Hashem, L. (1993). On Abstract Finite State Morphology. In Proceedings ofThe 6th Conference of the European Chapter of the Association for Computational Linguistics (EACL93), 297–304. Available through anony-mous ftp (atlas.ex.ac.uk), Report 272.
Narayanan, A. & Hashem, L. (1994). Finite State Abstractions on Arabic Morphology.Artificial Intelligence Review 7(6): 373–400.
Ó Nualláin, S., Farley, B. & Smith, A. G. (1994). The Spoken Image System: On the Visual Interpretation of Verbal Scene Descriptions. InIntegration of Natural Language and Vision Processing: Workshop Notes, 36–39. American Association for Artificial Intelligence. AAAI-94 Workshop Program.
Olivier, P., Maeda, T. & Tsujii, J.-I. (1994). Automatic Depiction of Spatial Descriptions. In Proceedings ofThe 12th National Conference on Artificial Intelligence (AAAI-94), 1405–1410. Association for Artificial Intelligence.
Olivier, P. & Tsujii, J.-I. (1994). Prepositional Semantics in the WIP System. InIntegration of Natural Language and Vision Processing: Workshop Notes, 139–144. American Association for Artificial Intelligence. AAAI-94 Workshop Program.
Price, B. A., Baeker, R. M. & Small, I. S. (1993). A Principled Taxonomy of Software Visualization.Journal of Visual Languages and Computing 4(3): 211–266.
Rajagopalan, R. (1994). Integrating Text with Graphical Imput to a Knowledge Base. InIntegration of Natural Language and Vision Processing: Workshop Notes, 14–21. American Association for Artificial Intelligence. AAAI-94 Workshop Program.
Reyero-Sans, I. & Tsujii, J.-I. (1994). A Cognitive Approach to an Interlingua Representation of Spatial Descriptions. InIntegration of Natural Language and Vision Processing: Workshop Notes, 122–130. American Association for Artificial Intelligence. AAAI-94 Workshop Program.
Sablayrolles, P. (1992). Spatio-Temporal Semantics in Natural language: The Case of Motion. In Aurnague, M., Borillo, A., M. B. & Byas, M. (eds.)Semantics of Time, Space, Movement and Spatio-Temporal Reasoning, 69–87. Groupe LRC Toulouse. Working papers of the 4th International Workshop.
Schank, R. C. (1972). Conceptual Dependency: A Theory of Natural Language Understanding.Cognitive Psychology 3: 552–631.
Schank, R. C. & Abelson, R. P. (1977).Scripts, Plans, Goals and Understanding. Lawrence Erlbaum.
Sharkey, N. E., Jackson, S. A. & Partridge, D. (1994). Internal Report for Connectionists Technical report, Department of Computer Science, University of Exeter, Exeter EX4 4PT, UK. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 312.
Strassmann, S. (1994). Semi-Autonomous Animated Actors. In Proceedings ofThe 12th National Conference on Artificial Intelligence (AAAI-94), 128–134. American Association for Artificial Intelligence.
Turner, S. J. & Cai, W. (1992). The ‘Logical Clocks’ Approach to Visualization of Parallel Programs. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 252.
Yazdani, M. (1991). LINGERing On: Steps Towards an ‘Intelligent’ Language Tutoring Environment. In Thompson, J. & Zähner, C. (eds.)Proceedings of the ICALL Workshop. CTI Centre for Modern Languages, University of Hull. Workshop held at UMIST.
Yazdani, M. & Mealing, S. (1995). Communicating Through Pictures.Artificial Intelligence Review 9(2–3): 205–213 (this volume).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Narayanan, A., Manuel, D., Ford, L. et al. Language visualisation: Applications and theoretical foundations of a primitive-based approach. Artif Intell Rev 9, 215–235 (1995). https://doi.org/10.1007/BF00849181
Issue Date:
DOI: https://doi.org/10.1007/BF00849181