Skip to main content
Log in

Language visualisation: Applications and theoretical foundations of a primitive-based approach

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

Language visualisation consists of using consistent and systematic mappings between language expressions and graphical forms, where the graphical forms constitute or convey the meaning of the expressions. Primitive-based applications are described for both natural and artificial language (story visualisation and program visualisation, respectively). On the basis of these and other applications some foundational concepts are identified in a bottom-up theory of visualisation. A universal visualisation system architecture is proposed, as is a basic visual object taxonomy for classifying any visualisation object. Also, preliminary steps are taken towards constructing a top-down theory.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Al-Asady, R. & Narayanan, A. (1993). More Notes on ‘A Clash of Intuitions’. In Proceedings ofThe 13th International Joint Conference on Artificial Intelligence (IJCAI93), 682–687.

  • Balbiani, P. & del Cerro, L. F. (1992). A Tableaux-Based Engine for Geometrical Reasoning. In Aurnague, M., Borillo, A., M. B. & Byas, M. (eds.)Semantics of Time, Space, Movement and Spatio-Temporal Reasoning, 407–418. Groupe LRC Toulouse. Working papers of the 4th International Workshop.

  • Beardon, C. (1992). CD-Icon: An Iconic Language Based on Conceptual Dependency.Intelligent Tutoring Media 3(4): 111–116.

    Google Scholar 

  • Beardon, C. (1995). Discourse Structures in Iconic Communication.Artificial Intelligence Review 9(2–3), 189–203 (this volume).

    Google Scholar 

  • Buschbeck-Wolf, B. (1992). A Semantic Approach to the Translation of Locative Prepositions. In Aurnague, M., Borillo, A., M. B. & Byas, M. (eds.)Semantics of Time, Space, Movement and Spatio-Temporal Reasoning, 53–67. Group LRC Toulouse. Working papers of the 4th International Workshop.

  • Cai, W., Pian, T. L. & Turner, S. J. (1994). A Framework for Visual Parallel Programming. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 288.

  • Cox, K. C. & Roman, G. C. (1994). A Characterization of the Computational Power of Rule-Based Visualization.Journal of Visual Languages and Computing 5(1): 5–28.

    Google Scholar 

  • Davis, M. (1994). Knowledge Representation for Video. In Proceedings ofThe 12th National Conference on Artificial Intelligence (AAAI-94), 120–127. American Association for Artificial Intelligence.

  • Ford, L. (1993a). Automatic Software Visualization Using Visual arts Techniques. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 279.

  • Ford, L. (1993b). Goofy Animation System. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 266.

  • Ford, L. (1993c). How Programmers Visualize Programs. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 271.

  • Ford, L. (1994). Interactive Learning and Researching with Visualization. In Franklin, S. D., Stubberud, A. R. & Wiedeman, L. (eds.)University Education Uses of Visualization in Scientific Computing (IFIP Transactions A-48). Elsevier Science.

  • Ford, L. & Tallis, D. (1993). Interactive Visual Abstractions of Programs. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 273.

  • Gapp, K.-P. & Maass, W. (1994). Spatial Layout Identification and Incremental Descriptions. InIntegration of Natural Language and Vision Processing: Workshop Notes, 145–132. American Association for Artificial Intelligence. AAAI-94 Workshop Program.

  • Herzog, G. (1992). Utilizing Interval-Based Event Representations for Incremental High-level Scene Analysis. In Aurnague, M., Borillo, A., M. B. & Byas, M. (eds.)Semantics of Time, Space, Movement and Spatio-Temporal Reasoning, 453–463. Group LRC Toulouse. Working papers of the 4th International Workshop.

  • Jayez, J. (1992). Some Problems About Hybrid Symbolic Representations Based on French Motion Verbs. In Aurnague, M., Borillo, A., M. B. & Byas, M. (eds.)Semantics of Time, Space, Movement and Spatio-Temporal Reasoning, 89–103. Groupe LRC Toulouse. Working papers of the 4th International Workshop.

  • Manuel, D. (1994). The Use of Art Media Techniques in Computer Visualizations and the Creation of Partially Automated Visualization Systems. Master's thesis, University of Exeter Department of Computer Science, Exeter, EX4 4PT, UK.

  • Mc Kevitt, P. (1994). Visions for Language. InIntegration of Natural Language and Vision Processing: Workshop Notes, 47–57. American Association for Artificial Intelligence. AAAI-94 Workshop Program.

  • Narayanan, A., Ford, L., Manuel, D., Tallis, D. & Yazdani, M. (1994). Animating Language. InIntegration of Natural Language and Vision Processing: Workshop Notes, 58–65. American Association for Artificial Intelligence. AAAI-94 Workshop Program.

  • Narayanan, A. & Hashem, L. (1993). On Abstract Finite State Morphology. In Proceedings ofThe 6th Conference of the European Chapter of the Association for Computational Linguistics (EACL93), 297–304. Available through anony-mous ftp (atlas.ex.ac.uk), Report 272.

  • Narayanan, A. & Hashem, L. (1994). Finite State Abstractions on Arabic Morphology.Artificial Intelligence Review 7(6): 373–400.

    Google Scholar 

  • Ó Nualláin, S., Farley, B. & Smith, A. G. (1994). The Spoken Image System: On the Visual Interpretation of Verbal Scene Descriptions. InIntegration of Natural Language and Vision Processing: Workshop Notes, 36–39. American Association for Artificial Intelligence. AAAI-94 Workshop Program.

  • Olivier, P., Maeda, T. & Tsujii, J.-I. (1994). Automatic Depiction of Spatial Descriptions. In Proceedings ofThe 12th National Conference on Artificial Intelligence (AAAI-94), 1405–1410. Association for Artificial Intelligence.

  • Olivier, P. & Tsujii, J.-I. (1994). Prepositional Semantics in the WIP System. InIntegration of Natural Language and Vision Processing: Workshop Notes, 139–144. American Association for Artificial Intelligence. AAAI-94 Workshop Program.

  • Price, B. A., Baeker, R. M. & Small, I. S. (1993). A Principled Taxonomy of Software Visualization.Journal of Visual Languages and Computing 4(3): 211–266.

    Google Scholar 

  • Rajagopalan, R. (1994). Integrating Text with Graphical Imput to a Knowledge Base. InIntegration of Natural Language and Vision Processing: Workshop Notes, 14–21. American Association for Artificial Intelligence. AAAI-94 Workshop Program.

  • Reyero-Sans, I. & Tsujii, J.-I. (1994). A Cognitive Approach to an Interlingua Representation of Spatial Descriptions. InIntegration of Natural Language and Vision Processing: Workshop Notes, 122–130. American Association for Artificial Intelligence. AAAI-94 Workshop Program.

  • Sablayrolles, P. (1992). Spatio-Temporal Semantics in Natural language: The Case of Motion. In Aurnague, M., Borillo, A., M. B. & Byas, M. (eds.)Semantics of Time, Space, Movement and Spatio-Temporal Reasoning, 69–87. Groupe LRC Toulouse. Working papers of the 4th International Workshop.

  • Schank, R. C. (1972). Conceptual Dependency: A Theory of Natural Language Understanding.Cognitive Psychology 3: 552–631.

    Google Scholar 

  • Schank, R. C. & Abelson, R. P. (1977).Scripts, Plans, Goals and Understanding. Lawrence Erlbaum.

  • Sharkey, N. E., Jackson, S. A. & Partridge, D. (1994). Internal Report for Connectionists Technical report, Department of Computer Science, University of Exeter, Exeter EX4 4PT, UK. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 312.

  • Strassmann, S. (1994). Semi-Autonomous Animated Actors. In Proceedings ofThe 12th National Conference on Artificial Intelligence (AAAI-94), 128–134. American Association for Artificial Intelligence.

  • Turner, S. J. & Cai, W. (1992). The ‘Logical Clocks’ Approach to Visualization of Parallel Programs. Technical report, University of Exeter Department of Computer Science. Available through anonymous ftp (atlas.ex.ac.uk), Report Number 252.

  • Yazdani, M. (1991). LINGERing On: Steps Towards an ‘Intelligent’ Language Tutoring Environment. In Thompson, J. & Zähner, C. (eds.)Proceedings of the ICALL Workshop. CTI Centre for Modern Languages, University of Hull. Workshop held at UMIST.

  • Yazdani, M. & Mealing, S. (1995). Communicating Through Pictures.Artificial Intelligence Review 9(2–3): 205–213 (this volume).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Narayanan, A., Manuel, D., Ford, L. et al. Language visualisation: Applications and theoretical foundations of a primitive-based approach. Artif Intell Rev 9, 215–235 (1995). https://doi.org/10.1007/BF00849181

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00849181

Key words

Navigation