Skip to main content

An Architecture for Problem Solving with Diagrams

  • Conference paper
Diagrammatic Representation and Inference (Diagrams 2004)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2980))

Included in the following conference series:

Abstract

In problem solving a goal/subgoal is either solved by generating needed information from current information, or further decomposed into additional subgoals. In traditional problem solving, goals, knowledge, and problem states are all modeled as expressions composed of symbolic predicates, and information generation is modeled as rule application based on matching of symbols. In problem solving with diagrams on the other hand, an additional means of generating information is available, viz., by visual perception on diagrams. A subgoal is solved opportunistically by whichever way of generating information is successful. Diagrams are especially effective because certain types of information that is entailed by given information is explicitly available – as emergent objects and emergent relations – for pickup by visual perception. We add to the traditional problem solving architecture a component for representing the diagram as a configuration of diagrammatic objects of three basic types, point, curve and region; a set of perceptual routines that recognize emergent objects and evaluate a set of generic spatial relations between objects; and a set of action routines that create or modify the diagram. We discuss how domain-specific capabilities can be added on top of the generic capabilities of the diagram system. The working of the architecture is illustrated by means of an application scenario.

This paper was prepared through participation in the Advanced Decision Architectures Collaborative Technology Alliance sponsored by the U.S. Army Research Laboratory under Cooperative Agreement DAAD19-01-2-0009.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Newell, A.: Unified Theories of Cognition. Harvard University Press, Cambridge (1990)

    Google Scholar 

  2. Lindsay, R.: Imagery and Inference. In: Glasgow, J., Narayanan, N.H., Chandrasekaran, B. (eds.) Diagrammatic Reasoning: Cognitive and Computational Perspectives, pp. 111–136. AAAI Press/MIT Press, MenloPark, CA (1995)

    Google Scholar 

  3. Marr, D., Nishihara, H.K.: Representation and Recognition of the Spatial Organization of Three Dimensional Shapes. In: Proceedings of the Royal Society, p. 200, 269–294 (1978)

    Google Scholar 

  4. Ullman, S.: Visual routines. Cognition 18, 97–159 (1984)

    Article  Google Scholar 

  5. Lindsay, R.K.: Using diagrams to understand geometry. Computational Intelligence 14(2), 238–272 (1998)

    Article  Google Scholar 

  6. Chandrasekaran, B.: Diagrammatic Representation and Reasoning: Some Distinctions. In: AAAI Fall 1997 Symposium Series, Diagrammatic Reasoning. American Association for Artificial Intelligence, Boston, MA (1997)

    Google Scholar 

  7. Koedinger, K.R., Anderson, J.R.: Abstract Planning and Perceptual Chunks: Elements of expertise in geometry. Cognitive Science 14, 511–550 (1990)

    Article  Google Scholar 

  8. Narayanan, N.H., Suwa, M., Motoda, H.: Hypothesizing behaviors from device diagrams. In: Glasgow, N., Narayanan, N.H., Chandrasekaran, B. (eds.) Diagrammatic Reasoning: Cognitive and Computational Perspectives, pp. 501–534. The MIT Press, Cambridge (1995)

    Google Scholar 

  9. Ferguson, R.W., Forbus, K.D.: GeoRep: A flexible tool for spatial representation of line drawings. In: Proc. 18th National Conference on Artificial Intelligence, pp. 510–516. AAAI Press, Austin (2000)

    Google Scholar 

  10. Pineda, L.: Grafiog: a Theory of Semantics for Graphics with Applications to Human-Computer Interaction and CAD Systems, Ph. D. Thesis, University of Edinburgh: Edinburgh, UK. p. 197+vii (1989)

    Google Scholar 

  11. Barwise, J., Etchemendy, J.: Heterogeneous Logic. In: Allwein, G., Barwise, J. (eds.) Logical Reasoning with Diagrams, pp. 179–200. Oxford University Press, New York (1996)

    Google Scholar 

  12. Anderson, M., Andersen, B.: Heterogeneous Data Querying in a Diagrammatic Information System. In: Hegarty, M., Meyer, B., Narayanan, N.H. (eds.) Diagrammatic Representation and Inference, pp. 109–111. Springer, New York (2002)

    Chapter  Google Scholar 

  13. Anderson, J.R., Lebiere, C.J.: The Atomic Components of Thought. Lawrence Erlbaum Associates, Mahwah (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chandrasekaran, B., Kurup, U., Banerjee, B., Josephson, J.R., Winkler, R. (2004). An Architecture for Problem Solving with Diagrams. In: Blackwell, A.F., Marriott, K., Shimojima, A. (eds) Diagrammatic Representation and Inference. Diagrams 2004. Lecture Notes in Computer Science(), vol 2980. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-25931-2_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-25931-2_16

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-21268-3

  • Online ISBN: 978-3-540-25931-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics