Skip to main content

Representation of Behavioral Knowledge for Planning and Plan-Recognition in a Cognitive Vision System

  • Conference paper
  • First Online:
KI 2002: Advances in Artificial Intelligence (KI 2002)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2479))

Included in the following conference series:

Abstract

The algorithmic generation of textual descriptions of image sequences requires conceptual knowledge. In our case, a stationary camera recorded image sequences of road traffic scenes. The necessary conceptual knowledge has been provided in the form of a so-called Situation Graph Tree (SGT). Other endeavors such as the generation of a synthetic image sequence from a textual description or the transformation of machine vision results for use in a driver assistance system could profit from the exploitation of the same conceptual knowledge, but more in a planning (pre-scriptive) rather than a de-scriptive context.

A recently discussed planning formalism, Hierarchical Task Networks (HTNs), exhibits a number of formal similarities with SGTs. These suggest to investigate whether and to which extent SGTs may be re-cast as HTNs in order to re-use the conceptual knowledge about the behavior of vehicles in road traffic scenes for planning purposes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. K. Erol, J. Hendler and D. S. Nau: UMCP: A Sound and Complete Procedure for Hierarchical Task-Network Planning. In: K. J. Hammond (Ed.): Proc. of the 2nd Int. Conf. on Artificial Intelligence Planning Systems (AIPS-94), June 13–15, 1994, University of Chicago, Chicago, Illinois, 1994, pp. 249–254.

    Google Scholar 

  2. K. Erol, J. Hendler and D. S. Nau: HTN Planning: Complexity and Expressivity. Proc. of the 12th National Conf. on Artificial Intelligence (AAAI-1994), Volume 2. Seattle, Washington, USA, July 31-August 4, 1994. AAAI Press, 1994, pp. 1123–1128.

    Google Scholar 

  3. K. Erol, J. Hendler and D. S. Nau: Complexity Results for HTN Planning. Annals of Mathematics and Artificial Intelligence 18:1 (1996) 69–93.

    Article  MATH  MathSciNet  Google Scholar 

  4. R. E. Fikes and N. J. Nilsson: STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving. Artificial Intelligence 2 (1971) 189–208.

    Article  MATH  Google Scholar 

  5. K. Fleischer and H.-H. Nagel: Machine-Vision-Based Detection and Tracking of Stationary Infrastructural Objects Beside Innercity Roads. In: Proc. of the IEEE Intelligent Transportation Systems Conf. (ITSC), August 25–29, 2001, Oakland, CA, USA, pp. 525–530.

    Google Scholar 

  6. K. Fleischer, H.-H. Nagel, and T. M. Rath: 3D-Model-Based-Vision for Innercity Driving Scenes. In: Proc. of the IEEE Intelligent Vehicle Symposium (IV-2002) June 18-20, 2002, Versailles, France.

    Google Scholar 

  7. R. Gerber: Natürlichsprachliche Beschreibung von Straβenverkehrsszenen durch Bildfolgenauswertung. Dissertation, Fakultät für Informatik der Universität Karlsruhe (TH), Karlsruhe, Januar 2000; erschienen im elektronischen Volltextarchiv der Universität Karlsruhe, http://www.ubka.uni-karlsruhe.de/cgi-bin/psview?document=2000/informatik/8 (in German).

    Google Scholar 

  8. M. Haag: Bildfolgenauswertung zur Erkennung der Absichten von Straβenverkehrsteilnehmern. Dissertation, Fakultät für Informatik der Universität Karlsruhe (TH), Karlsruhe, Juli 1998; erschienen in der Reihe Dissertationen zur Künstlichen Intelligenz (DISKI) 193; infix-Verlag Sankt Augustin 1998 (in German).

    Google Scholar 

  9. M. Haag and H.-H. Nagel: Incremental Recognition of Traffic Situations from Video Image Sequences. Image and Vision Computing 18:2 (2000) 137–153.

    Article  Google Scholar 

  10. R. J. Howarth and H. Buxton: Conceptual Descriptions from Monitoring and Watching Image Sequences. Image and Vision Computing 18:2 (2000) 105–136.

    Article  Google Scholar 

  11. S. Kambhampati: A Comparative analysis of Partial Order Planning and Task Reduction Planning SIGART Bulletin 6:1 (1995) 16–25.

    Article  MathSciNet  Google Scholar 

  12. H. Kautz, D. McAllester, and B. Selman: Encoding Plans in Propositional Logic. In: L. C. Aiello, J. Doyle, and S. C. Shapiro (Eds.): Proc. of the 5th Int. Conf. on Principles of Knowledge Representation and Reasoning (KR’96), Cambridge, Massachusetts, USA, 1996; Morgan Kaufman, San Mateo, CA, USA 1996, pp. 374–384.

    Google Scholar 

  13. A. D. Mali and S. Kambhampati: Encoding HTN Planning in Propositional Logic. In: R. G. Simmons, M. M. Veloso, and S. Smith (Eds.): Proc. of the 4th Int. Conf. on Artifical Intelligence Planning Systems (AIPS-98), Pittburgh, Pennsylvania, USA, 1998; AAAI-Press, 1998, pp. 190–198.

    Google Scholar 

  14. D. S. Nau, Y. Cao, A. Lotem, and H. Muñoz-Avila: SHOP: Simple Hierarchical Order Planner. In: Th. Dean (Ed.): Proc. of the 16th Int. Joint Conf. on Artificial Intelligence (IJCAI-99), Stockholm, Sweden, July 31-August 6, 1999; Morgan Kaufmann, San Mateo, CA, USA 1999, pp. 968–973.

    Google Scholar 

  15. D. S. Nau, H. Muñoz-Avila, Y. Cao, A. Lotem, and S. Mitchell: Total-Order Planning with Partially Ordered Subtasks. In: B. Nebel (Ed.): Proc. of the 17th Int. Joint Conf. on Artificial Intelligence (IJCAI-2001), Seattle, Washington, USA, August 4–10, 2001; Morgan Kaufman, San Mateo, CA, USA 2001, pp. 425–430.

    Google Scholar 

  16. H.-H. Nagel: From Image Sequences towards Conceptual Descriptions. Image and Vision Computing 6:2 (1988) 59–74.

    Article  Google Scholar 

  17. H.-H. Nagel, M. Haag, V. Jeyakumar, and A. Mukerjee: Visualization of Conceptual Descriptions Derived from Image Sequences. Mustererkennung 1999, 21. DAGM-Symposium, Bonn, 15.–17. September 1999, Springer-Verlag, Berlin, Heidelberg, u.a. 1999, pp. 364–371.

    Google Scholar 

  18. H.-H. Nagel: Natural Language Description of Image Sequences as a Form of Knowledge Representation. In: W. Burgard, T. Christaller, and A. B Cremers (Eds.): Proc. of the 23rd Annual German Conf. on Artificial Intelligence (KI-99), Bonn, Germany, September 13–15, 1999, LNCS 1701, Springer-Verlag, Berlin, Heidelberg, u.a. 1999, pp. 45–60.

    Google Scholar 

  19. J. Pearl: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufman, San Mateo, CA, USA 1988.

    Google Scholar 

  20. S. Russel and P. Norvig: Artificial Intelligence: A Modern Approach. Prentice Hall, Upper Saddle River, New Jersey, USA, 1995.

    Google Scholar 

  21. E. D. Sacerdoti: Planning in a Hierarchy of Abstraction Spaces. Artificial Intelligence 5 (1974) 115–135.

    Article  MATH  Google Scholar 

  22. K. H. Schäfer: Unscharfe zeitlogische Modellierung von Situationen und Handlungen in der Bildfolgenauswertung und Robotik. Dissertation, Fakultät für Informatik der Universität Karlsruhe (TH), Karlsruhe, Juli 1996; erschienen in der Reihe Dissertationen zur Künstlichen Intelligenz (DISKI) 135; infix-Verlag Sankt Augustin 1996 (in German).

    Google Scholar 

  23. G. Socher, G. Sagerer, and P. Perona: Bayesian reasoning on qualitative descriptions from images and speech. Image and Vision Computing 18:2 (2000) 155–172.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Arens, M., Nagel, HH. (2002). Representation of Behavioral Knowledge for Planning and Plan-Recognition in a Cognitive Vision System. In: Jarke, M., Lakemeyer, G., Koehler, J. (eds) KI 2002: Advances in Artificial Intelligence. KI 2002. Lecture Notes in Computer Science(), vol 2479. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45751-8_18

Download citation

  • DOI: https://doi.org/10.1007/3-540-45751-8_18

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-44185-4

  • Online ISBN: 978-3-540-45751-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics