Skip to main content

A Software Integration Framework for Cognitive Systems

  • Conference paper
Leveraging Applications of Formal Methods, Verification, and Validation (ISoLA 2011)

Abstract

Handling complex tasks with increasing levels of autonomy requires robotic systems to incorporate a large number of different functionalities at various levels of abstraction, such as localisation, navigation, object detection and tracking, human robot interaction including speech and gesture recognition as well as high level reasoning and planning. The interaction between functionalities in these cognitive robotics systems not only requires integration at a technical level but more importantly at an organisational and semantic level. Within this contribution, these cognitive functionalities are encapsulated in software components with the objective to provide clearly specified interfaces to allow reuse in other cognitive vision or robotics systems. To arrive at the level of building a system from these functionalities, it is considered essential to provide a framework that coordinates the components. Two principles organise the components: (1) the service principle uses a ”yellow pages” directory to announce its capabilities and to select other components, and (2) the hierarchy principle orders components along data abstraction from signal to symbolic levels and ascertains that system response is reactive. The proposed system is demonstrated in a context-oriented system for activity interpretation involving functionalities such as tracking, object and gesture recognition, spatio-temporal object relationships and reasoning to extract symbolic activity descriptions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Albus, J.S.: 4-D/RCS: A reference model architecture for Demo III. In: IEEE ISIC/CIRA/ISAS Joint Conf. (September 1998)

    Google Scholar 

  2. Arkin, R.C.: Behaviour based robotics. The MIT Press (1998)

    Google Scholar 

  3. Blum, S.: OSCAR - Eine Systemarchitektur für den autonomen, mobilen Roboter MARVIN. In: Autonome Mobile Systeme, Informatik Aktuell, pp. 218–230 (November 2000)

    Google Scholar 

  4. Crowley, J.L.: Integration and Control of Reactive Visual Processes. Robotics and Autonomous Systems 15(1) (1995)

    Google Scholar 

  5. Crowley, J., Christensen, H. (eds.): Vision as Process. Springer (1995)

    Google Scholar 

  6. University of surrey. Recognition and Vision Library (2003), http://ravl.sourceforge.net

  7. Fink, G.A., Jungclaus, N., Kummert, F., Ritter, H., Sagerer, G.: A distributed system for integrated speech and image understanding. In: International Symposium on Artificial Intelligence, Cancun, Mexico, pp. 117–126 (1996)

    Google Scholar 

  8. Klusch, M., Sycara, K.: Brokering and Matchmaking for Coordination of Agent Societies: A Survey. In: Omicini, A., et al. (eds.) Coordination of Internet Agents. Springer (2001)

    Google Scholar 

  9. Klusch, M., Bergamaschi, S., Edwards, P., Petta, P. (eds.): Intelligent Information Agents. LNCS (LNAI), vol. 2586. Springer, Heidelberg (2003)

    MATH  Google Scholar 

  10. Konstantinides, K., Rasure, J.R.: The Khoros software development environment for image and signal processing. IEEE Transactions on Image Processing 3(3), 243–252 (1994)

    Article  Google Scholar 

  11. Lindstöm, M., Orebäck, A., Christensen, H.: Berra: research architecture for service robots. In: IEEE ICRA, pp. 3278–3283 (2000)

    Google Scholar 

  12. Object Management Group (OMG). CORBAservices: Common Object Service Specification (March 1995)

    Google Scholar 

  13. Prouskas, K., Pitt, J.: A real-time architecture for time-aware agents. In: IEEE SMC (2003) (in press)

    Google Scholar 

  14. Schlegel, C., Wörz, R.: The Software Framework SmartSoft for Implementing Sensorimotor Systems. In: IEEE/RSJ IROS 1999, Kyongju, Korea, pp. 1610–1616 (October 1999)

    Google Scholar 

  15. Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., Ng, A.: Ros: an open-source Robot Operating System. In: ICRA Workshop on Open Source Software (2009)

    Google Scholar 

  16. Hawes, N., Wyatt, J.: Engineering Intelligent Information-Processing Systems with CAST. Advanced Engineering Infomatics 24(1), 27–29 (2010)

    Article  Google Scholar 

  17. Shoham, Y.: What we talk about when we talk about software agents. IEEE Intelligent Systems 14(2), 28–31 (1999)

    Article  Google Scholar 

  18. Ponweiser, W., Umgeher, G., Vincze, M.: A Reusable Dynamic Framework for Cognitive Vision Systems. In: Workshop on Computer Vision System Control Architectures at ICVS 2003, Graz, pp. 31–34 (2003)

    Google Scholar 

  19. Szyperski, C., Pfister, C.: Workshop on Component-Oriented Programming, Summary. In: Mühlhäuser M. (ed.) Special Issues in Object-Oriented Programming - ECOOP 1996 Workshop Reader. dpunkt Verlag, Heidelberg (1996)

    Google Scholar 

  20. Szyperski, C.: Component software. Addison Wesley, United Kingdom (1999)

    Google Scholar 

  21. Veryard, R.: Component-Based Business: Plug and Play. Springer (2001)

    Google Scholar 

  22. Vincze, M., Ayromlou, M., Ponweiser, W., Zillich, M.: Edge Projected Integration of Image and Model Cues for Robust Model-Based Object Tracking. Int. Journal of Robotics Research 20(7), 533–552 (2001)

    Article  Google Scholar 

  23. Wooldridge, M., Jennings, N.: Intelligent Agents: Theory and Practice. Knowledge Engineering Review 10(2) (1995)

    Google Scholar 

  24. Zillich, M., Matas, J.: Ellipse Detection using Efficient Grouping of Arc Segments. In: 27th Workshop of the Austrian Association of Pattern Recognition OAGM/AAPR, pp. 143–148 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zillich, M., Ponweiser, W., Vincze, M. (2012). A Software Integration Framework for Cognitive Systems. In: Hähnle, R., Knoop, J., Margaria, T., Schreiner, D., Steffen, B. (eds) Leveraging Applications of Formal Methods, Verification, and Validation. ISoLA 2011. Communications in Computer and Information Science, vol 336. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34781-8_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34781-8_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34780-1

  • Online ISBN: 978-3-642-34781-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics