Skip to main content
SpringerLink
Log in

Exploiting Context in Function-Based Reasoning

  • Conference paper
  • First Online:
Sensor Based Intelligent Robots

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2238))

Abstract

This paper presents the framework of the new context-based reasoning components of the GRUFF (Generic Recognition Using Form and Function) system. This is a generic object recognition system which reasons about and generates plans for understanding 3-D scenes of objects. A range image is generated from a stereo image pair and is provided as input to a multi-stage recognition system. A 3-D model of the scene, extracted from the range image, is processed to identify evidence of potential functionality directed by contextual cues. This recognition process considers the shape-suggested functionality by applying concepts of physics and causation to label an object’s potential functionality. The methodology for context-based reasoning relies on determining the significance of the accumulated functional evidence derived from the scene. For example, functional evidence for a chair or multiple chairs along with a table, in set configurations, is used to infer the existence of scene concepts such as “office” or “meeting room space.” Results of this work are presented for scene understanding derived from both simulated and real sensors positioned in typical office and meeting room environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Binford, T. O.: Survey of model-based image analysis systems, Int. J. of Robotics Research, 1, (1982) 18–64

    Article  Google Scholar 

  2. Bogoni, L. and Bajcsy, R.: Interactive Recognition and Representation of Functionality, Computer Vision and Image Understanding, special issue on Functionality in Object Recognition, Vol. 62, No. 2, (1995) 194–214

    Article  MATH  Google Scholar 

  3. Connell, J. H.: Get Me That Screwdriver! Developing a Sensory-action Vocabulary for Fetch-and-Carry Tasks, IBM Cyber Journal Research Report, RC 19473 (April 1994)

    Google Scholar 

  4. Cooper, P., Birnbaum, L., and Brand, E.: Causal Scene Understanding, Computer Vision and Image Understanding, special issue on Functionality in Object Recognition, Vol. 62, No. 2, (1995) 215–231

    Article  MATH  Google Scholar 

  5. Di Manzo, M., Trucco, E., Giunchiglia, F., Ricci, F.: FUR: Understanding FUnctional Reasoning, Int. J. of Intelligent Systems, 4, (1989) 431–457

    Article  Google Scholar 

  6. Doermann, D., Rivlin, E. and Rosenfeld, A.: The Function of Documents, Int. J. on Computer Vision, 16, (1998) 799–814

    Article  Google Scholar 

  7. Duric, Z., Fayman, J. A., and Rivlin, E.: Function from Motion, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18, No. 6, (1996) 579–591

    Article  Google Scholar 

  8. Fischler, M. A. and Strat, T. M.: Recognizing objects in a natural environment: a contextual vision system (CVS), Proceedings: Image Understanding Workshop, (May 1989) 774–788

    Google Scholar 

  9. Green, K., Eggert, D., Stark, L. and Bowyer, K.: Generic Recognition of Articulated Objects through Reasoning about Potential Function, Computer Vision and Image Understanding, special issue on Functionality in Object Recognition, Vol. 62, No. 2, (1995) 177–193

    Article  MATH  Google Scholar 

  10. Hodges, J.: Functional and Physical Object Characteristics and Object Recognition in Improvisation, Computer Vision and Image Understanding, special issue on Functionality in Object Recognition, Vol. 62, No. 2, (1995) 147–163

    Article  MATH  MathSciNet  Google Scholar 

  11. Hoogs, A. and Hackett, D.: Model-Supported Exploitation as a Framework for Image Understanding, Proceedings of the ARPA IU Workshop, (November 1994) 265–268

    Google Scholar 

  12. Hoover, A., Goldgof, D. and Bowyer, K. W.: Building a B-rep from a segmented range image, IEEE Second CAD-Based Vision Workshop, Champion, Pennsylvania (February 1994), 74–81

    Google Scholar 

  13. Jensen, F., Christensen, H. and Nielsen, J.: Bayesian Methods for Interpretation and Control in Multi-agent Vision Systems, in Proceedings of SPIE Conference on Application of AI X: Machine Vision and Robotics, Kevin W. Bowyer, editor, Vol. 1708, (1992) 536–548

    Google Scholar 

  14. Kim, D. and Nevatia, R.: A Method for Recognition and Localization of Generic Objects for Indoor Navigation, IEEE Workshop on Applications of Computer Vision, (1994), 280–288

    Google Scholar 

  15. Kise, K., Hattori, H., Kitahashi, T., and Fukunaga, K.: Representing and Recognizing Simple Hand-tools Based on Their Functions, Asian Conference on Computer Vision, Osaka, Japan (November, 1993), 656–659

    Google Scholar 

  16. Konolige, K., Beymer, D.: SRI small vision system user’s manual (software version 1.4). Stanford Research Institute. (December 1999)

    Google Scholar 

  17. Hanson, A. and Riseman, E.: The VISIONS Image-Understanding System Advances in Computer Vision (2 vols), Erlbaum, Vol. 1, (1988), 1–114

    Google Scholar 

  18. Stark, L., Hoover, A. W., Goldgof, D. B. and Bowyer, K. W.: Function-based object recognition from incomplete knowledge of object shape, IEEE Workshop on Qualitative Vision, New York (June 1993), 11–22

    Google Scholar 

  19. Minsky, M.: The Society of Mind, Simon and Shuster, New York, (1985)

    Google Scholar 

  20. Rivlin, E., Dickinson, S. and Rosenfeld, A.: Recognition by Functional Parts, Computer Vision and Image Understanding, special issue on Functionality in Object Recognition, Vol. 62, No. 2, (1995) 164–176

    Article  MATH  Google Scholar 

  21. Rivlin, E. and Rosenfeld, A.: Navigational Functionalities, Computer Vision and Image Understanding, special issue on Functionality in Object Recognition, Vol. 62, No. 2, (1995) 232–244

    Article  MATH  Google Scholar 

  22. Rivlin, E., Rosenfeld, A. and Perlis, D.: Recognition of Object Functionality in Goal-Directed Robotics, in Working Notes on Reasoning About Function, (1993) 126–130

    Google Scholar 

  23. Stark, L. and Bowyer, K.: Generic Object Recognition using Form and Function, Series in Machine Perception Artificial Intelligence, Vol. 10, World Scientific, New York, (1996)

    Google Scholar 

  24. Stark, L., and Bowyer, K. W.: Achieving generalized object recognition through reasoning about association of function to structure, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 3, No. 10, (1991) 1097–1104

    Article  Google Scholar 

  25. Stark, L., and Bowyer, K. W.: Indexing function-based categories for generic object recognition, Computer Vision and Pattern Recognition (CVPR’ 92), Champaign, Illinois (June 1992) 795–797

    Google Scholar 

  26. Stark, L. and Bowyer, K.: Function-based generic recognition for multiple object categories, CVGIP: Image Understanding, 59 (1), (January 1994) 1–21

    Article  Google Scholar 

  27. Stark, L., Hall, L. O. and Bowyer, K. W.: An investigation of methods of combining functional evidence for 3-D object recognition, International Journal of Pattern Recognition and Artificial Intelligence 7 (3), (June 1993) 573–594

    Article  Google Scholar 

  28. Stark, L., and Bowyer, K. W.: Functional Context in Vision, Proceedings of the Workshop on Context-Based Vision, Cambridge, Massachusetts, (1995) 63–74

    Google Scholar 

  29. Strat, T. M. and Fischler, M. A.: The Role of Context in Computer Vision, Proceedings of the Workshop on Context-Based Vision, Cambridge, Massachusetts, (1995) 2–12

    Google Scholar 

  30. Sutton, M., Stark, L., Bowyer, K. W.: Function from visual analysis and physical interaction: A methodology for recognition of generic classes of objects. Image and Vision Computing. 16 (11) (August 1998) 745–763

    Article  Google Scholar 

  31. Stansfield, R. A.: Robotic grasping of unknown objects: A knowledge-based approach, Int. Journal of Robotics Research, 10, (1991) 314–326

    Article  Google Scholar 

  32. Sutton, M., Stark, L. and Bowyer, K. W.: Function-based generic recognition for multiple object categories, in Three-dimensional Object Recognition Systems, A. K. Jain and P. J. Flynn, editors, Elsevier Science Publishers, (1993) 447–470

    Google Scholar 

  33. Weisbin, C. R., et al.: Autonomous mobile robot navigation and learning, IEEE Computer, Vol. 22, (1989) 29–35

    Google Scholar 

  34. Winston, P., Binford, T., Katz, B., and Lowry, M.: Learning Physical Description from Functional Deffinitions, Examples, and Precedents, AAAI’ 83 (1983) 433–439

    Google Scholar 

  35. Winston, P. and Rao, S.: Repairing learned knowledge using experience, in AI at MIT: Expanding Frontiers, P. H. Winston and S. A. Shellard, editors, MIT Press (1990) 363–379

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of West Florida, 32514, Pensacola, FL, USA

    Melanie A. Sutton

  2. University of the Pacific, 95211, Stockton, CA, USA

    Louise Stark & Ken Hughes

Authors
  1. Melanie A. Sutton
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Louise Stark
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ken Hughes
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, Johns Hopkins University, Baltimore

    Gregory D. Hager

  2. Center for Autonomous Systems, CVAP, Royal Institute of Technology, Sweden

    Henrik Iskov Christensen

  3. Department of Computer Science, University of Bern, German

    Horst Bunke

  4. Institute for Computer Science I, University of Bonn, USA

    Rolf Klein

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sutton, M.A., Stark, L., Hughes, K. (2002). Exploiting Context in Function-Based Reasoning. In: Hager, G.D., Christensen, H.I., Bunke, H., Klein, R. (eds) Sensor Based Intelligent Robots. Lecture Notes in Computer Science, vol 2238. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45993-6_20

Download citation

  • DOI: https://doi.org/10.1007/3-540-45993-6_20

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-43399-6

  • Online ISBN: 978-3-540-45993-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation