Skip to main content
SpringerLink
Log in

Sensor Fusion and Planning with Perception–Action Network

  • Published:
Journal of Intelligent and Robotic Systems Aims and scope Submit manuscript

Abstract

Robot intelligence requires a real-time connection between sensing and action. A new computation principle of robotics that efficiently implements such a connection is utmost important for the new generation of robotics. In this paper, a perception–action network is presented as a means of efficiently integrating sensing, knowledge, and action for sensor fusion and planning. The network consists of a number of heterogeneous computational units, representing feature transformation and decision-making for action, which are interconnected as a dynamic system. New input stimuli to the network invoke the evolution of network states to a new equilibrium, through which a real-time integration of sensing, knowledge, and action can be accomplished. The network provides a formal, yet general and efficient, method of achieving sensor fusion and planning. This is because the uncertainties of signals, propagated in the network, can be controlled by modifying sensing parameters and robot actions. Algorithms for sensor planning based on the proposed network are established and applied to robot self-localization. Simulation and experimental results are shown.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ren, C. Luo, Min-Hsiung Lin, and Ralph S. Scherp: Dynamic multi-sensor data fusion system for intelligent robots, IEEE Journal of Robotics and Automation 4(4) (1988), 385–386.

    Google Scholar 

  2. Hans, P. Moravec: Sensor fusion in certainty grids for mobile robots, AI Magazine(1988), 61–74.

  3. Scott, W. Shaw, Rui J. P. deFigueiredo, and Kumar Krishen: Fusion of radar and optical sensors for space robot vision, in: The proceeding of IEEE Conference on Robotics and Automation, 1988.

  4. Tom Henderson and Esther Shilcrat: Logical sensor system, Journal of Robotic System 1(2) (1984), 169–193.

    Google Scholar 

  5. Huntsberger, T. L. and Jayaramamurthy, S. N.: A frame work for multi-sensor fusion in the presence of uncertainty, in: Proceeding of Spatial Reasoning and Multi-Sensor Fusion Workshop, 1987.

  6. Hugh, F. Durrant-Whyte: Sensor models and multi-sensor integration, IEEE Journal of Robotics and Automation, 1987.

  7. Fukunaga, H: Introduction to Statistical Pattern Recognition, Academic Press, 1972.

  8. Gelb, A. et al.: Applied Optimal Estimation, MIT Press, 1974.

  9. Lee, S. and Kil, R. M.: Bidirectional continuous associator based on Gaussian potential function network, in: IEEE International Joint Conference on Neutral Networks, 1989, Vol. 1, pp. 45–53.

    Google Scholar 

  10. Lee, S. and Kil, R. M.: Robot kinematic control based on bidirectional mapping neural network, in: IEEE International Joint Conference on Neutral Networks, 1990, Vol. 3, pp. 327–335.

    Google Scholar 

  11. Duran-White, H. F.: A Bayesian approach to optimal sensor placement, International Journal of Robotics Research 9(5) (1990), 70–88.

    Google Scholar 

  12. Crown, C. K. and Bergman, A.: Determinig the camera and light source location for a visual task, in: IEEE International Conference on Robotics and Automation, Scottsdale, USA, April 1989.

  13. Tarabanis, K., Tsai, R.Y., and Allen, P. K.: Automated sensor planning for roboric vision tasks, in: IEEE International Conference on Robotics and Automation, Sacramento, USA, 1991.

  14. Hutchinson, S. A., Cormwell, R. L., and Kak, A. C.: Planning Sensing Strategies in Robotics and Automation, Philadelphia, USA, April 1988, pp. 1068–1075.

  15. Bajcsy, R.: Active perception vs. passive perception, in: IEEE Workshop of Computer Vision: Representation and Control, Bellaire, MI, 1985.

  16. Lacroix, S., Grandjean, P., and Ghllab, M.: Perception planning for a multi-sensor interpretation machine, in: IEEE International Conference on Robotics and Automation, Nice, France, 1992.

  17. Hager, G. and Mintz, M.: Task-directed multisensor fusion, in: IEEE International Conference on Robotics and Automation, Scottsdale, AZ, 1989.

  18. Lee, S. and Zhao, X.: Sensor planning with hierarchically distributed perception net, in: IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Las Vegas, NV, Oct. 1994.

  19. Pugh, A.: Robot Sensors, Vol. 1, IFS, UK, 1986.

  20. Rodney Brooks: A Robust layered control system for a mobile robot, IEEE Journal of Robotics and Automation 2(1) (1986).

  21. James S. Albus: Brains, Behavior, and Robotics, BYTE Books, Peterborough, NH, 1981.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Jet Propulsion Laboratory, California Institute of Technology, Pasadena, California, 91109, U.S.A

    Sukhan Lee

  2. Depts. of EE-Systems and CS, University of Southern California, Los Angeles, CA, 90089-0781, U.S.A

    Sukhan Lee

Authors
  1. Sukhan Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lee, S. Sensor Fusion and Planning with Perception–Action Network. Journal of Intelligent and Robotic Systems 19, 271–298 (1997). https://doi.org/10.1023/A:1007933821405

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1007933821405

Search

Navigation