Abstract
The purpose of this paper is to give an overview of past and recent work on planning sensing strategies for vision sensors. To achieve an economic use of robots in manufacturing, their programs must provide a high degree of fault-tolerance, security, and robustness to prevent unforeseen errors. Model errors (also termed uncertainties) are one of the most frequent reasons for such undesirable events. Robot systems can be made more reliable and fault-tolerant by providing them with capabilities of error detection and recovery, or error prevention. The latter may be achieved by reducing model errors using tactile and non-tactile sensors.
The quality of a robot program synthesized by a task-level programming system depends on the accuracy of the model, since all information that is not explicitly given by the programmer must be derived from it. This means that the following questions have to be answered by the automatic task planner in order to plan non-tactile sensing strategies: (1) When do I have to use sensors to reduce uncertainty about the real world? (2) What do I have to use them for? (3) How do I have to use them to achieve the necessary information within an acceptable period of time?
There are very few systems which deal broadly with the problem of robust robot programs, whereas there are numerous works on detail aspects of the field. The main approaches will be introduced and discussed in more detail. Finally, a new concept for generating sensor-integrated robust robot programs will be proposed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aylett, J.C., Fisher, R.B., and Fothergill, A.P., Predictive computer vision for robotic assembly, J. Intelligent and Robotic Systems 1, 185–201 (1988).
Bolles, R.C., Verification vision for programmable assembly, Proc. 5th UJCAI, Vol.2, pp. 569–575 (1977).
Brooks, R.A., Symbolic error analysis and robot planning, Int. J. Robotics Res. 1, No. 4 (1982).
Cowan, C.K. and Bergman, A., Determining the camera and light source location for a visual task. Proc. 1989 IEEE Int. Conf. Robotics and Automation, pp. 509–514 (1989).
Donald, B.R., Error Detection and Recovery in Robotics, Lecture Notes in Computer Science, 336, Springer-Verlag, New York (1987).
Durrant-Whyte, H.F., Consistent integration and propagation of disparate sensor observations, Int. J. Robotics Res. 6, No. 3, 3–24 (1987).
Frommherz, B. and Werling, G., Specifying configurations of 3D-objects by a graphical definition of spatial relationships, in Artificial Intelligence in Engineering: Robotics and Processes (ed. J.S. Gero), Elsevier, Amsterdam, pp. 77–98 (1988).
Frommherz, B. and Werling, G., A graphical implicit programming system for robot action planning, Proc. Int. Conf. Intelligent Autonomous Systems 2, Amsterdam, pp. 196–207 (1989).
Gini, M., Symbolic and qualitative reasoning for error recovery in robot programs, in Languages for Sensorbased Control in Robotics (ed. U. Rembold and K. Hörmann), Springer-Verlag, New York (1986).
Grimson, W.E.L., Sensing strategies for disambiguating among multiple objects in known poses. IEEE Int. J. Robotics and Automation RA-2, No. 4, (1986).
Hardy, N.W., Barnes, D.P., and Lee, M.H., Declarative sensor knowledge in a robot monitoring system, in Languages for Sensorbased Control in Robotics (ed. U. Rembold and K. Hörmann), Springer-Verlag, New York, pp. 169–187.
Hutchinson, S.A., Cromwell, R.L., and Kak, A.C., Planning sensing strategies in a robot work cell with multi-sensor capabilities, Proc. Int. Conf. Robotics and Automation, Philadelphia, Pennsylvania (1988).
Hörmann, A., Meier, W., and Schoen, J., A control architecture for an advanced fault-tolerant robot system, Proc. Inf. Conf. Intelligent Autonomous Systems2, Amsterdam, pp. 576–585 (1989).
Lozano-Pérez, T. and Brooks, R.A., An approach to automatic robot programming, A.I. Memo No. 842, MIT (1985).
Lozano-Pérez, T., Robot programming, Proc. IEEE 71(7), 821–841 (1983).
Mazon, I. and Alami, R., Representation and propagation of positioning uncertainties through manipulation robot programs. Integration into task-level programming system, Proc. 1989 IEEE Int. Conf. Robotics and Automation (1989).
Mazon, I., Modelling positioning uncertainties, in Proc. Workshop Geometry and Robotics (ed. J.-D. Boissonat and J.-P. Laumond), Toulouse, France, Springer-Verlag, New York (1989).
Minsky, M., A framework for representing knowledge, Al Memo No. 306, MIT, 19xx.
Majumdar, J., Levi, P., and Rembold, U., 3D model based robot vision by matching scene description with the object model from a CAD modeller, Robotics and Autonomous Systems 5, 69–83 (1989).
Nnaji. B.O., A CAD-based schema for an assembly planning reasoner for CSG objects: RALPH, Internal Report of Automation and Robotics Laboratory, Dep. of Ind. Engineering and Operations Research, University of Massachusetts, Amherst, U.S.A. (1988).
Neumann, B., Wissensbasierte Konfigurierung von Bildverarbeitungsanlagen, in Mustererkennung, Informatik Fachberichte 125 (ed. G. Hartmann), Springer-Verlag, Heidelberg, pp. 206–218 (1986).
Popplestone, R.J. and Ambler, A.P., A language for specifying robot manipulations, DAI Research Paper No. 161, University of Edinburgh (1981).
Requicha, A.A.G., Toward a theory of geometric tolerancing, Int. J. Robotics Res. 2(4), 45–60 (1983).
Requicha, A.A.G., Solid modelling and its applications: progress in tolerancing, inspection, and feature recognition, Technical Report No. 259, 30 Nov. (1989).
Selke, K. and Pugh, A., Sensor-guided generic assembly, Proc. 6th Int. Conf. Robot Vision and Sensory Controls, Paris, pp. 11–20 (1986).
Smith, R.C. and Cheeseman, P., On the representation and estimation of spatial uncertainty, Int. J. Robotics Res. 5(4), 56–68 (1986).
Smithers, T. and Malcolm, C., A behavioural approach to robot task planning and off-line programming, Advanced Robotics Programme Workshop on Manipulators, Sensors and Steps Towards Mobility, Karlsruhe (1987).
Sakane, S., Sato, T., and Kakikura, M.: Model-based planning of visual sensors using a hand-eye action simulator system: HEAVEN, Proc. Third Int. Conf. on Advanced Robotics, Versailles (1987).
Sakane, S., Sato, T., Kakikura, M., Development of an active vision planning engine towards autonomous hand-eye coordination, Proc. 20th Int. Symp. Industrial Robots, Oct. 4–6, Tokyo, Japan (1989).
Taylor, R.H. and Rajan, V.T., The efficient computation of uncertainty spaces for sensor-based robot planning, Proc. 1988 IEEE Int. Workshop on Intelligent Robots and Systems (IROS '88), Tokyo, pp. 231–236 (1988).
Taylor, R.H., The synthesis of manipulator control programs from task-level specifications, PhD, Stanford University (1976).
Yin, B., Using vision data in an object-level robot language, Int. J. Robotics Res. 6(1), 43–58 (1987).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Werling, G. Planning of sensing tasks in an assembly environment. J Intell Robot Syst 4, 221–254 (1991). https://doi.org/10.1007/BF00303225
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00303225