Abstract
This paper describes a real-time vision system that enhances the teleoperation of a servicing tool used in the heat exchangers of nuclear power plants. The vision system is used to track the position of the tool as it moves over a sheet of tube ends. A map-based strategy is adopted for the estimation of the position. The system incorporates a novel method for a foreshortening correction that is applied prior to map referencing. A hypothesize and verify scheme locates two image features that correspond to two map features. An efficient scheme for extracting image features is developed to locate these two features (tube-end centers) in the image. Two different types of heat-exchanger tube sheets are accounted for. They are those with tube ends placed in a square grid and those with tube ends placed in a triangular grid. The map-based strategy minimizes the cumulative errors in the estimate of the tool head position. The resulting low-cost system has been tested on synthetic and real data. Performance results are given.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aggarwal JK, Nandhakumar N (1988) On the computation of motion from sequences of images — a review. Proc IEEE 76:917–935
Duda RO, Hart PE (1973) Pattern Classification and Scene Analysis. John Wiley and Sons, New York
Ganapathy S (1984) Decomposition of transformation matrices for robot vision. Proc International Conference on Robotics and Automation, pp 130–139
Gonzalez RC, Woods RE (1992) Digital Image Processing. Addison Wesley, Reading, Mass.
Haralick RM, Shapiro LG (1992) Computer and Robot Vision, Addison Wesley, Reading, Mass.
Lenz RK, Tsai RY (1988) Techniques for calibration of the scale factor and image center for high accuracy 3-D machine vision metrology. IEEE Trans Pattern Analysis Machine Intelligence, vol. 10:713–720
Martin WN, Aggarwal JK (1988) Motion understanding, robot and human vision, Kluwer Academic, Boston, Mass.
Moerdler ML, Boult TE (1988) The integration of information from stereo and multiple shape-from-texture cues. Proc DARPA Image Understanding Workshop, Cambridge, Mass., pp 786–793
Moerdler ML, Kender JR (1987) An approach to the fusion of multiple shape from texture algorithms. Proc AAAI Workshop on Spatial Reasoning and Multi-sensor Fusion, St. Charles, 111., pp 272–281
Strat TM (1984) Recovering the camera parameters from a transformation matrix. Proc DARPA Image Understanding Workshop, pp 264–271
Sutherland I (1974) Three-dimensional data input by tablet. Proc IEEE 62:453–461
Tsai RY (1987) A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV camera and lenses. IEEE J Robotics Automation 3:323–344
Wang LL, Tsai WH (1991) Camera calibration by vanishing lines for 3-D computer vision. IEEE Trans Pattern Analysis Machine Intelligence 13:370–376
Wei GQ, Ma SD (1991) Two plane camera calibration: a unified model. IEEE Conference on Computer Vision and Pattern Recognition, pp 133–138
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Brem, L., Nandhakumar, N. A machine vision system for enhancing the teleoperation of an industrial robot. Machine Vis. Apps. 7, 187–198 (1994). https://doi.org/10.1007/BF01211663
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01211663