Skip to main content
Log in

A Modular Scheme for Controller Design and Performance Evaluation in 3D Visual Servoing

  • Published:
Journal of Intelligent and Robotic Systems Aims and scope Submit manuscript

Abstract

In this paper we present a modular scheme for designing and evaluating different control systems for position based dynamic look and move visual servoing systems. This scheme is particularly applied to a 6 DOF industrial manipulator equipped with a camera mounted on its end effector. The manipulator with its actuators and its current feedback loops can be modeled as a Cartesian device commanded through a serial line. In this case the manipulator can be considered as a decoupled system with 6 independent loops. The use of computer vision as feedback transducer strongly affects the closed loop dynamics of the overall system, so that a visual controller is required for achieving fast response and high control accuracy. Due to the long delay in generating the control signal, it is necessary to carefully select the visual controller. In this paper we present a framework that allows the study of some conventional and new techniques to design this visual controller. Besides an experimental setup has been built and used to evaluate and compare the performance of the position based dynamic look and move system with different controllers. Some criterions for selecting the best strategy for each task are established. Quite a lot of results relative to different trajectory tracking control strategies are presented, showing both simulation and real platform responses.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Allen, P. K., Timcenko, A., Yoshimi, B., and Michelman, P.: 1993, Automated tracking and grasping of a moving object with a robotic hand-eye system, IEEE Trans. Robotics Automat. 9(2), 152-165.

    Google Scholar 

  • Aracil, R., Jiménez, A., and Feliu, V.: 1984, Multirate sampling technique in digital control systems simulation, IEEE Trans. Systems Man Cybernet., 776-780.

  • Bachiller, M.: 1999, Estrategias de control para el seguimiento de objetos con movimiento tridimensional. Aplicación a un sistema robótico con percepción visual, PhD Thesis, UNED.

  • Bélanger, P.: 1991, Estimation of angular velocity and acceleration formshaft encoder measurements, Technical Report TR-CIM-91-1, Mc. Gill University.

  • Brown, R., Schneider, S., and Mulligan, M. M.: 1992, Analysis of algorithms for velocity estimation from discrete position versus time data, IEEE Trans. Industr. Electronics 39(1), 11-19.

    Google Scholar 

  • Chaumette, F., Rives, P., and Espiau, B.: 1991, Positioning of a robot with respect to an object, tracking it and estimating its velocity by visual servoing, in: Proc. of IEEE Internat. Conf. on Robotics and Automation, pp. 2248-2253.

  • Corke, P. I.: 1993, Visual control of robot manipulators - A review, in: K. Hashimoto (ed.), Visual Servoing, World Scientific, Singapore, pp. 1-31.

    Google Scholar 

  • Espiau, B., Chaumette, F., and Rives, P.: 1992, A new approach to visual servoing in robotics, IEEE Trans. Robotics Automat. 8, 313-326.

    Google Scholar 

  • Feddema, J. T. and Mitchell, O. R.: 1989, Vision guided servoing with feature based trajectory generation, IEEE Trans. Robotics Automat. 5, 691-700.

    Google Scholar 

  • Feliu, V.: 1986, A transformation algorithm for estimating system laplace transform from sampled data, IEEE Trans. Systems Man Cybernet., 168-173.

  • Gangloff, J. A., Mathelin, M., and Abba, G.: 1998, 6 dof high speed dynamic visual servoing using gpc controllers, in: Proc. of the 1998 IEEE Internat Conf. on Robotics and Automation, pp. 2008-2013.

  • González, Y.: 1998, Aportaciones a la calibración de cámaras con distorsión geométrica. Aplicación al control con realimentación visual, PhD Thesis, UNED.

  • Hashimoto, K., Ebine, T., and Kimura, H.: 1996, Visual servoing with hand eye manipulator optimal control approach, IEEE Trans. Robotics Automat., 766-774.

  • Houshangi, N.: 1990, Control of robotic manipulator to grasp a moving target using vision, in: Proc. of IEEE Internat Conf. on Robotics and Automation, pp. 604-609.

  • Hutchinson, S., Hager, G. D., and Corke, P. I.: 1996, A tutorial on visual servo control, IEEE Trans. Robotics Automat. 12(5), 651-670.

    Google Scholar 

  • Khosla, P. K., Papanikolopoulos, N. P., and Kanade, T.: 1993, Visual tracking of a moving target by a camera mounted on a robot: A combination of control and vision, IEEE Trans. Robotics Automat. 9, 14-35.

    Google Scholar 

  • Koivo, A. J. and Houshangi, N.: 1991, Real time vision feedback for servoing robotic manipulator with self tuning controller, IEEE Trans. Systems Man Cybernet. 1(1), 134-141.

    Google Scholar 

  • Norman, S. N.: 1995, Control Systems Engineering, Addison-Wesley, Reading, MA.

    Google Scholar 

  • Papanikolopoulos, N. P.: 1992, Controlled active vision, PhD Thesis, Carnegie Mellon University.

  • Smith, C. E., Brandt, S. A., and Papanikolopoulos, N. P.: 1997, Eye-in-hand robotic task in uncalibrated environments, IEEE Trans. Robotics Automat. 13, 903-914.

    Google Scholar 

  • Tomizuka, M.: 1987, Zero phase error tracking algorithm for digital control, J. Dyn. Systems Measm. Control, 65-68.

  • Vargas, M., Rubio, F. R., and Malpesa, A. R.: 1999, Pose-estimation and control in a 3D visual servoing system, in: IFAC, pp. 317-323.

  • Wang, T. C. and Varshney, P. K.: 1991, A measurement preprocessing approach for target tracking, in: IFAC, Vol. 7, pp. 199-202.

    Google Scholar 

  • Weiss, L.: 1984, Dynamic visual servo control of robots: An adaptative image based approach, PhD Thesis, Carnegie Mellon University.

  • Weiss, L. E., Sanderson, A. C., and Neuman, C. P.: 1987, Dynamic sensor based control of robots with visual feedback, IEEE J. Robotics Automat. 3, pp. 404-417.

    Google Scholar 

  • Westmore, D. B. and Wilson, W. J.: 1991, Direct dynamic control of a robot using an end point mounted camera and Kalman filter position estimation, in: Proc. of IEEE Internat Conf. on Robotics and Automation, pp. 2376-2384.

  • Wilson, W., Williams, C. C., and Bell, G. S.: 1996, Relative end-effector control using Cartesian position based visual servoing, IEEE Trans. Robotics Automat. 12(5), 684-696.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bachiller, M., Cerrada, J.A. & Cerrada, C. A Modular Scheme for Controller Design and Performance Evaluation in 3D Visual Servoing. Journal of Intelligent and Robotic Systems 36, 235–264 (2003). https://doi.org/10.1023/A:1023096511738

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1023096511738

Navigation