Skip to main content

Directing robots with visual primitives for navigation and micro-manipulation

  • Session T2B: Robot Vision and Navigation
  • Conference paper
  • First Online:
  • 133 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1351))

Abstract

For most present-day industrial robots, the user programs the robot using a robot language or teaches the robot using a pendant and/or joystick. In telerobots, the user controls the mobile robot or the robot arm by manually operating a joystick where the user himself acts as a cognition and decision making unit in the control loop. One of the important sensed information given to the user is visual feedback. Inspired by behavioral control of mobile robots, we propose a novel interface between the user and the robot to improve the performance of the robot system. In the proposed paradigm, the visual feedback exists in two control loops: one for the human supervisory control and the other for the robot itself for visual servoing. The human operator only provides the visual primitives to the robot and tells the robot its current situation which will activate a certain action, as in situation-to-action reactive/reflex control of mobile robots.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Special issue on vision-based control of robot manipulators, IEEE Trans. on Robotics and Automation, Vol.12, No. 5, October, 1996.

    Google Scholar 

  2. R. C. Arkin, “Motor Schema based mobile robot navigation,” Int. J. of Rob. Res., Vol.8, No. 4, 1989, pp.92–112.

    Google Scholar 

  3. R.A. Brooks, “A Robust layered control system for a mobile robot”, IEEE Journal of Robotics and Automation, Vol.RA-2, No.1, March 1986, pp.14–23.

    Google Scholar 

  4. D. Drascic and P. Milgram, “Positioning accuracy of a virtual stereographic pointer in a real stereoscopic video world”, SPIE Vol.1457: Stereoscopic Displays and applications II, 58-69, San Jose, California, September 1991.

    Google Scholar 

  5. J.J. Feddema, C.S.G. Lee, and O.R. Mitchell, “Weighted selection of Image features for resolved rate visual feedback control”, IEEE Trans. on Robotics and Automation, Vol. 7, No. 1, February 1991, pp.31–47.

    Google Scholar 

  6. K. Hashimoto, (Ed.), Visual servoing: real-time control of robot manipulators based on visual sensory feedback, World Scientific, 1993.

    Google Scholar 

  7. N.P. Papanikolopoulos and P.K. Khosla, “Shared and traded telerobotic visual control”, In Proc. IEEE Int. Conf. on Robotics and Automation, 1992, pp. 878-885.

    Google Scholar 

  8. F. Tendick, J. Voichick, G. Tharp and L. Stark, “A supervisory telerobotic control system using model-based vision feedback”, In Proc. IEEE Int. Conf. on Robotics and Automation, 1991, pp.2280–2285.

    Google Scholar 

  9. L.E. Weiss, et al., “Dynamic sensor-based control of robots with visual feedback”, IEEE J. Robotics and Automation, Vol. RA-3, Oct. 1987, pp. 404–417. *** DIRECT SUPPORT *** A0008188 00006

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Roland Chin Ting-Chuen Pong

Rights and permissions

Reprints and permissions

Copyright information

© 1997 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Tong, W.B., Tso, S.K., Lang, S., Luz, G.Z., Ma, S.D. (1997). Directing robots with visual primitives for navigation and micro-manipulation. In: Chin, R., Pong, TC. (eds) Computer Vision — ACCV'98. ACCV 1998. Lecture Notes in Computer Science, vol 1351. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-63930-6_114

Download citation

  • DOI: https://doi.org/10.1007/3-540-63930-6_114

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-63930-5

  • Online ISBN: 978-3-540-69669-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics