Skip to main content
Springer Nature Link
Log in

What Tasks can be Performed with an Uncalibrated Stereo Vision System?

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

This article studies the following question: “When is it possible to decide, on the basis of images of point-features observed by an imprecisely modeled two-camera stereo vision system, whether or not a prescribed robot positioning task has been precisely accomplished?” Results are shown for three camera model classes: injective cameras, weakly calibrated projective cameras, and uncalibrated projective cameras. In particular, given a weakly calibrated stereo pair, it is shown that a positioning task can be precisely accomplished if and only if the task specification is invariant to projective transformations. It is shown that injective and uncalibrated projective cameras can accomplish fewer tasks, but are still able to accomplish tasks involving point coincidences.

The same formal framework is applied to the problem of determining the set of tasks which can be precisely accomplished with the well-known position-based control architecture. It is shown that, for any class of camera models, the set of tasks which can be precisely accomplished using a position-based control architecture is a subset of the complete set of tasks which can be decided on the set, but includes all positioning tasks based on point coincidences. Two ways of extending the idea of position-based control to accomplish more tasks are also presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Boufama, B., Mohr, R., and Morin, L. 1998. Using geometric properties for automatic object positioning. Image and Vision Computing, 16:27–33.

    Google Scholar 

  • Castano, A. and Hutchinson, S.A. 1994. Visual compliance: Task-directed visual servo control. IEEE Trans. Robot. Autom., 10(3):334–342.

    Google Scholar 

  • Chang, W.-C. 1997. Vision-based control of uncertain systems. Ph.D. Thesis. Yale University.

  • Chang, W.-C., Morse, A.S., and Hager, G.D. 1996. A calibration-free, self-adjusting stereo visual control system. In Proc. of the 13th World Congress, International Federation of Automatic Control. IFAC, vol. A, pp. 343–348.

    Google Scholar 

  • Chang, W.-C., Hespanha, J.P., Morse, A.S., and Hager, G.D. 1997. Task re-encoding in vision-based control systems. In Proc. of the 36th Conf. on Decision and Contr., pp. 48–54.

  • Chaumette, F., Malis, E., and Boudet, S. 1997. 2d 1/2 visual servoing with respect to a planar object. In Proc. IROS Workshop on New Trends in Image-based Robot Servoing, pp. 43–52.

  • Chaumette, F., Rives, P., and Espiau, B. 1994. Classification and realization of the different vision-based tasks. In Visual Servoing, K. Hashimoto (Ed.), World Scientific, pp. 199–228.

  • Corke, P. 1994. Visual control of robot manipulators —a review. In Visual Servoing, K. Hashimoto, (Eds.), World Scientific, pp. 1–32.

  • Dickmanns, E. and Graefe, V. 1988. Applications of dynamic monocular machine vision. Machine Vision and Applications, 1:241–261.

    Google Scholar 

  • Espiau, B., Chaumette, F., and Rives, P. 1992. A new approach to visual servoing in robotics. IEEE Trans. Robot. Autom., 8:313–326.

    Google Scholar 

  • Fagerer, C., Dickmanns, D., and Dickmanns, E. 1994. Visual grasping with long delay time of a free floating object in orbit. Autonomous Robots, 1(1).

  • Faugeras, O. 1992. What can be seen in three dimensions with an uncalibrated stereo rig? In Proc. ECCV, pp. 563–578.

  • Faugeras, O. 1993. Three-Dimensional Computer Vision. MIT Press: Cambridge, MA.

    Google Scholar 

  • Hager, G. 1995. Calibration-free visual control using projective invariance. In Proc. Int. Conf. Comput. Vis., pp. 1009–1015.

  • Hager, G. 1997. A modular system for robust hand-eye coordination. IEEE Trans. Robot. Autom., 13(4):582–595.

    Google Scholar 

  • Hager, G., Chang, W.-C., and Morse, A.S. 1995. Robot hand-eye coordination based on stereo vision. IEEE Control Systems Magazine, 15(1):30–39.

    Google Scholar 

  • Hager, G. and Dodds, Z. 1997. A projective framework for constructing accurate hand-eye systems. In Proc. of the IEEE/RSJ/INRIA Workshop on New Trends in Image-Based Robot Servoing, pp. 71–82.

  • Hartley, R.I. 1997. Self-calibration of stationary cameras. Int. Journal of Computer Vision, 22:5–24.

    Google Scholar 

  • Hartley, R.I. 1998. Chirality. Int. Journal of Computer Vision, 26(1):41–62.

    Google Scholar 

  • Hespanha, J.P. 1998. Logic-based switching algorithms in control. Ph.D. Thesis. Yale University, New Haven, CT.

    Google Scholar 

  • Hespanha, J.P. and Morse, A.S. 1998. Certainty equivalence implies detectability. In Proc. NOLCOS.

  • Hespanha, J.P., Dodds, Z., Hager, G.D., and Morse, A.S. 1998. Decidability of robot positioning tasks using stereo vision systems. In Proc. of the 37th Conf. on Decision and Contr.

  • Hollinghurst, N. and Cipolla, R. 1994. Uncalibrated stereo hand eye coordination. Image and Vision Computing, 12(3):187–192.

    Google Scholar 

  • Hosoda, K. and Asada, M. 1994. Versatile visual servoing without knowledge of true jacobian. In IEEE Int'l Workshop on Intelligent Robots and Systems, IEEE Computer Society Press, pp. 186–191.

  • Hutchinson, S., Hager, G., and Corke P. 1996. A tutorial introduction to visual servo control. IEEE Trans. Robot. Autom., 12(5).

  • Jagersand, M., Fuentes, O., and Nelson, R. 1997. Experimental evaluation of uncalibrated visual servoing for precision manipulation. In Proc. ICRA, pp. 2874–2880.

  • Kelly, R. 1996. Robust asymptotically stable visual servoing of planar robots. IEEE Trans. Robot. Autom., 12(5):759–766.

    Google Scholar 

  • Kriegman, D., Hager, G., and Morse, A.S. (Eds.). 1998. The Confluence of Vision and Control. Number 237 in Lecture Notes in Control and Information Sciences, Springer-Verlag.

  • Longuet-Higgins, H. 1981. A computer algorithm for reconstructing a scene from two projections. Nature, 293:133–135.

    Google Scholar 

  • Maybank, S.J. 1998. Relation between 3d invariants and 2d invariants. Image and Vision Computing, 16:13–20.

    Google Scholar 

  • Mundy, J. and Zisserman, A. 1992. Geometric Invariance in Computer Vision. MIT Press: Cambridge, MA.

    Google Scholar 

  • Nelson, B.J. and Khosla, P.K. 1994. The resolvability ellipsoid for visual servoing. In Proc. IEEE Conf. Comp. Vision and Patt. Recog., IEEE Computer Society Press, pp. 829–832.

  • Ponce, J. and Genc, Y. 1998. A new approach to weak calibration. Image and Vision Computing, 16(3):223–243.

    Google Scholar 

  • Rizzi, A. 1995. Dexterous robot manipulation. Ph.D. Thesis. Yale University.

  • Robert, L. and Faugeras, O. 1993. Relative 3D positioning and 3D convex hull computation from a weakly calibrated stereo pair. In Proc. of the International Conference on Computer Vision, Berlin, Germany, pp. 540–543.

  • Robert, L., Zeller, C., and Faugeras, O. 1995. Applications of non-metric vision to some visually guided robotics tasks. Technical Report 2584, INRIA, Sophia-Antipolis.

  • Samson, C., Le Borgne, M., and Espiau, B. 1992. Robot Control: The Task Function Approach. Clarendon Press: Oxford, England.

    Google Scholar 

  • Sastry, S. and Bodson, M. 1989. Adaptive Control: Stability, Convergence and Robustness. Prentice Hall: Englewood Cliffs, NJ.

    Google Scholar 

  • Seelinger, M., Robinson, M., Dieck, Z., and Skaar, S. 1997. A vision-guided, semi-autonomous system applied to a robotic coating application. In Sensor Fusion and Decentralized Control in Autonomous Robotic Systems, P.S. Schenker and G.T. McKee (Eds.), SPIE, pp. 133–144.

  • Sharma, R. and Hutchinson, S. 1997. Motion perceptibility and its application to active vision-based servo control. IEEE Trans. Robot. Autom., 13(1):61–73.

    Google Scholar 

  • Skaar, S., Brockman, W., and Jang, W. 1990. Three-dimensional camera space manipulation. Int. J. Robot. Res., 9(4):22–39.

    Google Scholar 

  • Toyama, K., Wang, J., and Hager, G.D. 1996. SERVO-MATIC: a modular system for robust positioning using stereo visual servoing. In Proc. IEEE Int'l Conf. Robot. and Automat., pp. 2636–2643.

  • Weiss, L., Sanderson, A., and Neuman, C.P. 1987. Dynamic sensor-based control of robots with visual feedback. IEEE J. Robot. Automat., RA-3(5):404–417.

    Google Scholar 

  • Wijesoma, S., Wolfe, D., and Richards, R. 1993. Eye-to-hand coordination for vision-guided robot control applications. Int. J. Robot. Res., 12(1):65–78.

    Google Scholar 

  • Yoshimi, B. and Allen, P.K. 1994. Active, uncalibrated visual servoing. In IEEE Int'l Conf. Robotics Automat., San Diego, CA, pp. 156–161.

  • Zhang, Z. 1998. Determining epipolar geometry and its uncertainty: A review. Int. Journal of Computer Vision, 27(2):161–195.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Electrical Engineering-System, University of Southern California, Los Angeles, CA, 90089-2563

    J.P. Hespanha

  2. Center for Computational Vision and Control, c/o Computer Science Department, Yale University, P.O. Box 208285, New Haven, CT, 06520

    Z. Dodds, G.D. Hager & A.S. Morse

Authors
  1. J.P. Hespanha
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Z. Dodds
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. G.D. Hager
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. A.S. Morse
    View author publications

    You can also search for this author inPubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hespanha, J., Dodds, Z., Hager, G. et al. What Tasks can be Performed with an Uncalibrated Stereo Vision System?. International Journal of Computer Vision 35, 65–85 (1999). https://doi.org/10.1023/A:1008111128520

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008111128520