Skip to main content
SpringerLink
Log in

Automated Alignment of Robotic Pan-Tilt Camera Units Using Vision

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

In this paper we show how to carry out an automatic alignment of a pan-tilt camera platform with its natural coordinate frame, using only images obtained from the cameras during controlled motion of the unit. An active camera in aligned orientation represents the zero position for each axis, and allows axis odometry to be referred to a fixed reference frame; such referral is otherwise only possible using mechanical means, such as end-stops, which cannot take account of the unknown relationship between the camera coordinate frame and its mounting. The algorithms presented involve the calculation of two-view transformations (homographies or epipolar geometry) between pairs of images related by controlled rotation about individual head axes. From these relationships, which can be calculated linearly or optimised iteratively, an invariant line to the motion can be extracted which represents an aligned viewing direction. We present methods for general and degenerate motion (translating or non-translating), and general and degenerate scenes (non-planar and planar, but otherwise unknown), which do not require knowledge of the camera calibration, and are resistant to lens distortion non-linearity.Detailed experimentation in simulation, and in real scenes, demonstrate the speed, accuracy, and robustness of the methods, with the advantages of applicability to a wide range circumstances and no need to involve calibration objects or complex motions. Accuracy of within half a degree can be achieved with a single motion, and we also show how to improve on this by incorporating images from further motions, using a natural extension of the basic algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Armstrong, M.N. 1996. Self-calibration from Image Sequences. Ph.D. thesis, University of Oxford.

  • Beardsley, P.A. and Zisserman, A. 1995. Affine Calibration of Mobile Vehicles. In R. Mohr and W. Chengke (Eds.): Proc. Joint Europe-China Workshop on Geometrical Modelling and Invariants for Computer Vision, Xi’an, China.

  • Davison, A. 1998. Mobile robot navigation using active vision. Ph.D. thesis, Robotics Research Group, Oxford University Department of Engineering Science.

  • DeSouza, G.N., Jones, A.J., and Kak, A.C. 2002. A world independent approach for the calibration of mobile robotics active stereo heads. In Proc. IEEE Int’l Conf. on Robotics and Automation, vol. 4. Washington, pp. 3336–3341.

  • Harris, C.G. and Stephens, M. 1988. A combined corner and edge detector. In Proc. 4th Alvey Vision Conf., Manchester. pp. 147–151.

  • Hartley, R.I. and Zisserman, A. 2000. Multiple View Geometry in Computer Vision. Cambridge University Press.

  • Hayman, E., Knight, J., and Murray, D.W. 2000. Self-alignment of an active head from observations of rotation matrices. In Proc. 15th IEEE Int’l Conf. on Pattern Recognition, vol. 1. Barcelona, pp. 80–84.

  • Horaud, R. and Csurka, G. 1998. Self-calibration and euclidean reconstruction using motions of a stereo rig. In Proc. 6th Int’l Conf. on Computer Vision, Bombay. pp. 96–103.

  • Knight, J. 2002. Towards fully autonomous mobile robot navigation. Ph.D. thesis, Robotics Research Group, Oxford University Department of Engineering Science.

  • Knight, J. and Reid, I. 2000a. Active visual alignment of a mobile stereo camera platform. In Proc. IEEE Int’l Conf. on Robotics and Automation, Vol.4. San Francisco, pp. 3203–3208.

  • Knight, J. and Reid, I. 2000b. Binocular self-alignment and calibration from planar scenes. In Vernon, D. Ed.): Proc. 6th European Conference on Computer Vision, Dublin. pp. II:462–476.

  • Knight, J., Zisserman, A., and Reid, I. 2003. Linear auto-calibration for ground plane motion. In Proc. IEEE Conf. on Computer vision and Pattern Recognition, Madison, Wisconsin.18–20 June, pp. I:503–510.

  • Li, M. 1998. Kinematic calibration of an active head-eye system. IEEE Transactions on Robotics and Automation 14(1):153–157.

    Article  Google Scholar 

  • Ma, S.D. 1996. A self-calibration technique for active vision systems. IEEE Trans. Robotics and Automation 12(1):114–120.

    Article  Google Scholar 

  • Maybank, S.J. 1993. Theory of Reconstruction from Image Motion. Springer-Verlag Berlin.

    Google Scholar 

  • McLauchlan, P.F. and Murray, D.W. 1996. Active camera calibration for a head-eye platform using the variable state-dimension filter. IEEE Transactions on Pattern Analysis and Machine Intelligence 18(1):15–21.

    Article  Google Scholar 

  • Murray, D.W., Reid, I.D., and Davison, A.J. 1996. Steering and navigation behaviours using fixation. In Proc. 7th British Machine Vision Conf., pp. Edinburgh. 635–644.

  • Murray, D.W., Reid, I.D., and Davison, A.J. 1997. Steering without representation using active fixation. Perception 26(12):1519–1528.

    Google Scholar 

  • Reid, I.D. and Beardsley, P.A. 1996. Self-alignment of a binocular head. Image and Vision Computing 14(8):635–640.

    Article  Google Scholar 

  • Sampson, P.D. 1982. Fitting conic sections to ‘very scattered’ data: An iterative refinement of the Bookstein algorithm. Computer Vision, Graphics, and Image Processing 18:97–108.

    Article  Google Scholar 

  • Sharkey, P.M., Murray, D.W., Vandevelde, S., Reid, I.D., and McLauchlan, P.F. 1993. A modular head/eye platform for real-time reactive vision. Mechatronics 3(4):517–535.

    Article  Google Scholar 

  • Tordoff, B. and Murray, D.W. 2000. Violating rotating camera geometry: The effect of radial distortion on self-calibration. In Proc. 15th IEEE Int’l Conf. on Pattern Recognition, vol. 1. Barcelona, pp. 423–427.

  • Torr, P.H.S. and Zisserman, A. 2000. MLESAC: A new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding 78(1), 138–156.

    Article  Google Scholar 

  • Viéville, T. and Lingrand, D. 1996. Using singular displacements for uncalibrated monocular vision systems. In Proc. 4th European Conf. on Computer Vision, Cambridge. pp. II:207–216.

  • Zisserman, A., Beardsley, P.A., and Reid, I.D. 1995. Metric Calibration of a stereo rig. In Proc. IEEE Workshop on Representations of Visual Scenes, in conjunction with ICCV’95, Cambridge, MA. pp. 93–100.

Download references

Author information

Authors and Affiliations

  1. Active Vision Lab, Robotics Research Group, Department of Engineering Science, University of Oxford, Parks Road, Oxford, OX1 3PJ, UK

    Joss Knight & Ian Reid

Authors
  1. Joss Knight
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ian Reid
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Joss Knight.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Knight, J., Reid, I. Automated Alignment of Robotic Pan-Tilt Camera Units Using Vision. Int J Comput Vision 68, 219–237 (2006). https://doi.org/10.1007/s11263-005-5032-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-005-5032-8

Keywords

Search

Navigation