Skip to main content
SpringerLink
Log in

A Robust Approach for Structure from Planar Motion by Stereo Image Sequences

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

This paper proposes a robust method for recovery of motion and structure from two image sequences taken by stereo cameras undergoing a planar motion. The feature correspondences between images are extracted and refined automatically by the relation of the stereo cameras and the property of the motion. To improve the robustness, an auto-scale random sample consensus (RANSAC) algorithm is adopted in the motion and structure estimation. Unlike other work recovering epipolar geometry, here we use a random sampling algorithm to recover the 2D motion and to exclude the outliers which lie both on and out of the epipolar lines. Further more, the idea of RANSAC is used in structure estimation to exclude the outliers from the image sequence. The contribution of this work is the development of an approach to make structure and motion estimation more robust and efficient so as to be applicable to real applications. With the adoption of the auto-scale technique, the algorithm completely automates the estimation process without any prior information or user’s specification of parameters like thresholds. Indoor and outdoor experiments have been done to verify the performance of the algorithm. The results demonstrated that the proposed algorithm is robust and efficient for applications in planar motions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Azarbayejani A., Pentland A. (1994) Recursive estimation of , structure, and focal length. IEEE Trans. Pattern Anal. Mach. Intell. 17: 545–561

    Google Scholar 

  2. Bartoli A., Coquerelle M., Sturm P. (2004) A framework for pencil-of-points structure-from-motion. In: Proceedings of European conference on computer vision, vol 2. Springer, Berlin Heidelberg New York, pp 28–40

  3. Chen T., Liu Y.H., Calibration of camera orientation using image sequences. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems, vol 3, pp 2606–2611 (2004)

  4. Chen T., Liu Y.H.,: A robust technique for structure from planar motion using image sequences. In: Proceedings of IEEE international conference on information acquisition, pp 507–512 (2005)

  5. Chiuso A., Favaro P., Jin H., Soatto S. (2002) Structure from motion causally integrated over time. IEEE Trans. Pattern Anal. Mach. Intell. 24: 523–535

    Article  Google Scholar 

  6. Cui N., Weng J.J., Cohen P. (1994) Recursive-batch estimation of motion and structure from monocular image sequences. Comput. Vis. Graph. Image Process. 59(2): 154–170

    Article  Google Scholar 

  7. Dellaert F., Seitz S., Thorpe C., Thrun S. Structure from motion without correspondence. In: Proceedings of conference computer vision and pattern recognition, pp 557–564 (2000)

  8. Fischler M.A., Bolles R.C. (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communi. ACM 24: 381–395

    Article  MathSciNet  Google Scholar 

  9. Harris C.J., Stephens M. A combined corner and edge detector. In: Alvey Vision Conference, pp 147–151 (1988)

  10. Hartley R.I. Euclidean reconstruction from uncalibrated views. In: Proceedings of IEEE international workshop on applications of invariance in computer vision II. Delgada, Azores, pp 187–201 (1993)

  11. Kumar R.V.R., Tirmalai A., Jain R.C. A nonlinear optimization algorithm for the estimation of structure and motion parameters. In: Proceedings of conference computer vision and pattern recognition, pp 136–143 (1898)

  12. Kumar R.V.R., Tirmalai A., Jain R.C. A nonlinear optimization algorithm for the estimation of structure and motion parameters. In: Proceedings of conference computer vision and pattern recognition, pp 136–143 (1989)

  13. McLauchlan P., Murray D. A unifying framework for structure and motion recovery from image sequences. In: Proceedings of international conference on computer vision, pp 314–320 (1995)

  14. Montiel J.M.M., Ortn D. Indoor robot motion based on monocular images. Robotica 19, pp 331–342 (2001)

    Google Scholar 

  15. Montiel J.M.M., Zisserman A. Automated architectural acquisition from a camera undergoing planar motion. In: International Symposium on virtual and augmented architecture (VAA01) (2001)

  16. Stein G.P., Mano O., Shashua A. A robust method for vehicle ego-motion. In: IEEE Intelligent vehicles symposium (IV2000) (2000)

  17. Stewart C.V. (1995) MINPRAN: a new robust estimator for computer vision. IEEE Trans Pattern Anal. Mach. Intell. 17, 925–938

    Article  Google Scholar 

  18. Sturm P.F. Structure and motion for dynamic scenes: the case of points moving in planes. In: Proceedings of european conference on computer vision, vol 2, pp. 867–882 (2002)

  19. Taylor C.J., Kriegman D.J., Anandan P. Structure and motion in two dimensions from multiple images: A least squares approach. In: Proceedings of IEEE international work-shop on visual motion, pp 242–248 (1991)

  20. Tomasi C., Kanade T. (1992) Shape and motion from image streams under orthography: a factorization method. Int. J. Comput. Vis. 9: 137–154

    Article  Google Scholar 

  21. Torr P.H.S., Davidson C. (2003) IMPSAC: synthesis of importance sampling and random sample consensus. IEEE Trans. Pattern Anal. Mach. Intell. 25: 354–364

    Article  Google Scholar 

  22. Torr P.H.S., Zisserman A. (2000) MLESAC: a new robust estimator with application to estimating image geometry. Comput. Vis. Image Underst. 78: 138–156

    Article  Google Scholar 

  23. Vidal R., Oliensis J. Structure from planar motions with small baselines. In: Proceedings of european conference on computer vision, vol 2, pp 383–398 (2002)

  24. Wang H., Suter D. (2004) Robust adaptive-scale parametric model estimation for computer vision. IEEE Trans. Pattern Anal. Mach. Intell. 26: 1459–1474

    Article  Google Scholar 

  25. Weng J., Cui Y., Ahuja N. (1997) Transitory image sequences, asymptotic properties, and estimation of motion and structure. IEEE Trans. Pattern Anal. Mach. Intell. 19: 451C463

    Article  Google Scholar 

  26. .Zhang Z., Shan Y. Incremental motion estimation through modified bundle adjustment. In: Proceedings of IEEE international conference on image processing, vol 2, pp 343–346 (2003)

  27. Triggs B., McLauchlan P., Hartley R., and Fitzgibbon A. Bundle adjustment – modern synthesis. In: Proceedings of workshop vision algorithms: theory and practice, pp 298–372 (1999)

  28. Zhang Z., Luong Q.T., Faugeras O. Motion of an uncalibrated stereo rig: self-calibration and metric reconstruction: ICPR-A, pp 695–697 (1994)

  29. Faugeras O., Papadopoulo T. A nonlinear method for estimating the projective geometry of three views, ICCV, pp 477–484 (1998)

Download references

Author information

Authors and Affiliations

  1. Automation and Computer-Aided Engineering, The Chinese University of Hong Kong, Hong Kong, People’s Republic of China

    Tai Chen & Yun-Hui Liu

Authors
  1. Tai Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yun-Hui Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tai Chen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chen, T., Liu, YH. A Robust Approach for Structure from Planar Motion by Stereo Image Sequences. Machine Vision and Applications 17, 197–209 (2006). https://doi.org/10.1007/s00138-006-0031-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-006-0031-5

Keywords

Search

Navigation