Skip to main content
SpringerLink
Log in

Image Registration Using Wavelet-Based Motion Model

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

An image registration algorithm is developed to estimate dense motion vectors between two images using the coarse-to-fine wavelet-based motion model. This motion model is described by a linear combination of hierarchical basis functions proposed by Cai and Wang (SIAM Numer. Anal., 33(3):937–970, 1996). The coarser-scale basis function has larger support while the finer-scale basis function has smaller support. With these variable supports in full resolution, the basis functions serve as large-to-small windows so that the global and local information can be incorporated concurrently for image matching, especially for recovering motion vectors containing large displacements. To evaluate the accuracy of the wavelet-based method, two sets of test images were experimented using both the wavelet-based method and a leading pyramid spline-based method by Szeliski et al. (International Journal of Computer Vision, 22(3):199–218, 1996). One set of test images, taken from Barron et al. (International Journal of Computer Vision, 12:43–77, 1994), contains small displacements. The other set exhibits low texture or spatial aliasing after image blurring and contains large displacements. The experimental results showed that our wavelet-based method produced better motion estimates with error distributions having a smaller mean and smaller standard deviation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adelson, E.H. and Bergen, J.R. 1985. Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America, A2(2):284–299.

    Google Scholar 

  • Anandan, P. 1989. A computational framework and an algorithm for the measurement of structure from motion. International Journal of Computer Vision, 2:283–310.

    Google Scholar 

  • Bab-Hadiashar, A. and Suter, D. 1997. Optic flow calculation using robust statistics. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'97), pp. 988–993.

  • Barron, J.L., Fleet, D.J., and Beauchemin, S.S. 1994. Performance of optical flowtechniques. International Journal of Computer Vision, 12:43–77.

    Google Scholar 

  • Bergen, J.R., Anandan, P., Hanna, K.J., and Hingorani, R. 1992. Hierarchical model-based motion estimation. In Computer Vision-ECCV’ 92, the Second European Conference on Computer Vision, Santa Margherita Ligure, Italy, G. Sandini (Ed.). Springer: Berlin, pp. 237–252.

    Google Scholar 

  • Black, M.J. and Anandan, P. 1996. The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. Computer Vision and Image Understanding, 63(1):75–104.

    Google Scholar 

  • Black, M.J. and Rangarajan, A. 1996. On the unification of line processes, outlier rejection, and robust statistics with applications in early vision. International Journal of Computer Vision, 19(1):57–92.

    Google Scholar 

  • Black, M.J., Yacoob, Y., Jepson, A.D., and Fleet, D.J. 1997. Learning parameterized models of image motion. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'97), pp. 561–567.

  • Bregler, C. and Malik, J. 1998, Tracking people with twists and exponential maps. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'98), pp. 8–15.

  • Brown, L.G. 1992. A survey of image registration techniques. Computing Surveys, 24(4):325–376.

    Google Scholar 

  • Cai, W. and Wang, J. 1996. Adaptive multiresolution collocation methods for initial boundary value problems of nonlinear PDEs. SIAM NUMER. ANAL. 33(3):937–970.

    Google Scholar 

  • Chui, C.K. 1992. Introduction to Wavelets. Academic Press.

  • Daubechies, I. 1990. The wavelet transform, time-frequency localization and signal analysis. IEEE Transactions on Information Theory, 36:961–1005.

    Google Scholar 

  • Enkelmann, W. 1986. Investigation of multigrid algorithms for the estimation of optical flow fields in image sequences. In Proceedings of IEEE Workshop on Motion: Representation and Analysis, Charleston, SC, pp. 81–87.

  • Fleet, D.J., Black, M.J., and Jepson, A.D. 1998. Motion feature detection using steerable flowfields. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'98), pp. 274–281.

  • Fleet, D.J. and Jepson, A.D. 1990. Computation of component image velocity from local phase information. International Journal of Computer Vision, 5:77–104.

    Google Scholar 

  • Hanna, K.J. 1991. Direct multi-resolution estimation of ego-motion and structure from motion, In Proceedings of IEEE Workshop on Visual Motion, Princeton, New Jersy, pp. 156–162.

  • Heeger, D.J. 1988. Optical flow using spatiotemporal filters. International Journal of Computer Vision, 1:279–302.

    Google Scholar 

  • Horn, B.K.P. and Schunck, B.G. 1981. Determining optical flow: A retrospective. Artificial Intelligence, 17:185–203.

    Google Scholar 

  • Horn, B.K.P. and Weldson, E.J. Jr. 1988. Direct method for recovering motion. International Journal of Computer Vision, 2:51–57.

    Google Scholar 

  • Jepson, A. and Black, M.J. 1993. Mixture models for optical flow computation, In 1993 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'93), pp. 760–761.

  • Kanade, T. and Okutomi, M. 1994. Astereo matching algorithm with an adaptive window: Theory and experiment. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(9):920–932.

    Google Scholar 

  • Kanatani, K. 1993. Geometric Computation for Machine Vision. Oxford University Press.

  • Lucas, B.D. and Kanade, T. 1981. An iterative image registration technique with an application in stereo vision. In Proceedings of the Seventh International Joint Conference on Artificial Intelligence, pp. 674–679.

  • Luettgen, M.R., Clem Karl, W., and Willsky, A.S. 1994. Efficient multiscale regularization with applications to the computation of optical flow. IEEE Transactions on Image Processing, 31:41–64.

    Google Scholar 

  • Memin, E. and Perez, P. 1998. Dense estimation and object-based segmentation of the optical flow with robust techniques. IEEE Transactions on Image Processing, 75:703–719.

    Google Scholar 

  • Mallat, S.G. 1989. A theory for multiresolution signal decomposition: The wavelet Representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(7):674–693.

    Google Scholar 

  • Nesi, P., Bimbo, A.D., and Ben-Tzvi, D. 1995. Arobust algorithm for optical flow estimation, Ċomputer Vision and Image Understanding, 62(1):59–68.

    Google Scholar 

  • Nagel, H.H. 1987. On the estimation of optical flow: relations between different approaches and some new Artificial Intelligence, 33:299–324.

    Google Scholar 

  • Ong, E.P. and Spann, M. 1996. Robust results. multiresolution computation of optical flow. In IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP-96), Vol. 4, pp. 1938–1941.

    Google Scholar 

  • Ong, E.P. and Spann, M., 1999. Robust optical flow computation based on least-median-of-squares regression. International Journal of Computer Vision, 31:51–82.

    Google Scholar 

  • Otte, M. and Nagel, H.H. 1994. Optical flow estimation: Advances and comparisons. In ECCV'94, pp. 51–60.

  • Poggio, T., Torre, V., and Koch, C. 1985. Computational Vision and Regularization Theory. Nature, 317(6035):314–319.

    Google Scholar 

  • Press, W.H., Flannery, B.P., Teukolsky, S.A., and Vetterling, W.T. 1992. Numerical Recipes in C: The Art of Scientific Computing, 2nd Edn. Cambridge University Press: Cambridge.

    Google Scholar 

  • Quam, L.I. 1984. Hierarchical warp stereo. In Image Understanding Workshop, New Orleans, Louisiana, Science Applications International Corporation, pp. 149–155.

    Google Scholar 

  • Singh, A. 1990. An estimation-theoretic framework for image-flow computation. In Third International Conference on Computer Vision, pp. 168–177.

  • Szeliski, R. and Coughlan, J. 1997. Spline-based image registration. International Journal of Computer Vision, 22(3):199–218.

    Google Scholar 

  • Szeliski, R. and Shum, H.Y. 1996. Motion Estimation with Quadtree Splines. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(12):1199–1210.

    Google Scholar 

  • Waxman, A.M. and Wohn, K. 1985. Contour evolution, neighborhood deformation, and global image flow: Planar surfaces in motion. International Journal of Robotics Research, 4(3):95–108.

    Google Scholar 

  • Weber, J. and Malik, J. 1995. Robust computation of optical flow in a multi-scale differential framework. International Journal of Computer Vision, 14(1):67–81.

    Google Scholar 

  • Wei, G.Q., Brauer, W., and Hirzinger G. 1998. Intensity-and Gradient-based stereo matching using hierarchical Gaussian basis functions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11):1143–1160.

    Google Scholar 

  • Wu, Y.T. 1997. Image registration usingwavelet-based motion model and its applications. Ph.D. Dissertation, Department of Electrical Engineering, University of Pittsburgh.

  • Wu, Y.T., Kanade T., Cohn, J.F., and Li, C.C. 1998. Optical flow estimation using wavelet motion model. In International Conference on Computer Vision, pp. 992–998.

  • Wu, Y.T., Kanade T., and Li, C.C. 2000. Discrete signal matching using wavelet-base displacement model. In 4th Asian Conference on Computer Vision, pp. 753–758.

  • Xiong, Y. and Shafer, S.A. 1997. Moment and hypergeometric filters for high precision computation of focus, stereo and optical flow. International Journal of Computer Vision, 22(1):25–59.

    Google Scholar 

  • Yserentant, H. 1986. On the muti-level splitting of finite element spaces. Numerische Mathematik, 49:397–412.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Information Engineering, National Chi Nan University, Puli, 545, Taiwan, ROC

    Yu-Te Wu

  2. The Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, 15213

    Takeo Kanade

  3. Department of Electrical Engineering, University of Pittsburgh, Pittsburgh, PA, 15261

    Ching-Chung Li

  4. Department of Psychology and Psychiatry, University of Pittsburgh, Pittsburgh, PA, 15261

    Jeffrey Cohn

Authors
  1. Yu-Te Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Takeo Kanade
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ching-Chung Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jeffrey Cohn
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wu, YT., Kanade, T., Li, CC. et al. Image Registration Using Wavelet-Based Motion Model. International Journal of Computer Vision 38, 129–152 (2000). https://doi.org/10.1023/A:1008101718719

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008101718719

Search

Navigation