Skip to main content
Log in

Sub-Pixel Estimation Error Cancellation on Area-Based Matching

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

Area-based image matching and sub-pixel displacement estimation using similarity measures are common methods that are used in various fields. Sub-pixel estimation using parabola fitting over three points with their similarity measures is also a common method to increase the matching resolution. However, few investigations or studies have explored the characteristics of this estimation.

This study analyzed sub-pixel estimation error using two different types of matching model. Our analysis demonstrates that the estimation contains a systematic error depending on image characteristics, the similarity function, and the fitting function. This error causes some inherently problematic phenomena such as the so-called pixel-locking effect, by which the estimated positions tend to be biased toward integer values. We also show that there are good combinations of the similarity functions and fitting functions.

In addition, we propose a new algorithm to greatly reduce sub-pixel estimation error. This method is independent of the similarity measure and the fitting function. Moreover, it is quite simple to implement. The advantage of our novel method is confirmed through experiments using different types of images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aggarwal, J.K. and Nandhakumar, N. 1988. On the Computation of Motion from Sequences of Images–-a Review. Proceedings of the IEEE, 76(8):917–935.

    Google Scholar 

  • Aghajan, H.K., Schaper, C.D., and Kailath, T. 1993. Machine Vision Techniques for Sub-Pixel Estimation of Critical Dimensions. Optical Engineering, 32(4):828–839.

    Google Scholar 

  • Davis, C.Q. and Freeman, C.Q. 1998. Statistics of Subpixel Registration Algorithms based on Spatiotemporal Gradients or Block Matching. Optical Engineering, 37(4):1290–1298.

    Google Scholar 

  • Davis, C.Q., Karu, Z.Z., and Freeman, D.M. 1995. Equivalence of Subpixel Motion Estimators based on Optical Flow and Block Matching. In IEEE International Symposium for Computer Vision, Coral Gables, Florida, pp. 7–12.

    Google Scholar 

  • Driscoll, W.G. 1978. Handbook of Optics. New York: McGraw-Hill.

    Google Scholar 

  • Dvornychenko, V.N. 1983. Bounds on (Deterministic) Correlation Functions with Application to Registration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 5(2):206–213.

    Google Scholar 

  • Fincham, A. and Delerce, G. 1999. Advanced Optimization of Correlation Imaging Velocimetry Algorithms. In Proceedings of the 3rd International Workshop on PIV, additional print, Santa Barbara, USA.

    Google Scholar 

  • Foroosh, H., Zerubia, J.B., and Berthod M. 2002. Extension of Phase Correlation to Subpixel Registration. IEEE Transactions on Image Processing, 11(3):188–200.

    Google Scholar 

  • Frischholz, R.W. and Spinnler, K.P. 1993. A Class of Algorithms for Real-Time Subpixel Registration. In Europto Confference, Munich.

  • Fusiello, A. and Roberto, V. 2000. Symmetric Stereo with Multiple Windowing. International Journal of Pattern Recognition and Artificial Intelligence, 14(8):1053–1066.

    Google Scholar 

  • Hart, D.P. 1998. The Elimination of Correlation Errors in PIV Processing. Proceedings of the 9th International Symposium on Applications of Laser Techniques to Fluid Mechanics, Lisbon, Portugal, page 13.3.

  • Horn, B.K.P. and Schunck, B.G. 1981. Determining Optical Flow. Artificial Intelligence, 17:185–204.

    Google Scholar 

  • Irani, M. and Peleg, S. 1991. Improving Resolution by Image Registration. CVGIP: Graphical Models and Image Processing, 53(3):231–239.

    Google Scholar 

  • Kanade, T. and Okutomi, M. 1994. A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment, IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(9):920–932.

    Google Scholar 

  • Keys, R. 1981. Cubic Convolution Interpolation for Digital Image Processing. IEEE Transactions on Acoustics, Speech, and Signal Processing, 29(6):1153–1160.

    Google Scholar 

  • Lecordier, B., Lecordier, J.C., and Trinite, M. 1999. Iterative Sub-Pixel Algorithm for the Cross-Correlation PIV Measurements. In Proceedings of the 3rd International Workshop on PIV, Santa Barbara, USA, pp. 37–43.

  • Lucas, B. and Kanade, T. 1981. An Iterative Image Registration Technique with an Application to Stereo Vision. In Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vancouver, 674–679.

  • Mitiche, A. and Mansouri, A.-R. 2004. On convergence of the Horn and Schunck optical-flow estimation method. IEEE Transactions on Image Processing, 13(6):848–852.

    PubMed  Google Scholar 

  • Raffel, M., Willert, C.E. and Kompenhans, J. 1998. Particle Image Velocimetry. Heidelberg: Springer-Verlag.

    Google Scholar 

  • Schreier, H.W., Braasch, J.R., and Sutton, M.A. 2000. Systematic Errors in Digital Image Correlation Caused by Intensity Interpolation. Optical Engineering, 39(11):2915–2921.

    Google Scholar 

  • Shimizu, M. and Okutomi, M. 2001. Precise sub-pixel estimation on area-based matching. In Proceedings of the 8th IEEE International Conference on Computer Vision, Vancouver, Canada, pp. 90–97.

    Google Scholar 

  • Shimizu, M. and Okutomi, M. 2002. An Analysis of Sub-Pixel Estimation Error on Area-Based Image Matching, In Proceedings of the 14th International Conference on Digital Signal Processing, Santorini, Greece Vol. II, pp. 1239–1242 (w3B4).

  • Shortis, M.R., Clarke, T.A., and Short, T. 1994. A Comparison of Some Techniques for the Subpixel Location of Discrete Target Images. In Proceedings of the SPIE: Videometrics III, Boston, MA, USA, Vol. 2350, pp. 239–250.

  • Szeliski, R. and Scharstein, D. 2002. Symmetric Sub-Pixel Stereo Matching, Proceedings of the 7th European Conference on Computer Vision, II:525–540, Copenhagen.

  • Tian, Q. and Huhns, M.N. 1986. Algorithms for Subpixel Registration. Computer Vision, Graphics and Image Processing, (35):220–233.

    Google Scholar 

  • West, G.A.W. and Clarke, T.A. 1990. A Survey and Examination of Subpixel Measurement Techniques. In Proceedings of the SPIE: Close-Range Photogrammetry Meets Machine Vision, Zurich, Switzerland, Vol. 1395, pp. 456–463.

  • Westerweel, J. 1998. Effect on Sensor Geometry on the Performance of PIV interrogation. In Proceedings of the 9th International Symposium on Applications of Laser Techniques to Fluid Mechanics, Lisbon, Portugal, page 1.2.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Masao Shimizu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shimizu, M., Okutomi, M. Sub-Pixel Estimation Error Cancellation on Area-Based Matching. Int J Comput Vision 63, 207–224 (2005). https://doi.org/10.1007/s11263-005-6878-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-005-6878-5

Keywords

Navigation