Abstract
Area-based image matching and sub-pixel displacement estimation using similarity measures are common methods that are used in various fields. Sub-pixel estimation using parabola fitting over three points with their similarity measures is also a common method to increase the matching resolution. However, few investigations or studies have explored the characteristics of this estimation.
This study analyzed sub-pixel estimation error using two different types of matching model. Our analysis demonstrates that the estimation contains a systematic error depending on image characteristics, the similarity function, and the fitting function. This error causes some inherently problematic phenomena such as the so-called pixel-locking effect, by which the estimated positions tend to be biased toward integer values. We also show that there are good combinations of the similarity functions and fitting functions.
In addition, we propose a new algorithm to greatly reduce sub-pixel estimation error. This method is independent of the similarity measure and the fitting function. Moreover, it is quite simple to implement. The advantage of our novel method is confirmed through experiments using different types of images.
Similar content being viewed by others
References
Aggarwal, J.K. and Nandhakumar, N. 1988. On the Computation of Motion from Sequences of Images–-a Review. Proceedings of the IEEE, 76(8):917–935.
Aghajan, H.K., Schaper, C.D., and Kailath, T. 1993. Machine Vision Techniques for Sub-Pixel Estimation of Critical Dimensions. Optical Engineering, 32(4):828–839.
Davis, C.Q. and Freeman, C.Q. 1998. Statistics of Subpixel Registration Algorithms based on Spatiotemporal Gradients or Block Matching. Optical Engineering, 37(4):1290–1298.
Davis, C.Q., Karu, Z.Z., and Freeman, D.M. 1995. Equivalence of Subpixel Motion Estimators based on Optical Flow and Block Matching. In IEEE International Symposium for Computer Vision, Coral Gables, Florida, pp. 7–12.
Driscoll, W.G. 1978. Handbook of Optics. New York: McGraw-Hill.
Dvornychenko, V.N. 1983. Bounds on (Deterministic) Correlation Functions with Application to Registration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 5(2):206–213.
Fincham, A. and Delerce, G. 1999. Advanced Optimization of Correlation Imaging Velocimetry Algorithms. In Proceedings of the 3rd International Workshop on PIV, additional print, Santa Barbara, USA.
Foroosh, H., Zerubia, J.B., and Berthod M. 2002. Extension of Phase Correlation to Subpixel Registration. IEEE Transactions on Image Processing, 11(3):188–200.
Frischholz, R.W. and Spinnler, K.P. 1993. A Class of Algorithms for Real-Time Subpixel Registration. In Europto Confference, Munich.
Fusiello, A. and Roberto, V. 2000. Symmetric Stereo with Multiple Windowing. International Journal of Pattern Recognition and Artificial Intelligence, 14(8):1053–1066.
Hart, D.P. 1998. The Elimination of Correlation Errors in PIV Processing. Proceedings of the 9th International Symposium on Applications of Laser Techniques to Fluid Mechanics, Lisbon, Portugal, page 13.3.
Horn, B.K.P. and Schunck, B.G. 1981. Determining Optical Flow. Artificial Intelligence, 17:185–204.
Irani, M. and Peleg, S. 1991. Improving Resolution by Image Registration. CVGIP: Graphical Models and Image Processing, 53(3):231–239.
Kanade, T. and Okutomi, M. 1994. A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment, IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(9):920–932.
Keys, R. 1981. Cubic Convolution Interpolation for Digital Image Processing. IEEE Transactions on Acoustics, Speech, and Signal Processing, 29(6):1153–1160.
Lecordier, B., Lecordier, J.C., and Trinite, M. 1999. Iterative Sub-Pixel Algorithm for the Cross-Correlation PIV Measurements. In Proceedings of the 3rd International Workshop on PIV, Santa Barbara, USA, pp. 37–43.
Lucas, B. and Kanade, T. 1981. An Iterative Image Registration Technique with an Application to Stereo Vision. In Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vancouver, 674–679.
Mitiche, A. and Mansouri, A.-R. 2004. On convergence of the Horn and Schunck optical-flow estimation method. IEEE Transactions on Image Processing, 13(6):848–852.
Raffel, M., Willert, C.E. and Kompenhans, J. 1998. Particle Image Velocimetry. Heidelberg: Springer-Verlag.
Schreier, H.W., Braasch, J.R., and Sutton, M.A. 2000. Systematic Errors in Digital Image Correlation Caused by Intensity Interpolation. Optical Engineering, 39(11):2915–2921.
Shimizu, M. and Okutomi, M. 2001. Precise sub-pixel estimation on area-based matching. In Proceedings of the 8th IEEE International Conference on Computer Vision, Vancouver, Canada, pp. 90–97.
Shimizu, M. and Okutomi, M. 2002. An Analysis of Sub-Pixel Estimation Error on Area-Based Image Matching, In Proceedings of the 14th International Conference on Digital Signal Processing, Santorini, Greece Vol. II, pp. 1239–1242 (w3B4).
Shortis, M.R., Clarke, T.A., and Short, T. 1994. A Comparison of Some Techniques for the Subpixel Location of Discrete Target Images. In Proceedings of the SPIE: Videometrics III, Boston, MA, USA, Vol. 2350, pp. 239–250.
Szeliski, R. and Scharstein, D. 2002. Symmetric Sub-Pixel Stereo Matching, Proceedings of the 7th European Conference on Computer Vision, II:525–540, Copenhagen.
Tian, Q. and Huhns, M.N. 1986. Algorithms for Subpixel Registration. Computer Vision, Graphics and Image Processing, (35):220–233.
West, G.A.W. and Clarke, T.A. 1990. A Survey and Examination of Subpixel Measurement Techniques. In Proceedings of the SPIE: Close-Range Photogrammetry Meets Machine Vision, Zurich, Switzerland, Vol. 1395, pp. 456–463.
Westerweel, J. 1998. Effect on Sensor Geometry on the Performance of PIV interrogation. In Proceedings of the 9th International Symposium on Applications of Laser Techniques to Fluid Mechanics, Lisbon, Portugal, page 1.2.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Shimizu, M., Okutomi, M. Sub-Pixel Estimation Error Cancellation on Area-Based Matching. Int J Comput Vision 63, 207–224 (2005). https://doi.org/10.1007/s11263-005-6878-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-005-6878-5