Abstract
While modelling spatially uniform or low-order polynomial contrast and offset changes is mostly a solved problem, there has been limited progress in models which could represent highly inhomogeneous photometric variations. A recent quadratic programming (QP) based matching allows for almost arbitrary photometric deviations. However this QP-based approach is deficient in one substantial respect: it can only assume that images are aligned geometrically as it knows nothing about geometry in general. This paper improves on the QP-based framework by extending it to include a robust rigid registration layer thus increasing both its generality and practical utility. The proposed method shows up to 4 times improvement in the quadratic matching score over a current state-of-the-art benchmark.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Basri, R., Jacobs, D., Kemelmacher, I.: Photometric stereo with general, unknown lighting. International Journal of Computer Vision 72(3), 239–257 (2007)
Chen, J., Chen, C., Chen, Y.: Fast algorithm for robust template matching with M-estimators. IEEE Trans. on Signal Processing 51(1), 230–243 (2003)
Crowley, J., Martin, J.: Experimental comparison of correlation techniques. In: Proc. International Conference on Intelligent Autonomous Systems (IAS-4), Karlsruhe, Germany, March 27-30, pp. 86–93 (1995)
Fitch, A., Kadyrov, A., Christmas, W., Kittler, J.: Fast robust correlation. IEEE Trans. on Image Processing 14(8), 1063–1073 (2005)
Gruen, A.: Adaptive least squares correlation: a powerful image matching technique. South African Journal of Photogrammetry, Remote Sensing and Cartography 14(3), 175–187 (1985)
Kovalevsky, V.: The problem of character recognition from the point of view of mathematical statistics. In: Kovalevsky, V. (ed.) Character Readers and Pattern Recognition. Spartan, New York (1968)
Lai, S.: Robust image matching under partial occlusion and spatially varying illumination change. Computer Vision and Image Understanding 78(1), 84–98 (2000)
Lai, S., Fang, M.: Method for matching images using spatially-varying illumination change models, US patent 6,621,929 (September 2003)
M.I.T. face database (accessed August 24, 2006) http://vismod.media.mit.edu/pub/images
Pizarro, D., Peyras, J., Bartoli, A.: Light-invariant fitting of active appearance models. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, Anchorage, Alaska, pp. 1–6 (June 2008)
Shorin, A.: Modelling Inhomogeneous Noise and Large Occlusions for Robust Image Matching. Ph.D. thesis, University of Auckland (2010)
Shorin, A., Gimel’farb, G., Delmas, P., Morris, J.: Image matching with spatially variant contrast and offset: A quadratic programming approach. In: Kasparis, T., Kwok, J. (eds.) S+SSPR 2008. LNCS, vol. 5342, pp. 100–107. Springer, Heidelberg (2008)
Silveira, G., Malis, E.: Real-time visual tracking under arbitrary illumination changes. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, June 17-22, pp. 1–6 (2007)
Tombari, F., Di Stefano, L., Mattoccia, S.: A robust measure for visual correspondence. In: Proc. 14th Int. Conf. on Image Analysis and Processing (ICIAP), Modena, Italy, pp. 376–381 (September 2007)
Wei, S., Lai, S.: Robust and efficient image alignment based on relative gradient matching. IEEE Trans. on Image Processing 15(10), 2936–2943 (2006)
Yang, C., Lai, S., Chang, L.: Robust face image matching under illumination variations. Journal on Applied Signal Processing 2004(16), 2533–2543 (2004)
Zhu, G., Zhang, S., Chen, X., Wang, C.: Efficient illumination insensitive object tracking by normalized gradient matching. IEEE Signal Processing Letters 14(12), 944–947 (2007)
Zou, J., Ji, Q., Nagy, G.: A comparative study of local matching approach for face recognition. IEEE Trans. on Image Processing 16(10), 2617–2628 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shorin, A., Gimel’farb, G., Delmas, P., Riddle, P. (2010). Constraint Optimisation for Robust Image Matching with Inhomogeneous Photometric Variations and Affine Noise. In: Blanc-Talon, J., Bone, D., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2010. Lecture Notes in Computer Science, vol 6474. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17688-3_44
Download citation
DOI: https://doi.org/10.1007/978-3-642-17688-3_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17687-6
Online ISBN: 978-3-642-17688-3
eBook Packages: Computer ScienceComputer Science (R0)