Abstract
Many vision problems, such as object recognition and image synthesis, are greatly impacted by deformation of objects. In this paper, we develop a deformation model based on Lie algebraic analysis. This work aims to provide a generative model that explicitly decouples deformation from appearance, which is fundamentally different from the prior work that focuses on deformation-resilient features or metrics. Specifically, the deformation group for each object can be characterized by a set of Lie algebraic basis. Such basis for different objects are related via parallel transport. Exploiting the parallel transport relations, we formulate an optimization problem, and derive an algorithm that jointly estimates the deformation basis for a class of objects, given a set of images resulted from the action of the deformations. We test the proposed model empirically on both character recognition and face synthesis.
Chapter PDF
References
Tenenbaum, J., Silva, V., Langford, J.: A global geometric framework for nonlinear dimensionality reduction. Science 290, 2319 (2000)
Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323 (2000)
Belongie, S., Malik, J., Puzicha, J.: Shape context: A new descriptor for shape matching and object recognition. In: Advances in Neural Information Processing Systems, pp. 831–837 (2001)
Keysers, D., Deselaers, T., Gollan, C., Ney, H.: Deformation models for image recognition. IEEE Trans. on Pattern Analysis and Machine Intelligence 29, 1422–1435 (2007)
Simard, P., Cun, Y.L., Denker, J., Victorri, B.: Transformation invariance in pattern recognition: Tangent distance and tangent propagation. International Journal of Imaging Systems and Technology 11, 181–197 (2000)
Hastie, T., Simard, P.: Metrics and models for handwritten character recognition. Statistical Science, 54–65 (1998)
Keysers, D., Macherey, W., Ney, H., Dahmen, J.: Adaptation in statistical pattern recognition using tangent vectors. IEEE Transactions on Pattern Analysis and Machine Intelligence 26, 269–274 (2004)
Frey, B., Jojic, N.: Transformed component analysis: Joint estimation of spatial transformations and image components. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp. 1190–1196. IEEE (1999)
Frey, B., Jojic, N.: Estimating mixture models of images and inferring spatial transformations using the em algorithm. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1. IEEE (1999)
Frey, B., Jojic, N.: Transformation-invariant clustering using the em algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 1–17 (2003)
Miller, E., Matsakis, N., Viola, P.: Learning from one example through shared densities on transforms. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 464–471. IEEE (2000)
Cootes, T., Edwards, G., Taylor, C.: Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 681–685 (2001)
Jones, M., Poggio, T.: Multidimensional morphable models: A framework for representing and matching object classes. International Journal of Computer Vision 29, 107–131 (1998)
Bruhn, A., Weickert, J., Schnörr, C.: Lucas/kanade meets horn/schunck: Combining local and global optic flow methods. International Journal of Computer Vision 61, 211–231 (2005)
LeCun, Y.: Mnist handwritten digit database. AT&T Labs (Online) (1998), http://yann.lecun.com/exdb/mnist
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wei, D., Lin, D., Fisher, J. (2012). Learning Deformations with Parallel Transport. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7573. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33709-3_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-33709-3_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33708-6
Online ISBN: 978-3-642-33709-3
eBook Packages: Computer ScienceComputer Science (R0)