Abstract
The fields of image processing, computer vision and computer graphics have concentrated traditionally on regular 2D images. Recently, images painted on 2D manifolds are becoming more popular and are used in face recognition, volumetric medical image processing, 3D computer graphics, and many other applications. The need has risen to regularize this type of images.
Various manifold representations are the input for these applications. Among the main representations are triangulated manifolds and parametric manifolds. We extend the short time image enhancing Beltrami kernel from 2D images to these manifold representations. This approach suits also other manifold representations that can be easily converted to triangulated manifolds, such as implicit manifolds and point clouds.
The arbitrary time step enabled by the use of the kernel filtering approach offers a tradeoff between the accuracy of the flow and its execution time. The numerical scheme used to construct the kernel makes the method applicable to all types of manifolds, including open manifolds and self intersecting manifolds. The calculations are done on the 2D manifold itself and are not affected by the complexity of the manifold or the dimension of the space in which it is embedded. The method is demonstrated on images painted on synthetic manifolds and is used to selectively smooth face images. Incorporating the geometrical information of the face manifolds in the regularization process yields improved results.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bajaj, C.L., Xu, G.: Anisotropic diffusion of surfaces and functions on surfaces. ACM Transactions on Graphics 22, 4–32 (2003)
Bertalmio, M., Cheng, L., Osher, S., Sapiro, G.: Variational problems and partial differential equations on implicit surfaces. Journal of Computational Physics 174, 759–780 (2001)
Bertalmio, M., Memoli, F., Cheng, L., Sapiro, G., Osher, S.: Variational problems and partial differential equations on implicit surfaces: Bye bye triangulated surfaces? In: Osher, S., Paragios, N. (eds.) Geometric Level Set Methods in Imaging, Vision, and Graphics, pp. 381–398. Springer, New York (2003)
Clarenz, U., Diewald, U., Rumpf, M.: Processing textured surfaces via anisotropic geometric diffusion. IEEE Transactions on Image Processing 13(2), 248–261 (2004)
Kimmel, R., Malladi, R., Sochen, N.: Image processing via the beltrami operator. In: Proc. of 3-rd Asian Conf. on Computer Vision, Hong Kong (January 1998)
Kimmel, R., Malladi, R., Sochen, N.: Images as embedding maps and minimal surfaces: Movies, color, texture, and volumetric medical images. International Journal of Computer Vision 39(2), 111–129 (2000)
Kimmel, R., Sethian, J.: Computing geodesic paths on manifolds. Proceedings of National Academy of Sciences 95(15), 8431–8435 (1998)
Kimmel, R., Sochen, N.: Orientation diffusion or how to comb a porcupine? special issue on PDEs in Image Processing, Computer Vision, and Computer Graphics. Journal of Visual Communication and Image Representation 13, 238–248 (2002)
Memoli, F., Sapiro, G., Osher, S.: Solving variational problems and partial differential equations mapping into general target manifolds. Journal of Computational Physics 195(1), 263–292 (2004)
Osher, S., Sethian, J.: Fronts propagation with curvature dependent speed: Algorithms based on hamilton-jacobi formulations. J. Comput. Phys. 79, 12–49 (1988)
Sethian, J.: A fast marching level set method for monotonically advancing fronts. Proceedings of National Academy of Sciences 93(4), 1591–1595 (1996)
Sethian, J.: Level Set Methods and Fast Marching Methods. Cambridge University Press, Cambridge (1996)
Sochen, N.: Stochastic processes in vision: From langevin to beltrami. In: Proc. of International Conference on Computer Vision, Vancouver, Canada (July 2001)
Sochen, N., Deriche, R., Lopez-Perez, L.: The beltrami flow over implicit manifolds. In: Proc. of 9th International Conference on Computer Vision, Nice (October 2003)
Sochen, N., Deriche, R., Lopez-Perez, L.: The beltrami flow over manifolds. Technical Report TR-4897, INRIA Sophia-Antipolis, Sophia Antipolis, France (2003)
Sochen, N., Kimmel, R., Bruckstein, A.: Diffusions and confusions in signal and image processing. Journal of Mathematical Imaging and Vision 14(3), 195–209 (2001)
Sochen, N., Kimmel, R., Malladi, R.: A general framework for low level vision. IEEE Trans. on Image Processing 7(3), 310–318 (1998)
Sochen, N., Zeevi, Y.Y.: Representation of colored images by manifolds embedded in higher dimensional non-euclidean space. In: Proc. of ICIP 1998, Chicago, IL, January 1998, pp. 166–170 (1998)
Spira, A., Kimmel, R.: Geodesic curvature flow on parametric surfaces. In: Curve and Surface Design: Saint-Malo 2002, Saint-Malo, France, June 2002, pp. 365–373 (2002)
Spira, A., Kimmel, R.: An efficient solution to the eikonal equation on parametric manifolds. In: INTERPHASE 2003 meeting, Isaac Newton Institute for Mathematical Sciences, 2003 Preprints, Preprint no. NI03045-CPD, UK (June 2003)
Spira, A., Kimmel, R.: An efficient solution to the eikonal equation on parametric manifolds. Interfaces and Free Boundaries 6(3), 315–327 (2004)
Spira, A., Kimmel, R., Sochen, N.: Efficient beltrami flow using a short time kernel. In: Griffin, L.D., Lillholm, M. (eds.) Scale-Space 2003. LNCS, vol. 2695, pp. 511–522. Springer, Heidelberg (2003)
Spira, A., Sochen, N., Kimmel, R.: Geometric filters, diffusion flows, and kernels in image processing. In: Eduardo, B.C. (ed.) Handbook of Geometric Computing- Applications in Pattern Recogntion, Computer Vision, Neuralcomputing, and Robotics, February 2005, pp. 203–230. Springer, Heidelberg (2005)
Tsitsiklis, J.: Efficient algorithms for globally optimal trajectories. IEEE Trans. on Automatic Control 40(9), 1528–1538 (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Spira, A., Kimmel, R. (2005). Enhancing Images Painted on Manifolds. In: Kimmel, R., Sochen, N.A., Weickert, J. (eds) Scale Space and PDE Methods in Computer Vision. Scale-Space 2005. Lecture Notes in Computer Science, vol 3459. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11408031_42
Download citation
DOI: https://doi.org/10.1007/11408031_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25547-5
Online ISBN: 978-3-540-32012-8
eBook Packages: Computer ScienceComputer Science (R0)