Abstract
We propose a nonlinear partial differential equation (PDE) for regularizing a tensor which contains the first derivative information of an image such as strength of edges and a direction of the gradient of the image. Unlike a typical diffusivity matrix which consists of derivatives of a tensor data, we propose a diffusivity matrix which consists of the tensor data itself, i.e., derivatives of an image. This allows directional smoothing for the tensor along edges which are not in the tensor but in the image. That is, a tensor in the proposed PDE is diffused fast along edges of an image but slowly across them. Since we have a regularized tensor which properly represents the first derivative information of an image, the tensor is useful to improve the quality of image denoising, image enhancement, corner detection, and ramp preserving denoising. We also prove the uniqueness and existence of solution to the proposed PDE.
Similar content being viewed by others
References
Perona, P., Malik, J.: Scale space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 12, 629–639 (1990)
Catté, F., Lions, P.L., Morel, J.M., Coll, T.: Image selective smoothing and edge detection by nonlinear diffusion. SIAM J. Numer. Anal. 29, 182–193 (1992)
Weickert, J.: Coherence-enhancing diffusion filtering. Int. J. Comput. Vis. 31, 111–127 (1999)
Bigün, J., Granlund, G.H.: Optimal orientation detection of linear symmetry. In: First International Conference on Computer Vision, London, pp. 433–438 (1987)
Kass, M., Witkin, A.: Analyzing oriented patterns. Comput. Vis. Graph. Image Process. 37, 362–385 (1987)
Jähne, B.: Digital Image Processing. Springer, Berlin (2005)
Brox, T., van den Boomgaard, R., Lauze, F.B., van de Weijer, H., Weickert, J., Mrázek, P., Kornprobst, P.: Adaptive structure tensors and their applications. In: Weickert, J., Hagen, H. (Eds.) Visualization and Processing of Tensor Fields, pp. 17–42. Springer, Berlin (2006)
Bigün, J., Granlund, G.H., Wiklund, J.: Multidimensional orientation estimation with applications to texture analysis and optical flow. IEEE Trans. Pattern Anal. Mach. Intell. 13, 1349–1356 (1991)
Weickert, J., Schnörr, C.: A theoretical framework for convex regularizers in PDE-based computation of image motion. Int. J. Comput. Vis. 45, 245–264 (2001)
Brox, T., Weickert, J., Burgeth, B., Mrázek, P.: Nonlinear structure tensors. Image Vis. Comput. 24, 41–55 (2006)
Gerig, G., Kübler, O., Kikinis, R., Jolesz, F.A.: Nonlinear anisotropic filtering of MRI data. IEEE Trans. Med. Imaging 1, 221–232 (1992)
Parker, G.J.M., Schnabel, J.A., Symms, M.R., Werring, D.J., Barker, G.J.: Nonlinear smoothing for reduction systematic and random errors in diffusion tensor imaging. J. Mag. Reson. Imaging. 11, 702–710 (2000)
Tschumperlé, D., Deriche, R.: Diffusion tensor regularization with constraints preservation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 948–953. Kauai Marriott, Hawaii (2001)
Tschumperlé, D., Deriche, R.: Orthonormal vector sets regularization with PDE’s and applications. Int. J. Comput. Vis. 50, 237–252 (2002)
Vese, L.A., Osher, S.: Numerical methods for p-harmonic flows applications to image processing. SIAM J. Numer. Anal. 40, 2085–2104 (2002)
Lysaker, M., Osher, S., Tai, X.-C.: Noise removal using smoothed normals and surface fitting. IEEE Trans. Image Process. 13, 1345–1357 (2004)
Sochen, N.A., Sagiv, C., Kimmel, R.: Stereographic combing a porcupine or studies on direction diffusion in image processing. SIAM J. Appl. Math. 64, 1477–1508 (2004)
Tai, X.-C., Osher, S., Holm, R.: Image inpainting using TV-Stokes equation. In: Image Processing Based on Partial Differential Equations. Springer, Heidelberg (2006)
Weickert, J., Brox, T.: Diffusion and regularization of vector- and matrix-valued images. In: Nashed, M.Z., Scherzer, O. (eds.) Inverse Problems, Image Analysis, and Medical Imaging. Contemporary Mathematics, vol. 313, pp. 251–268. AMS, Providence (2002)
Weickert, J.: Scale-space properties of nonlinear diffusion filtering with a diffusion tensor. Tech. Rep. 110, Laboratory of Technomathematics, University of Kaiserslautern, Germany, October 1994
Evans, C.L.: Partial Differential Equations. Graduate Studies in Mathematics, vol. 19. American Mathematical Society, Providence (1998)
Brezis, H.: Analyse Fonctionnelle. Dunod, Masson (1992)
Köthe, U.: Edge and junction detection with an improved structure tensor. In: Michaelis, B., Krell, G. (eds.) Pattern Recognition, Proc. of 25th DAGM Symposium, Magdeburg. Lecture Notes in Computer Science, vol. 2781, pp. 25–32. Springer, Berlin (2003)
Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60, 259–268 (1992)
Weickert, J.: Coherence-enhancing shock filters. In: Michaelis, B., Krell, G. (eds.) Pattern Recognition, Proc. of 25th DAGM Symposium, Magdeburg. Lecture Notes in Computer Science, vol. 2781, pp. 1–8. Springer, Berlin (2003)
Kornprobst, P., Deriche, R., Aubert, G.: Image coupling, restoration and enhancement via PDE’s. In: Proc. of the International Conference on Image Processing, vol. 2, Santa Barbara, CA, pp. 458–261 (1997)
Osher, S., Rudin, L.I.: Feature-oriented image enhancement using shock filters. SIAM J. Numer. Anal. 27, 919–940 (1990)
Alvarez, L., Mazorra, L.: Signal and image restoration using shock filters and anisotropic diffusion. SIAM J. Numer. Anal. 31, 590–605 (1994)
Lee, S., Seo, J.K., Park, C., Lee, B.I., Woo, E.J., Lee, S.Y., Kwon, O., Hahn, J.: Conductivity image reconstruction from defective data in MREIT: numerical simulation and animal experiment. IEEE Trans. Med. Imaging 25, 168–176 (2006)
Buades, A., Coll, B., Morel, J.M.: The staircasing effect in neighborhood filters and its solution. IEEE Trans. Image Process. 15, 1499–1505 (2006)
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by KRF-2006-311-C00015. The research is supported by MOE (Ministry of Education) Tier II project T207N2202 and IDM project NRF2007IDMIDM002-010. In addition, support from SUG 20/07 is also gratefully acknowledged.
Rights and permissions
About this article
Cite this article
Hahn, J., Lee, CO. A Nonlinear Structure Tensor with the Diffusivity Matrix Composed of the Image Gradient. J Math Imaging Vis 34, 137–151 (2009). https://doi.org/10.1007/s10851-009-0138-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-009-0138-1