Skip to main content
Log in

A Nonlinear Structure Tensor with the Diffusivity Matrix Composed of the Image Gradient

  • Published:
Journal of Mathematical Imaging and Vision Aims and scope Submit manuscript

Abstract

We propose a nonlinear partial differential equation (PDE) for regularizing a tensor which contains the first derivative information of an image such as strength of edges and a direction of the gradient of the image. Unlike a typical diffusivity matrix which consists of derivatives of a tensor data, we propose a diffusivity matrix which consists of the tensor data itself, i.e., derivatives of an image. This allows directional smoothing for the tensor along edges which are not in the tensor but in the image. That is, a tensor in the proposed PDE is diffused fast along edges of an image but slowly across them. Since we have a regularized tensor which properly represents the first derivative information of an image, the tensor is useful to improve the quality of image denoising, image enhancement, corner detection, and ramp preserving denoising. We also prove the uniqueness and existence of solution to the proposed PDE.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Perona, P., Malik, J.: Scale space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 12, 629–639 (1990)

    Article  Google Scholar 

  2. Catté, F., Lions, P.L., Morel, J.M., Coll, T.: Image selective smoothing and edge detection by nonlinear diffusion. SIAM J. Numer. Anal. 29, 182–193 (1992)

    Article  MATH  MathSciNet  Google Scholar 

  3. Weickert, J.: Coherence-enhancing diffusion filtering. Int. J. Comput. Vis. 31, 111–127 (1999)

    Article  Google Scholar 

  4. Bigün, J., Granlund, G.H.: Optimal orientation detection of linear symmetry. In: First International Conference on Computer Vision, London, pp. 433–438 (1987)

  5. Kass, M., Witkin, A.: Analyzing oriented patterns. Comput. Vis. Graph. Image Process. 37, 362–385 (1987)

    Article  Google Scholar 

  6. Jähne, B.: Digital Image Processing. Springer, Berlin (2005)

    Google Scholar 

  7. Brox, T., van den Boomgaard, R., Lauze, F.B., van de Weijer, H., Weickert, J., Mrázek, P., Kornprobst, P.: Adaptive structure tensors and their applications. In: Weickert, J., Hagen, H. (Eds.) Visualization and Processing of Tensor Fields, pp. 17–42. Springer, Berlin (2006)

    Chapter  Google Scholar 

  8. Bigün, J., Granlund, G.H., Wiklund, J.: Multidimensional orientation estimation with applications to texture analysis and optical flow. IEEE Trans. Pattern Anal. Mach. Intell. 13, 1349–1356 (1991)

    Article  Google Scholar 

  9. Weickert, J., Schnörr, C.: A theoretical framework for convex regularizers in PDE-based computation of image motion. Int. J. Comput. Vis. 45, 245–264 (2001)

    Article  MATH  Google Scholar 

  10. Brox, T., Weickert, J., Burgeth, B., Mrázek, P.: Nonlinear structure tensors. Image Vis. Comput. 24, 41–55 (2006)

    Article  Google Scholar 

  11. Gerig, G., Kübler, O., Kikinis, R., Jolesz, F.A.: Nonlinear anisotropic filtering of MRI data. IEEE Trans. Med. Imaging 1, 221–232 (1992)

    Article  Google Scholar 

  12. Parker, G.J.M., Schnabel, J.A., Symms, M.R., Werring, D.J., Barker, G.J.: Nonlinear smoothing for reduction systematic and random errors in diffusion tensor imaging. J. Mag. Reson. Imaging. 11, 702–710 (2000)

    Article  Google Scholar 

  13. Tschumperlé, D., Deriche, R.: Diffusion tensor regularization with constraints preservation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 948–953. Kauai Marriott, Hawaii (2001)

    Google Scholar 

  14. Tschumperlé, D., Deriche, R.: Orthonormal vector sets regularization with PDE’s and applications. Int. J. Comput. Vis. 50, 237–252 (2002)

    Article  MATH  Google Scholar 

  15. Vese, L.A., Osher, S.: Numerical methods for p-harmonic flows applications to image processing. SIAM J. Numer. Anal. 40, 2085–2104 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  16. Lysaker, M., Osher, S., Tai, X.-C.: Noise removal using smoothed normals and surface fitting. IEEE Trans. Image Process. 13, 1345–1357 (2004)

    Article  MathSciNet  Google Scholar 

  17. Sochen, N.A., Sagiv, C., Kimmel, R.: Stereographic combing a porcupine or studies on direction diffusion in image processing. SIAM J. Appl. Math. 64, 1477–1508 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  18. Tai, X.-C., Osher, S., Holm, R.: Image inpainting using TV-Stokes equation. In: Image Processing Based on Partial Differential Equations. Springer, Heidelberg (2006)

    Google Scholar 

  19. Weickert, J., Brox, T.: Diffusion and regularization of vector- and matrix-valued images. In: Nashed, M.Z., Scherzer, O. (eds.) Inverse Problems, Image Analysis, and Medical Imaging. Contemporary Mathematics, vol. 313, pp. 251–268. AMS, Providence (2002)

    Google Scholar 

  20. Weickert, J.: Scale-space properties of nonlinear diffusion filtering with a diffusion tensor. Tech. Rep. 110, Laboratory of Technomathematics, University of Kaiserslautern, Germany, October 1994

  21. Evans, C.L.: Partial Differential Equations. Graduate Studies in Mathematics, vol. 19. American Mathematical Society, Providence (1998)

    MATH  Google Scholar 

  22. Brezis, H.: Analyse Fonctionnelle. Dunod, Masson (1992)

    Google Scholar 

  23. Köthe, U.: Edge and junction detection with an improved structure tensor. In: Michaelis, B., Krell, G. (eds.) Pattern Recognition, Proc. of 25th DAGM Symposium, Magdeburg. Lecture Notes in Computer Science, vol. 2781, pp. 25–32. Springer, Berlin (2003)

    Google Scholar 

  24. Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60, 259–268 (1992)

    Article  MATH  Google Scholar 

  25. Weickert, J.: Coherence-enhancing shock filters. In: Michaelis, B., Krell, G. (eds.) Pattern Recognition, Proc. of 25th DAGM Symposium, Magdeburg. Lecture Notes in Computer Science, vol. 2781, pp. 1–8. Springer, Berlin (2003)

    Google Scholar 

  26. Kornprobst, P., Deriche, R., Aubert, G.: Image coupling, restoration and enhancement via PDE’s. In: Proc. of the International Conference on Image Processing, vol. 2, Santa Barbara, CA, pp. 458–261 (1997)

  27. Osher, S., Rudin, L.I.: Feature-oriented image enhancement using shock filters. SIAM J. Numer. Anal. 27, 919–940 (1990)

    Article  MATH  Google Scholar 

  28. Alvarez, L., Mazorra, L.: Signal and image restoration using shock filters and anisotropic diffusion. SIAM J. Numer. Anal. 31, 590–605 (1994)

    Article  MATH  MathSciNet  Google Scholar 

  29. Lee, S., Seo, J.K., Park, C., Lee, B.I., Woo, E.J., Lee, S.Y., Kwon, O., Hahn, J.: Conductivity image reconstruction from defective data in MREIT: numerical simulation and animal experiment. IEEE Trans. Med. Imaging 25, 168–176 (2006)

    Article  Google Scholar 

  30. Buades, A., Coll, B., Morel, J.M.: The staircasing effect in neighborhood filters and its solution. IEEE Trans. Image Process. 15, 1499–1505 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jooyoung Hahn.

Additional information

This work was supported by KRF-2006-311-C00015. The research is supported by MOE (Ministry of Education) Tier II project T207N2202 and IDM project NRF2007IDMIDM002-010. In addition, support from SUG 20/07 is also gratefully acknowledged.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hahn, J., Lee, CO. A Nonlinear Structure Tensor with the Diffusivity Matrix Composed of the Image Gradient. J Math Imaging Vis 34, 137–151 (2009). https://doi.org/10.1007/s10851-009-0138-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10851-009-0138-1

Keywords

Navigation