Abstract
We propose a new class of approaches to smooth visual data while preserving significant transitions of these data as clues for segmentation. Formally, the given visual data are represented as a noisy (image) function g, and we present a class of continuously formulated global minimization problems to smooth g. The resulting function u can be characterized as the minimizer of a specific nonquadratic functional or, equivalently, as the result of an associated nonlinear diffusion process. Our approach generalizes the well-known quadratic regularization principle while retaining its attractive properties: For any given g, the solution u to the proposed minimization problem is unique and depends continuously on the data g. Furthermore, convergence of approximate solutions obtained by finite element discretization holds true. We show that the nodal variables of any chosen finite element subspace can be interpreted as computational units whose activation dynamics due to the nonlinear smoothing process evolve like a globally asymptotically stable network. A corresponding analogue implementation is thus feasible and would provide a real time processing stage for the transition preserving smoothing of visual data. Using artificial as well as real data we illustrate our approach by numerical examples. We demonstrate that solutions to our approach improve those obtained by quadratic minimization and show the influence of global parameters which allow for a continuous, scale-dependent, and selective control of the smoothing process.
Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.References
Ambrosio L, Tortorelli VM (1990) Approximation of functionals fepending on jumps by elliptic functionals via Γ-convergence. Commun Pure Appl Math 43: 999–1036
Aubin JP (1972) Approximation of elliptic boundary-value problems. Wiley, New York
Bertero M, Poggio TA, Torre V (1988) Ill-Posed problems in early vision. Proc IEEE 76: 869–889
Blake A, Zisserman A (1987) Visual reconstruction. MIT Press, Cambridge
Browder FE (1970) Existence theorems for nonlinear partial differential equations, Part I. In: Global analysis. Proc Symp Pure Math XVI, Providence, Rhode Island, pp 1–60
Carriero M, Leaci A (1990) Existence theorem for a dirichlet problem with free discontinuity set. Nonlinear Anal Theory Methods Appl 15:661–677
Ciarlet PG (1978) The finite element method for elliptic problems. North-Holland, Amsterdam
Demoment G (1989) Image reconstruction and restoration: overview of common estimation structures and problems. IEEE Trans ASSP 37:2024–2036
Geiger D, Girosi F (1990) Parallel and deterministic algorithms from MRFs: surface reconstruction and integration. In: Faugeras O (ed) First Europ Conf Comp Vision. Springer, Berlin Heidelberg New York, pp 89–98
Geiger D, Yuille A (1991) A common framework for image segmentation. Int J Comp Vision 6: 227–243
Geman S, Geman D (1984) Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans PAMI 6: 721–741
De Giorgi E, Carriero M, Leaci A (1989) Existence theorem for a minimum problem with free discontinuity set. Arch Rat Mech Anal 108: 195–218
Grossberg S, Mingolla E (1985) Neural dynamics of perceptual grouping: textures, boundaries, and emergent segmentations. Percep Psychophys 38: 141–171
Hackbusch W (1985) Multi-grid methods and applications. Springer-Verlag, Berlin Heidelberg New York Tokyo
Hirsch MW (1989) Convergent activation dynamics in continuous time n tworks. Neural Networks 2: 331–349
Horn BKP, Schunck BG (1981) Determining optical flow. Artif Intell 17: 185–203
Hutchinson J, Koch C, Luo J, Mead C (1988) Computing motion using analog and binary resistive networks. IEEE Comput 21: 52–63
Ikeuchi K, Horn BKP (1981) Numerical shape from shading and occluding boundaries. Artif Intell 17: 141–185
Lions JL (1969) Quelques méthodes de résolution des problèmes aux limites non linéaires. Dunod Gauthier-Villars, Paris
March R (1992) Visual reconstruction with discontinuities using variational methods. Image Visual Comp 10: 30–38
Marroquin J, Mitter S, Poggio T (1987) Probabilistic solution of ill-posed problems in computational vision. J Am Stat Assoc 82: 76–89
Mumford D, Shah J (1989) Optimal approximations by piecewise smooth functions and associated variational problems. Commun Pure Appl Math 42: 577–685
Murray DW, Buxton BF (1987) Scene segmentation from visual motion using global optimization. IEEE Trans PAMI 9: 220–228
Nordström N (1990) Biased anisotropic diffusion — a unified regularization and diffusion approach to edge detection. Image Visual Comp 8: 318–327
Ortega JM, Rheinboldt WC (1970) Iterative solution of nonlinear equations in several variables. Academic Press, New York
Perona P, Malik J (1990) Scale-space and edge detection using anisotropic diffusion. IEEE Trans PAMI 12: 629–639
Poggio T, Torre V, Koch C (1985) Computational vision and regularization theory. Nature 317: 314–319
Poggio T, Koch C (1985) Ill-posed problems in early vision: from computational theory to analogue networks. Proc R Soc London [Biol] 226:303–323
Schnörr C (1991) Determining optical flow for irregular domains by minimizing quadratic functionals of a certain class. Int J Comput Vision 6:25–38
Schnörr C (1994) Unique reconstruction of piecewise smooth images by minimizing strictly convex nonquadratic functionals. J Math Imaging Vision 4: 189–198
Shah J (1990) Parameter estimation, multiscale representation and algorithms for energy-minimizing segmentations. Proc Int Conf Patt Rec, Atlantic City, New Jersey
Shah J (1991) Segmentation by nonlinear diffusion. Proc Conf Comp Vis Patt Rec, Lahaine, Maui, Hawaii
Terzopoulos D (1983) Multilevel computational processes for visual surface reconstruction. Comp Vis Graphics Image Proc 24: 52–96
Terzopoulos D (1988) The computation of visible-surface representations. IEEE Trans PAMI 10: 417–438
Tikhonov AN, Arsenin VY (1977) Solutions of ill-posed problems. Wiley, New York
Vainberg M (1973) Variational method and method of monotone operators in the theory of nonlinear equations. Wiley, New York
Walter W (1986) Gewöhnliche Differentialgleichungen. Springer, Berlin Heidelberg New York
Wang T, Mathur B, Hsu A, Koch C (1989) Computing optical flow in he primate visual system: linking computational theory with perception and physiology. In: Durbin R, Miall C, Mitchison G (eds) The computing neuron. Addison-Wesley, New York, pp 371–392
Author information
Authors and Affiliations
Additional information
This article was processed by the author using the Latex style file pljour2 from Springer-Verlag.
Rights and permissions
About this article
Cite this article
Schnörr, C., Sprengel, R. A nonlinear regularization approach to early vision. Biol. Cybern. 72, 141–149 (1994). https://doi.org/10.1007/BF00205978
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF00205978