Abstract
We introduce and study a two-dimensional variational model for the reconstruction of a smooth generic solid shape E, which may handle the self-occlusions and that can be considered as an improvement of the 2.1D sketch of Nitzberg and Mumford (Proceedings of the Third International Conference on Computer Vision, Osaka, 1990). We characterize from the topological viewpoint the apparent contour of E, namely, we characterize those planar graphs that are apparent contours of some shape E. This is the classical problem of recovering a three-dimensional layered shape from its apparent contour, which is of interest in theoretical computer vision. We make use of the so-called Huffman labeling (Machine Intelligence, vol. 6, Am. Elsevier, New York, 1971), see also the papers of Williams (Ph.D. Dissertation, 1994 and Int. J. Comput. Vis. 23:93–108, 1997) and the paper of Karpenko and Hughes (Preprint, 2006) for related results. Moreover, we show that if E and F are two shapes having the same apparent contour, then E and F differ by a global homeomorphism which is strictly increasing on each fiber along the direction of the eye of the observer. These two topological theorems allow to find the domain of the functional ℱ describing the model. Compactness, semicontinuity and relaxation properties of ℱ are then studied, as well as connections of our model with the problem of completion of hidden contours.
Similar content being viewed by others
References
Ambrosio, L., Fusco, N., Pallara, D.: Functions of Bounded Variation and Free Discontinuity Problems. Clarendon, Oxford (2000)
Arnold, V.I.: The Theory of Singularities and Its Applications. Cambridge University Press, Cambridge (1991)
Bellettini, G., Dal Maso, G., Paolini, M.: Semicontinuity and relaxation properties of a curvature depending functional in 2D. Ann. Sc. Norm. Super Pisa Cl. Sci. 20(4), 247–299 (1993)
Bellettini, G., Paolini, M.: Variational properties of an image segmentation functional depending on contours curvature. Adv. Math. Sci. Appl. 5, 681–715 (1995)
Bellettini, G., March, R.: An image segmentation variational model with free discontinuities and contour curvature. Math. Models Methods Appl. Sci. 14, 1–45 (2004)
Bellettini, G., March, R.: Variational properties of a model for image segmentation with overlapping regions. In: Variational Methods for Discontinuous Structures, Cernobbio (Como), 4–6 July 2001. Birkhäuser, Basel (2001)
Bellettini, G., Mugnai, L.: Characterization and representation of the lower semicontinuous envelope of the elastica functional. Ann. Inst. Henri Poincaré Anal. Non Linéaire 21(6), 839–880 (2004)
Braides, A., March, R.: Approximation by Γ-convergence of a curvature depending functional in visual reconstruction. Commun. Pure Appl. Math. 59, 71–121 (2006)
Coscia, A.: On curvature sensitive image segmentation. Nonlinear Anal. 39, 711–730 (2000)
Huffman, D.A.: Impossible objects as nonsense sentences. In: Meltzer, B., Michie, D. (eds.) Machine Intelligence, vol. 6. Am. Elsevier, New York (1971)
Kanizsa, G.: Organization in Vision. Praeger, New York (1979)
Karpenko, O.A., Hughes, J.F.: SmoothSketch: 3D free-form shapes from complex sketches. In: The 33rd International Conference and Exhibition on Computer Graphics and Imaging Techniques, Boston, MA (2006).
Koenderink, J.J.: Solid Shape. MIT Press, Cambridge (1990)
Koenderink, J.J., van Doorn, A.J.: The singularities of the visual mapping. Biol. Cybern. 24, 51–59 (1976)
Luminati, D.: Surfaces with assigned apparent contour. Ann. Sc. Norm. Super. Pisa Cl. Sci. IV. Ser. 21 3, 311–341 (1994)
Morel, J.-M., Solimini, S.: Variational Methods in Image Segmentation. Progress in Nonlinear Differential Equations and Their Applications, vol. 14. Birkhäuser, Boston (1995)
Mumford, D., Shah, J.: Optimal approximations by piecewise smooth functions and associated variational problems. Commun. Pure Appl. Math. 42, 577–685 (1989)
Munkres, J.R.: Topology, 2nd edn. Prentice Hall, Englewood Cliffs (2000), p. xvi
Nitzberg, M., Mumford, D.: The 2.1-D sketch. In: Proceedings of the Third International Conference on Computer Vision, Osaka (1990)
Nitzberg, M., Mumford, D., Shiota, T.: Filtering, Segmentation and Depth. Lecture Notes in Computer Science, vol. 662. Springer, Berlin (1993)
Pignoni, R.: On surfaces and their contour. Manuscripta Math. 72, 223–249 (1991)
Whitney, H.: On singularities of mappings of euclidean spaces. I. Mappings of the plane into the plane. Ann. Math. 62, 374–410 (1955)
Williams, L.R.: Perceptual completion of occluded surfaces. Ph.D. Dissertation, Dept. of Computer Science, Univ. of Massachusetts, Amherst (1994)
Williams, L.R.: Topological reconstruction of a smooth manifold-solid from its occluding contour. Int. J. Comput. Vis. 23, 93–108 (1997)
Author information
Authors and Affiliations
Corresponding author
Additional information
The first author gratefully acknowledges the hospitality and the support of the Max Planck Institute for Gravitational Physics in Golm, where this paper was completed. The authors are also grateful to Marc Alexa who, during the Oberwolfach meeting “Trends in Mathematical Imaging and Surface Processing” (January 2007) pointed out the connections of Theorem 5.1 with the work of Huffman 10, Williams 24, and Karpenko and Hughes 12.
Rights and permissions
About this article
Cite this article
Bellettini, G., Beorchia, V. & Paolini, M. Topological and Variational Properties of a Model for the Reconstruction of Three-Dimensional Transparent Images with Self-Occlusions. J Math Imaging Vis 32, 265–291 (2008). https://doi.org/10.1007/s10851-008-0100-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-008-0100-7