Skip to main content
SpringerLink
Log in

Segmentation of range images as the search for geometric parametric models

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

Segmentation of range images has long been considered in computer vision as an important but extremely difficult problem. In this paper we present a new paradigm for the segmentation of range images into piecewise continuous surfaces. Data aggregation is performed via model recovery in terms of variable-order bi-variate polynomials using iterative regression. Model recovery is initiated independently in regularly placed seed regions in the image. All the recovered models are potential candidates for the final description of the data. Selection of the models is defined as a quadratic Boolean problem, and the solution is sought by the WTA (winner-takes-all) technique, which turns out to be a good compromise between the speed of computation and the accuracy of the solution. The overall efficiency of the method is achieved by combining model recovery and model selection in an iterative way. Partial recovery of the models is followed by the selection (optimization) procedure and only the “best” models are allowed to develop further.

The major novelty of the approach lies in an effective combination of simple component algorithms, which stands in contrast to methods which attempt to solve the problem in a single processing step using sophisticated means. We present the results on several real range images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Ackley, D.H. 1987.Stochastic Iterated Genetic Hillclimbing. PhD thesis, Department of Computer Science, Carnegie Mellon University.

  • Asada, H. and Brady, M. 1986. The curvature primal sketch.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-8(1):2–14.

    Google Scholar 

  • Bajcsy, R. 1988. Active perception.Proceedings of the IEEE, 76(8):996–1005.

    Google Scholar 

  • Bajcsy, R., Solina, F., and Gupta, A. 1990. Segmentation versus object representation-Are they separable? In Jain, R. and Jain, A.K., editors,Analysis and Interpretation of Range Images. Springer-Verlag: New York.

    Google Scholar 

  • Besl, P.J. 1988.Surfaces in Range Image Understanding. Springer-Verlag: New York.

    Google Scholar 

  • Besl, P.J., Birch, J.B., and Watson, L.T. 1988. Robust window operators. InProceedings of the 2nd International Conference on Computer Vision, Tampa, FL, pp. 591–600.

  • Besl, P.J. and Jain, R.C. 1985. Three-dimensional object recognition.ACM Computing Surveys, 17(1):75–145.

    Google Scholar 

  • Besl, P.J. and Jain, R.C. 1986. Invariant surface characteristics for three-dimensional object recognition in range images.Computer Vision, Graphics, and Image Processing, 33(1):33–80.

    Google Scholar 

  • Besl, P.J. and Jain, R.C. 1988. Segmentation through variable-order surface fitting.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-10(2):167–192.

    Google Scholar 

  • Binford, T.O. 1982. Survey of model-based image analysis systems. International Journal of Robotics Research, 1(1):18–64.

    Google Scholar 

  • Blake, A. and Zisserman, A. 1987.Visual Reconstruction. The MIT Press: Cambridge, Massachusetts.

    Google Scholar 

  • Bolle, R.M. and Vermuri, B.C. 1991. On three-dimensional surface reconstruction methods.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-13(1):1–13.

    Google Scholar 

  • Brady, M. 1983. Criteria for representations of shape. In Beck, J., Hope, B., and Rosenfeld, A., editors,Human and Machine Vision. Academic Press: New York.

    Google Scholar 

  • Brady, M., Ponce, J., Yuille, A., and Asada, H. 1985. Describing surfaces.Computer Vision, Graphics, and Image Processing, 32(1):1–28.

    Google Scholar 

  • Chen, D.S. 1989. A data-driven intermediate level feature extraction algorithm.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-11(7):749–758.

    Google Scholar 

  • Cherkassky, D. 1991. Implementation of algorithms on the Connection Machine. In GRASP News, Vol. 7, No. 1. University of Pennsylvania, Philadelphia, PA. MS-CIS-91-20, GRASP LAB 256.

    Google Scholar 

  • Fan, T.J. 1988.Describing and Recognizing 3-D Objects Using Surface Properties. PhD thesis, University of Southern California. Technical report IRIS 237.

  • Faugeras, O.D. and Hebert, M. 1986. The representation, recognition, and locating of 3-D objects.The International Journal of Robotics Research, 5(3):27–52.

    Google Scholar 

  • Feldman, J.A. 1982. Dynamic connections in neural networks.Biological Cybernetics, 46:27–39.

    Google Scholar 

  • Fua, P. and Hanson, A.J. 1989. Objective functions for feature discrimination. InProceedings of the 11th International Joint Conference on Artificial Intelligence, Detroit, MI, pp. 1596–1602.

  • Godin, G.D. and Levine, M.D. 1989. Structured edge map of Curved objects in a range image. InProceedings of Conference on Computer Vision and Pattern Recognition, San Diego, CA, pp. 276–281.

  • Gupta, A. and Bajcsy, R. 1993. Volumetric segmentation of range images of 3-D objects using superquadrics.Computer Vision, Graphics, and Image Processing: Image Understanding, 58(3): 302–326.

    Google Scholar 

  • Hochberg, J. 1981. Levels of perceptual organization. In Kubovy, M. and Pomerantz, J.R., editors,Perceptual Organization. Lawrence Erlbaum Associates: New Jersey. pp. 255–276.

    Google Scholar 

  • Hoffman, R. and Jain, A.K. 1987. Segmentation and classification of range images.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-9(5):608–620.

    Google Scholar 

  • Hopfield, J.J. and Tank, D.W. 1985. “Neural” computation of decisions in optimization problems.Biological Cybernetics, 52:141–152.

    Google Scholar 

  • Horowitz, S.L. and Pavlidis, T. 1974. Picture segmentation by a directed split-and-merge procedure. InProceedings of the 2nd International Joint Conference on Pattern Recognition, pp. 424–433.

  • Jain, R.C. and Binford, T.O. 1991. Ignorance, myopia, and naivete in computer vision systems.Computer Vision, Graphics, and Image Processing: Image Understanding, 53(1):112–117.

    Google Scholar 

  • Kirkpatrick, S., Gelatt, C.D., and Vecchi, M.P. 1983. Optimization by simulated annealing.Science, 220:671–680.

    Google Scholar 

  • Koch, C. and Ullman, S. 1984. Selecting one among many: A simple network implementing shifts in selective visual attention. Technical Report A.I. Memo 770, C.B.I.P. Paper 3, Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA.

    Google Scholar 

  • Leclerc, Y.G. 1989. Constructing simple stable descriptions for image partitioning.International Journal of Computer Vision, 3:73–102.

    Google Scholar 

  • Leonardis, A. 1993.Image Analysis Using Parametric Models: Model-Recovery and Model-Selection Paradigm. PhD thesis, Faculty of Electrical Engineering and Computer Science, University of Ljubljana, Slovenia. Technical Report LRV-93-3.

    Google Scholar 

  • Leonardis, A. and Bajcsy, R. 1992. Finding parametric curves in an image. In Sandini, G., editor,Proceedings of The Second European Conference on Computer Vision—ECCV-92, Santa Margherita Ligure, Italy, pp. 653–657. Springer-Verlag. Lecture Notes in Computer Science, LNCS-Series Vol. 588.

  • Leonardis, A., Solina, E., and Macerl, A. 1994. A direct recovery of superquadric models in range images using recover-and-select paradigm. In Eklundh J.-O., ed.,Proceedings of The Third European Conference on Computer Vision-ECCV-94, Stockholm, Sweden. Springer-Verlag. Lecture Notes in Computer Science, LNCS - Series vol. 800.

  • Li, G. 1985. Robust regression. In Hoaglin, D.C., Mosteller, E., and Tukey, J.W., editors,Exploring Data Tables, Trends and Shapes. Wiley: New York. pp. 281–343.

    Google Scholar 

  • Liang, P. and Todhunter, J.S. 1990. Representation and recognition of surface shapes in range images: A differential geometry approach.Computer Vision, Graphics, and Image Processing, 52(1):78–109.

    Google Scholar 

  • Marr, D. 1982.Vision. Freeman: San Francisco, CA.

    Google Scholar 

  • Mumford, D. and Shah, J. 1985. Boundary detection by minimizing functionals, I. InProc. IEEE Comp. Soc. Conf. Computer Vision and Pattern Recognition, San Francisco, CA, pp. 22–26.

  • Nackman, L.R. 1984. Two-dimensional critical point configuration graphs.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-6(4):442–449.

    Google Scholar 

  • Pentland, A.R. 1989. Part segmentation for object recognition.Neural Computation, 1:82–91.

    Google Scholar 

  • Pentland, A.R. 1990. Automatic extraction of deformable part models.International Journal of Computer Vision, 4:107–126.

    Google Scholar 

  • Poggio, T., Torre, V., and Koch, C. 1985. Computational vision and regularization theory.Nature, 317:314–319.

    Google Scholar 

  • Ponce, J. and Brady, M. 1985. Toward a surface primal sketch. In Kanade, T., editor, Three Dimensional Vision. Academic Press: New York.

    Google Scholar 

  • Rissanen, J. 1984. Universal coding, information, prediction, and estimation.IEEE Transactions on Information Theory, 30:629–636.

    Google Scholar 

  • Sander, P.T. and Zucker, S. 1988. Inferring differential structure from 3-D images: Smooth cross sections of fibre bundles. McGill University, Canada, Technical Report TR-CIM-88-6.

    Google Scholar 

  • Seber, G. A.F. 1977.Linear Regression Analysis. Wiley: New York. Chapter 11.

    Google Scholar 

  • Smith, D.R. and Kanade, T. 1985. Autonomous scene description with range imagery.Computer Vision, Graphics, and Image Processing, 31(3):322–334.

    Google Scholar 

  • Terzopoulos, D. 1986. Regularization of inverse visual problems involving discontinuities.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-8(4):413–424.

    Google Scholar 

  • Zucker, S.W. 1976. Region growing: childhood and adolescence.Computer Graphics and Image Processing, 5:382–399.

    Google Scholar 

Download references

Author information

Author notes

  1. Aleš Leonardis

    Present address: Department of Electrical Engineering and Computer Science, Computer Vision Laboratory, University of Ljubljana, Tržaška c. 25, 61001, Ljubljana, Slovenia

  2. Alok Gupta

    Present address: Siemens Corporate Research at Princeton, New Jersey, USA

Authors and Affiliations

  1. GRASP Laboratory, Department of Computer and Information Science, University of Pennsylvania, 19104, Philadelphia, PA

    Aleš Leonardis, Alok Gupta & Ruzena Bajcsy

Authors
  1. Aleš Leonardis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alok Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ruzena Bajcsy
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Leonardis, A., Gupta, A. & Bajcsy, R. Segmentation of range images as the search for geometric parametric models. Int J Comput Vision 14, 253–277 (1995). https://doi.org/10.1007/BF01679685

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01679685

Keywords

Search

Navigation