Skip to main content
SpringerLink
Log in

Noise Reduction in Surface Reconstruction from a Given Gradient Field

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

We present a gradient space technique for noise reduction in surfaces reconstructed from a noisy gradient field. We first analyze the error sources in the recovered gradient field of a surface using a three-image photometric stereo method. Based on this analysis, we propose an additive noise model to describe the errors in the surface gradient estimates. We then use a vector space formulation and construct a multiscale orthonormal expansion for gradient fields. Using the sparse representation properties of this expansion, we develop techniques for reducing the gradient field noise by coefficient selection with thresholding. The simulation results indicate that the proposed technique provides significant improvement on the noise levels of both the estimated gradient fields and the reconstructed surfaces under heavy noise levels. Furthermore, the experiments using noisy photometric stereo image triplets of real range data suggest that the additive model remains viable after the nonlinear photometric stereo operation to provide accurate noise removal.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Buzbee, B., Golub, G., and Nielson, C. 1970. On direct methods of solving poisson's equations. SIAM Journal of Numerical Analysis, 7:627–656.

    Google Scholar 

  • Chang, S.G., Bin, Y., and Vetterli, M. 2000. Adaptive wavelet thresholding for image denoising and compression. IEEE Transactions on Image Processing, 9(9):1532–1546.

    Google Scholar 

  • Courant, R. and Hilbert, D. 1962. Methods of Mathematical Physics. John Wiley & Sons: New York.

    Google Scholar 

  • Daubechies, I. 1988. Orthonormal bases of compactly supported wavelets. Communications on Pure and Applied Mathematics, 41:909–996.

    Google Scholar 

  • Deift, P. and Sylvester, J. 1981, Some remarks on shape from shading problems in computer vision. Journal of Mathematical Analysis and Applications, 34:235–248.

    Google Scholar 

  • Donoho, D.L. and Johnstone, I.M. 1994. Ideal denoising in an orthonormal basis chosen from a library of bases. Comptes Rendus de l'Académie des Sciences, Série I, 319.

    Google Scholar 

  • Embrechts, P., Klüppelberg, C., and Mikosch, T. 1997. Modelling extremal events for insurance and finance. In Applications of Mathematics: Stochastic Modelling and Applied Probability. Springer: Berlin.

    Google Scholar 

  • Frankot, R.T. and Chellappa, R. 1988. A method for enforcing integrability in shape from shading algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(4):439–451.

    Google Scholar 

  • Frankot, R.T. and Chellappa, R. 1989. A method for enforcing integrability in shape from shading algorithms. In Shape from Shading, B.K.P. Horn and M.J. Brooks (Eds.). The MIT Press, Chapt. 5, pp. 89–122.

    Google Scholar 

  • Galo, M. and Tozzi, C.L. 1996. Surface reconstruction using multiple light sources and perspective projection. In IEEE International Conference on Image Processing, vol. 2, pp. 309–312.

    Google Scholar 

  • Grossberg, M.D. and Nayar, S.K. 2001.Ageneral imaging model and a method for finding its parameters. In IEEE Eighth International Conference on Computer Vision, vol. 2, pp. 108–115.

    Google Scholar 

  • Hayakawa, H. 1994. Photometric stereo under a light-source with arbitrary motion. Journal of Optical Society of America, Serie A, 11(11):3079–3089.

    Google Scholar 

  • Horn, B.K.P. 1986. Robot Vision. MIT Press: Cambridge.

    Google Scholar 

  • Horn, B.K.P. and Brooks, M.J. 1986. The variational approach to shape from shading. Compute Vision, Graphics, and Image Processing, 33:174–208.

    Google Scholar 

  • Horn, K.B.P. and Brooks, M.J. (Eds.). 1989. Shape from Shading. The MIT Press.

  • Hsieh, J.-W., Liao, H.-Y.M., Ko, M.-T., and Fan, K.-C. 1995. Wavelet-based shape from shading. Graphical Models and Image Processing, 57(4):343–362.

    Google Scholar 

  • Hurt, N.E. 1991. Mathematical methods in shape-from-shading: A review of recent results.Acta Applicandae Mathematicae, 23(2):163–188.

    Google Scholar 

  • Ikeuchi, K. 1981. Determining surface orientations of specular surfaces by using the photometric stereo method. IEEE Transactions on Pattern Analysis and Machine Intelligence, 3(6):661–669.

    Google Scholar 

  • Ikeuchi, K. and Horn, B.K.P. 1981. Numerical shape from shading and occluding boundaries. Artificial Intelligence, 17(1-3):141–184.

    Google Scholar 

  • Iwahori, Y., Tanaka, H., Woodham, R.J., and Ishii, N. 1994. Photometric stereo for specular surface shape based on neural network. IEICE Transactions on Information and Systems, E77-D(4):498–506.

    Google Scholar 

  • Iwahori, Y., Woodham, R.J., Ozaki, M., Tanaka, H., and Ishii, N. 1997. Neural network based photometric stereo with a nearby rotational moving light source. IEICE Transactions on Information and Systems, E80-D(9):948–957.

    Google Scholar 

  • Jain, A.K. 1989. Fundamentals of Digital Image Processing. Prentice Hall.

  • Jones, A. and Taylor, C. 1994. Robust shape from shading. IVC, 12(7):411–421.

    Google Scholar 

  • Karaçali, B. and Snyder, W. 2002. Partial integrability in surface reconstruction from a given gradient field. In IEEE International Conference on Image Processing, vol. 2, pp. 525–528.

    Google Scholar 

  • Karaçali, B. 1999.Signal reconstruction using the cross-scale correlation properties of the wavelet decomposition. Technical Report TR 99/13, North Carolina State University, Center for Advanced Computing and Communications.

  • Karaçali, B. 2002. Vector space methods in surface reconstruction from one or more images acquired from the same view with application to scanning electron microscopy images. Ph.D. thesis, North Carolina State University, Department of Electrical and Computer Engineering.

  • Kiang, R.K. 1997. Rectifying airborne scanner measurements using neural networks. In Proceedings of SPIE, Applications and Science of Artificial Neural Networks III, vol. 3077, pp. 525–534.

    Google Scholar 

  • Kim, B.-H. and Park, R.-H. 1997. Shape from shading and photometric stereo using surface approximation by legendre polynomials. Computer Vision and Image Understanding, 66(3):255–270.

    Google Scholar 

  • Kozera, R. 1991. Existence and uniqueness in photometric stereo. Applied Mathematics and Computation, 44(2):1–103.

    Google Scholar 

  • Krim, H., Mallat, S., Donoho, D., and Willsky, A.S. 1995.Best basis algorithm for signal enhancement. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing.

  • Lambert, J.H. 1760. Photometria sive de Mensura et Gratibus Luminis, Colorum et Umbrae. Eberhard Klett, Augsburg.

  • Lee, K.M. and Kuo, C.-C.J. 1994. Shape from shading with perspective projection. Computer Vision, Graphics, and Image Processing: Image Understanding, 59(2):202–212.

    Google Scholar 

  • Mallat, S. 1989. A theory for multiresolution signal decomposition: The wavelet representation. IEEE Transactions on Pattern analysis and Machine Intelligence, 11(7):674–693.

    Google Scholar 

  • Mallat, S.G. 1998. A Wavelet Tour of Signal Processing. Academic Press: San Diego.

    Google Scholar 

  • Noakes, L. and Kozera, R. 1999. A 2D leap-frog algorithm for optimal surface reconstruction. In Proceedings of the 44th Annual Meeting of the SPIE, Stream Vision Geometry VIII, vol. 3811, pp. 317–328.

    Google Scholar 

  • Noakes, L. and Kozera, R. 2001. 2D Leap-Frog: Integrability, noise and digitization. InLecture Notes in Computer Science, vol. 2243, pp. 352–364.

    Google Scholar 

  • Noakes, L. and Kozera, R. 2003a. Denoising images: Non-linear Leap-Frog for shape and light-source recovery. In Lecture Notes in Computer Science, T. Asano, R. Klette, and C. Ronse (Eds.), vol. 2616, pp. 419–436.

  • Noakes, L. and Kozera, R. 2003b. Nonlinearities and noise reduction in 3-source photometric stereo. Journal of Mathematical Imaging and Vision, 18(2):119–127.

    Google Scholar 

  • Noakes, L., Kozera, R., and Klette, R. 1999. The lawn-mowing algorithm for noisy gradient vector fields. In Proceedings of the 44th Annual Meeting of the SPIE, Stream Vision Geometry VIII, vol. 3811, pp. 305–316.

    Google Scholar 

  • Phong, B.T. 1975. Illumination for computer generated pictures. Communications of the ACM, 18(6):311–317.

    Google Scholar 

  • Rajaram, K.V., Parthasarathy, G., and Faruqi, M.A. 1995. Neural network approach to photometric stereo inversion of realworld reflectance maps for extracting 3-D shapes of objects. IEEE Transactions on Systems, Man and Cybernetics, 25(1):1289–1300.

    Google Scholar 

  • Shevlin, F. 1994. Rectifying airborne scanner measurements using neural networks. In IEEE International Conference on Image Processing, vol. 1, pp. 1007–1011.

    Google Scholar 

  • Stein, F. and Medioni, G. 1992. Structural indexing: Efficient 3D object recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):125–145.

    Google Scholar 

  • Symchony, T., Chellappa, R., and Shao, M. 1990. Direct analitical methods for solving poisson equation in computer vision problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(5):435–446.

    Google Scholar 

  • Tagare, H.D. and deFigueiredo, R.J.P. 1991. A theory of photometric stereo for a class of diffuse non-Lambertian surfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(2):133–152.

    Google Scholar 

  • Woodham, R.J. 1978. Photometric stereo: A reflectance map technique for determining surface orientations from a single view. In Proceedings of SPIE, Image Understanding Systems & Industrial Applications, vol. 155, pp. 136–143.

    Google Scholar 

  • Zhang, R., Tsai, P.-S., Cryer, J.E., and Shah, M. 1999. Shape from shading: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(8):690–706.

    Google Scholar 

  • Zheng, Q., Klemas, V., Yan, X.-H., Wang, Z., and Kagleder, K. 1997. Digital orthorectification of space shuttle coastal ocean photographs. International Journal of Remote Sensing, 18(1):197–211.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Radiology, Section on Biomedical Image Analysis, University of Pennsylvania, 3600 Market Street Suite 380, Philadelphia, PA, 19104, USA

    B. Karaçali

  2. Electrical and Computer Engineering Department, North Carolina State University, 1010 Main Campus Drive, Box 7911, Raleigh, NC, 27695, USA

    W. Snyder

Authors
  1. B. Karaçali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. W. Snyder
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Karaçali, B., Snyder, W. Noise Reduction in Surface Reconstruction from a Given Gradient Field. International Journal of Computer Vision 60, 25–44 (2004). https://doi.org/10.1023/B:VISI.0000027788.50090.b6

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:VISI.0000027788.50090.b6

Search

Navigation