Abstract
We present a Lambertian photometric stereo algorithm robust to specularities and shadows and it is based on a maximum feasible subsystem (Max FS) framework. A Big-M method is developed to obtain the maximum subset of images that satisfy the Lambertian constraint among the whole set of captured photometric stereo images which include non-Lambertian reflections such as specularities and shadows. Our algorithm employs purely algebraic pixel-wise optimization without relying on probabilistic/physical reasoning or initialization, and it guarantees the global optimality. It can be applied to the image sets with the number of images ranging from four to hundreds, and we show that the computation time is reasonably short for a medium number of images (10~100). Experiments are carried out with various objects to demonstrate the effectiveness of the algorithm.
Chapter PDF
Similar content being viewed by others
Keywords
- Mixed Integer Linear Programming
- Bidirectional Reflectance Distribution Function
- Photometric Stereo
- Picture Frame
- Shadowed Pixel
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Woodham, R.: Photometric method for determining surface orientation from multiple images. Opt. Eng. 19(1), 139–144 (1980)
Coleman Jr., E., Jain, R.: Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry. CGIP 18(4), 309–328 (1982)
Sato, Y., Ikeuchi, K.: Temporal-color space analysis of reflection. Journal of Optical Society of America A 11(11), 2990–3002 (1992)
Barsky, S., Petrou, M.: The 4-source photometric stereo technique for three-dimensional surfaces in the presence of highlights and shadows. PAMI 25(10), 1239–1252 (2003)
Nayar, S., Ikeuchi, K., Kanade, T.: Determining shape and reflectance of hybrid surfaces by photometric sampling. IEEE Trans. on Robotics and Automation 6(4), 418–431 (1990)
Chandraker, M., Agarwal, S., Kriegman, D.: Shadowcuts: Photometric stereo with shadows. In: IEEE Conference on Computer Vision and Pattern Recognition (2007)
Mallick, S.P., Zickler, T.E., Kriegman, D.J., Belhumeur, P.N.: Beyond Lambert: Reconstructing specular surfaces using color. In: IEEE International Conference on Computer Vision (2005)
Hertzmann, A., Seitz, S.: Shape and materials by example: a photometric stereo approach. In: IEEE Conference on Computer Vision and Pattern Recognition (2003)
Goldman, D., Curless, B., Hertzmann, A., Seitz, S.: Shape and spatially-varying brdfs from photometric stereo. In: IEEE International Conference on Computer Vision (2005)
Tagare, H., de Figueiredo, R.: A theory of photometric stereo for a class of diffuse non-lambertian surfaces. PAMI 13(2), 133–152 (1991)
Georghiades, A.S.: Incorporating the Torrance and Sparrow model of reflectance in uncalibrated photometric stereo. In: IEEE International Conference on Computer Vision (2003)
Chung, H.-S., Jia, J.: Efficient photometric stereo on glossy surfaces with wide specular lobes. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)
Wu, T.-P., Tang, K.-L., Tang, C.-K., Wong, T.-T.: Dense photometric stereo: A markov random field approach. PAMI 28(11), 1830–1846 (2006)
Wu, T.-P., Tang, C.-K.: Dense photometric stereo by expectation maximization. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 159–172. Springer, Heidelberg (2006)
Verbiest, F., Van Gool, L.: Photometric stereo with coherent outlier handling and confidence estimation. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24(6), 381–395 (1981)
Li, H.: Consensus Set Maximization with guaranteed global optimality for robust geometry estimation. In: IEEE International Conference on Computer Vision (2009)
Ke, Q., Kanade, T.: Quasiconvex optimization for robust geometric reconstruction. In: IEEE International Conference on Computer Vision (2005)
Chinneck, J.W.: Feasibility and infeasibility in optimization: algorithms and computational methods, 1st edn. Springer, Heidelberg (2007)
Parker, M.: A set covering approach to infeasibility analysis of linear programming problems and related issues. PhD thesis, University of Colorado at Denver (1995)
Makhorin, A.: GLPK (GNU linear programming kit) 4.1.6 (2004), http://www.gnu.org/software/glpk/glpk.html
Agrawal, A., Raskar, R., Chellappa, R.: What is the range of surface reconstructions from a gradient field? In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 578–591. Springer, Heidelberg (2006)
Agrawal, A., Raskar, R., Chellappa, R.: An algebraic approach to surface reconstructions from gradient fields? In: IEEE International Conference on Computer Vision (2006)
Hernández, C., Vogiatzis, G., Cipolla, R.: Shadows in three-source photometric stereo. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 290–303. Springer, Heidelberg (2008)
Liu, C., Szeliski, R., Kang, S.B., Zitnick, C.L., Freeman, W.T.: Automatic estimation and removal of noise from a single image. PAMI 30(2), 299–314 (2008)
Mukaigawa, Y., Ishii, Y., Shakunaga, T.: Analysis of photo-metric factors based on photometric linearization. Journal of Optical Society of America A 24(10), 3326–3334 (2007)
Higo, T., Matsushita, Y., Joshi, N., Ikeuchi, K.: A hand-held photometric stereo camera for 3-D modeling. In: IEEE International Conference on Computer Vision (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yu, C., Seo, Y., Lee, S.W. (2010). Photometric Stereo from Maximum Feasible Lambertian Reflections. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6314. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15561-1_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-15561-1_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15560-4
Online ISBN: 978-3-642-15561-1
eBook Packages: Computer ScienceComputer Science (R0)