Abstract
Modeling the shape and appearance of a thin film object has promising applications such as heritage-modeling and industrial inspections. In the same time, such modeling is a frontier of computer vision and contains various challenging issues to be solved. In particular, thin film colors show iridescence along the view and lighting directions and how to acquire and formalize the spectral iridescence for shape estimation. This paper aims to model the shapes and appearances of thin film objects from measured reflectance spectra. Thin film reflectance is represented by the incident angle on the object surface, the refractive index and the film thickness. First, we estimate the incident angle of a surface patch on a thin film based on monotonically increasing peak intensities. Then, we apply a characteristics strip expansion method to the peak intensity for estimating the surface normal of the patch. Based on this shape estimation, we estimate refractive index and film thickness from iridescence variance. We experimentally evaluate the accuracy of the estimated shape and estimated parameters. We also demonstrate to reconstruct appearances based on the shape and parameters.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
IWasaki, K., Matsuzawa, K., Nishita, T.: Real-time rendering of soap bubbles taking into account light interference. In: Proceedings of the Computer Graphics International, CGI 2004, pp. 344–348. IEEE Computer Society, Washington, DC, USA (2004)
Meinster, K.W.: Interference spectroscopy. Part I. J. Opt. Soc. Am. 31, 405–426 (1941)
Azzam, R., Bashara, N.: Ellipsometry and Polarized Light. North-Holland Personal Library. North-Holland Pub, Co, Amsterdam (1977)
Kitagawa, K.: Thin-film thickness profile measurement by three-wavelength interference color analysis. Appl. Opt. 52, 1998–2007 (2013)
Kitagawa, K.: Transparent film thickness measurement by three-wavelength interference method: an extended application of global model fitting algorithm. In: 2012 13th Int’l Workshop on Mechatronics (MECATRONICS), 2012 9th France-Japan 7th Europe-Asia Congress on and Research and Education in Mechatronics (REM), pp. 94–100 (2012)
Kobayashi, Y., Morimoto, T., Sato, I., Mukaigawa, Y., Ikeuchi, K.: BRDF estimation of structural color object by using hyper spectral image. In: IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 915–922 (2013)
Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47, 7–42 (2002)
Herbort, S., WUhler, C.: An introduction to image-based 3d surface reconstruction and a survey of photometric stereo methods. 3D Res. 2, 40:1–40:17 (2011)
Morris, N.J.W., et al.: Reconstructing the surface of inhomogeneous transparent scenes by scatter-trace photography (2007)
Oxholm, G., Nishino, K.: Shape and reflectance from natural illumination. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part I. LNCS, vol. 7572, pp. 528–541. Springer, Heidelberg (2012)
Morimoto, T., Tan, R., Kawakami, R., Ikeuchi, K.: Estimating optical properties of layered surfaces using the spider model. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 207–214 (2010)
Hirayama, H., Kaneda, K., Yamashita, H., Monden, Y.: An accurate illumination model for objects coated with multilayer films. Comput. Graph. 25, 391–400 (2001)
Hirayama, H., Yamaji, Y., Kaneda, K., Yamashita, H., Monden, Y.: Rendering iridescent colors appearing on natural objects. In: Proceedings of the Eighth Pacific Conference on Computer Graphics and Applications, pp. 15–433 (2000)
Sun, Y., David Fracchia, F., Drew, M.S., Calvert, T.W.: Rendering iridescent colors of optical disks. In: Péroche, B., Rushmeier, H. (eds.) Rendering Techniques 2000. Eurographics, pp. 341–352. Springer, Heidelberg (2000)
Sun, Y., Fracchia, F.D., Calvert, T.W., Drew, M.S.: Deriving spectra from colors and rendering light interference. IEEE Comput. Graph. Appl. 19, 61–67 (1999)
Sadeghi, I., Muñoz, A., Laven, P., Jarosz, W., Seron, F., Gutierrez, D., Jensen, H.W.: Physically-based simulation of rainbows. ACM Trans. Graph. 31, 3:1–3:12 (2012). (Presented at SIGGRAPH)
Cuypers, T., Haber, T., Bekaert, P., Oh, S.B., Raskar, R.: Reflectance model for diffraction. ACM Trans. Graph. 31, 122:1–122:11 (2012)
Kinoshita, S.: Structural Colors in the Realm of Nature. World Scientific, Singapore (2008)
Pedrotti, L.S.: Basic Physical Optics. SPIE Press Book, Bellingham (2008)
Horn, B.K.: A problem in computer vision: orienting silicon integrated circuit chips for lead bonding. Comput. Graph. Image Process. 4, 294–303 (1975)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Kobayashi, Y., Morimoto, T., Sato, I., Mukaigawa, Y., Ikeuchi, K. (2015). Reconstructing Shape and Appearance of Thin Film Objects with Hyper Spectral Sensor. In: Cremers, D., Reid, I., Saito, H., Yang, MH. (eds) Computer Vision -- ACCV 2014. ACCV 2014. Lecture Notes in Computer Science(), vol 9006. Springer, Cham. https://doi.org/10.1007/978-3-319-16817-3_32
Download citation
DOI: https://doi.org/10.1007/978-3-319-16817-3_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16816-6
Online ISBN: 978-3-319-16817-3
eBook Packages: Computer ScienceComputer Science (R0)