M. Dellepiane
P. Cignoni
R. Scopigno
Abstract
Flash light of digital cameras is a very useful way to picture scenes with low-quality illumination. Nevertheless, especially in low-end cameras integrated flash lights are considered as not reliable for high-quality images, due to known artifacts (sharp shadows, highlights, uneven lighting) generated in images. Moreover, a mathematical model of this kind of light is difficult to create. In this article we present a color correction space which, given some information about the geometry of the pictured scene, is able to provide a space-dependent color correction for each pixel of the image. The correction space can be calculated once in a lifetime using a quite fast acquisition procedure; after 3D spatial calibration, the obtained color correction function can be applied to every image where flash is the dominant light source. We developed this approach to produce better color samples in the application framework of color mapping on 3D scanned models. The correction space proposed presents several advantages: it is independent from the kind of light used (provided that it is bound to the camera), it gives the possibility to correct some artifacts (for example, color deviation) introduced by flash light, and it has a wide range of possible applications, from image enhancement to material color estimation. Moreover, once that the inverse photo-to-geometry transformation is known, it allows the easy estimation of the flash light position and permits to identify and remove other annoying artifacts, like highlights and shadows. The resulting approach allows to gather in an easy manner a better and more consistent color information and to produce higher-quality 3D models.
- Agrawal, A., Raskar, R., Nayar, S. K., and Li, Y. 2005. Removing photography artifacts using gradient projection and flash-exposure sampling. ACM Trans. Graph. 24, 3, 828--835. Google Scholar
Digital Library
- BT Software. http://www.leocad.org/.Google Scholar
- Bannai, N., Agathos, A., and Fisher, R. B. 2004. Fusing multiple color images for texturing models. In Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium (3DPVT'04). IEEE Computer Society, 558--565. Google ScholarDigital Library
- Barnard, K., Cardei, V., and Funt, B. 2002a. A comparison of computational color constancy algorithms. Part I: Methodology and experiments with synthesized data. IEEE Trans. Image Process. 11, 9, 972--984. Google ScholarDigital Library
- Barnard, K., Martin, L., Coath, A., and Funt, B. 2002b. A comparison of computational color constancy algorithms Part II: Experiments with image data. IEEE Trans. Image Process. 11, 9, 985. Google ScholarDigital Library
- Baumberg, A. 2002. Blending images for texturing 3d models. In Proceedings of the British Machine Vision Conference (BMVC'02). Canon Research Center Europe.Google ScholarCross Ref
- Bernardini, F., Martin, I., and Rushmeier, H. 2001. High-Quality texture reconstruction from multiple scans. IEEE Trans. Vis. Comput. Graph. 7, 4, 318--332. Google ScholarDigital Library
- Callieri, M., Cignoni, P., Corsini, M., and Scopigno, R. 2008. Masked photo blending: Mapping dense photographic dataset on high-resolution 3d models. Comput. Graph. 32, 4, 464--473. http://dx.doi.org/10.1016/j.cag.2008.05.004. Google ScholarDigital Library
- Callieri, M., Cignoni, P., and Scopigno, R. 2002. Reconstructing textured meshes from multiple range rgb maps. In Proceedings of the 7th Internatinal Fall Workshop on Vision, Modeling, and Visualization. IOS Press, 419--426.Google Scholar
- Commission Internationale de l'Eclairage (CIE). 2004. Colorimetry. CIE 15:2004. Commission Internationale de l'Eclairage (CIE).Google Scholar
- Corsini, M., Callieri, M., and Cignoni, P. 2008. Stereo light probe. Comput. Graph. Forum 27, 2, 291--300.Google ScholarCross Ref
- Debevec, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'98). ACM Press, New York, 189--198. Google ScholarDigital Library
- Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In Proceedings of the Annual Conference on Computer Graphics and Intractive Techniques (SIGGRAPH'00). ACM Press/Addison-Wesley, New York, 145--156. Google ScholarDigital Library
- Ebner, M. 2004. Color constancy using local color shifts. In Proceedings of the European Conference on Computer Vision (ECCV). 276--287.Google ScholarCross Ref
- Eisemann, E. and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. ACM Trans. Graph. 23. ACM Press. Google ScholarDigital Library
- Finlayson, G. D. and Hordley, S. D. 2000. Improving gamut mapping color constancy. IEEE Trans. Image Process. 9, 10, 1774--1783. Google ScholarDigital Library
- Finlayson, G. D., Hordley, S. D., and Hubel, P. M. 2001. Color by correlation: A simple, unifying framework for color constancy. IEEE Trans. Pattern Anal. Mach. Intell. 23, 11, 1209--1221. Google ScholarDigital Library
- Franken, T., Dellepiane, M., Ganovelli, F., Cignoni, P., Montani, C., and Scopigno, R. 2005. Minimizing user intervention in registering 2d images to 3d models. The Vis. Comput. 21, 8--10, (Special Issues for Pacific Graphics 2005). 619--628.Google ScholarCross Ref
- Gijsenij, A. and Gevers, T. 2007. Color constancy using natural image statistics. In Proceedings of the International Conference on Computer Vision and Pattern Recognition. 1--8.Google Scholar
- Grubbs, F. 1969. Procedures for detecting outlying observations in samples. Technomet 11, 1--21.Google ScholarCross Ref
- Hoppe, H. and Toyama, K. 2003. Continuous flash. Tech. rep. MSR-TR-2003-63, Microsoft Research.Google Scholar
- Hsu, E., Mertens, T., Paris, S., Avidan, S., and Durand, F. 2008. Light mixture estimation for spatially varying white balance. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques. (SIGGRAPH'08). ACM Press. Google ScholarDigital Library
- Kawakami, R., Ikeuchi, K., and Tan, R. T. 2005. Consistent surface color for texturing large objects in outdoor scenes. In Proceedings of the International Conference on Computer Vision (ICCV'05). 1200--1207. Google ScholarDigital Library
- Lensch, H., Heidrich, W., and Seidel, H. 2000. Automated texture registration and stitching for real world models. In Proceedings of the 8th Pacific Graphics Conference. IEEE, Los Alamitos, CA, 317--327. Google ScholarDigital Library
- Lensch, H. P. A., Kautz, J., Goesele, M., Heidrich, W., and Seidel, H.-P. 2003. Image-Based reconstruction of spatial appearance and geometric detail. ACM Trans. Graph. 22, 2, 234--257. Google ScholarDigital Library
- Lin, S., Yuanzhen, S. L., Kang, S. B., Tong, X., and yeung Shum, H. 2003. Diffuse-Specular separation and depth recovery from image sequences. In Proceedings of the European Conference on Computer Vision (ECCV). 210--224. Google ScholarDigital Library
- Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Trans. Graph. 25, 3, 646--653. Google ScholarDigital Library
- Lu, C., Drew, M. S., and Finlayson, G. D. 2006. Shadow removal via flash/noflash illumination. W. Mult. Signal Proc. 198--201.Google Scholar
- Omer, I. and Werman, M. 2004. Color lines: Image specific color representation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'04). Vol. II. IEEE, 946--953. Google ScholarDigital Library
- Ortiz, F. and Torres, F. 2006. Automatic detection and elimination of specular reflectance in color images by means of ms diagram and vector connected filters. IEEE Trans. Syst. Man, Cybernet. Part C: Appl. Rev. 36, 5, 681--687. Google ScholarDigital Library
- Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., and Toyama, K. 2004. Digital photography with flash and no-flash image pairs. In Proceedings of the Annual Conference on Computer Graphics and Intractive Techniques (SIGGRAPH'04), 664--72. Google ScholarDigital Library
- Pulli, K., Abi-Rached, H., Duchamp, T., Shapiro, L. G., and Stuetzle, W. 1998. Acquisition and visualization of colored 3d objects. In Proceedings of the International Conference on Pattern recognition (ICPR'98). IEEE Computer Society, 11. Google ScholarDigital Library
- Rankov, V., Locke, R., Edens, R., Barber, P., and Vojnovic, B. 2005. An algorithm for image stitching and blending. In Proceedings of SPIE. Three-Dimensional and Multidimensional Microscopy: Image Acquisition and Processing XII. Vol. 5701. 190--199.Google ScholarCross Ref
- Raskar, R., Welch, G., Low, K., and Bandyopadhyay, B. 2001. Shader lamps: Animating real objects with image-based illumination. In Proceedings of the Eurographics Workshop on Rendering Techniques. Springer, 89--102. Google ScholarDigital Library
- Sato, Y. and Ikeuchi, K. 1993. Temporal-Color space analysis of reflection. In Computer Vision and Pattern Recognition. 570--576.Google Scholar
- Shen, H.-L., Zhang, H.-G., Shao, S.-J., and Xin, J. H. 2008. Chromaticity-Based separation of reflection components in a single image. Pattern Recogn. 41, 8, 2461--2469. Google ScholarDigital Library
- Tan, P., Lin, S., Quan, L., and Shum, H.-Y. 2003. Highlight removal by illumination-constrained inpainting. In Proceedings of the 9th IEEE International Conference on Computer Vision (ICCV '03). IEEE Computer Society, 164. Google ScholarDigital Library
- van de Weijer, J. and Gevers, T. 2005. Color constancy based on the grey-edge hypothesis. In Proceedings of the IEEE International Conference on Image Processing (ICIP). 722--725.Google Scholar
- Vergauwen, M. and Gool, L. V. 2006. Web-Based 3d reconstruction service. Mach. Vis. Appl. 17, 6, 411--426. Google ScholarDigital Library
- Wolff, L. 1989. Using polarization to separate reflection components. In Computer Vision and Pattern Recognition. 363--369.Google Scholar
Index Terms
- Improved color acquisition and mapping on 3D models via flash-based photography
Recommendations
Flash photography enhancement via intrinsic relighting
We enhance photographs shot in dark environments by combining a picture taken with the available light and one taken with the flash. We preserve the ambiance of the original lighting and insert the sharpness from the flash image. We use the bilateral ...
Latest results in digital color film restoration
Special issue on latest results in colour image processing and applicationsMotion picture is not only a theatrical art but also a vivid record of past life. Unfortunately, almost all color films made since the 1950s are subject to fading that can be arrested only by storing prints at very low temperatures. Photochemical ...
Approximate Cross Channel Color Mapping from Sparse Color Correspondences
ICCVW '13: Proceedings of the 2013 IEEE International Conference on Computer Vision WorkshopsWe propose a color mapping method that compensates color differences between images having a common semantic content such as multiple views of a scene taken from different viewpoints. A so-called color mapping model is usually estimated from color ...
Comments