Abstract
This paper introduces a novel camera attachment for measuring the illumination color spatially in the scene. The illumination color is then used to transform color appearance in the image into that under white light.
The main idea is that the scene inter-reflection through a reference camera-attached surface “Nose” can, under some conditions, represent the illumination color directly. The illumination measurement principle relies on the satisfaction of the gray world assumption in a local scene area or the appearance of highlights, from dielectric surfaces. Scene inter-reflections are strongly blurred due to optical dispersion on the nose surface and defocusing of the nose surface image. Blurring smoothes the intense highlights and it thus becomes possible to measure the nose inter-reflection under conditions in which intensity variation in the main image would exceed the sensor dynamic range.
We designed a nose surface to reflect a blurred scene version into a small image section, which is interpreted as a spatial illumination image. The nose image is then mapped to the main image for adjusting every pixel color. Experimental results showed that the nose inter-reflection color is a good measure of illumination color when the model assumptions are satisfied. The nose method performance, operating on real images, is presented and compared with the Retinex and the scene-inserted white patch methods.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abdellatif, M. 1996. Imaging System, International Patent Application Number: PCT/JP96/03683.
Abdellatif, M., Tanaka, Y., Gofuku, A., and Nagai, I. 1998. Illumination color from the blurred inter-reflection of a reference nose. In Proc. Third Asian Conference on Computer Vision, 1:208–215.
Bajcsy, R., Lee, S.W., and Leonardis, A. 1996. Detection of diffuse and specular interface reflections and inter-reflections by color image segmentation. Int. Journal of Computer Vision, 17(3):241–272.
Blake, A. 1985. Boundary conditions for lightness computation in Mondrian world. In Proc. of Computer Vision, Graphics Image Processing, 32:314–327.
Brainard, D.H. and Wandell, B.A. 1986. Analysis of the retinex theory of color vision. Journal of the Optical Society of America A, 3(10):1651–1661.
Brill, M.H. 1980. Computer-simulated object-color recognizer. MIT Research Lab. of Electronics, Cambridge, MA, Tech. Rep. 122.
D'Zmura, M. and Lennie, P. 1986. Mechanisms of color constancy. Journal of the Optical Society of America A, 3:1662–1672.
Finlayson, G.D. 1996. Color in perspective. IEEE Trans. On PAMI, 18(10):1034–1038.
Finlayson, G.D., Drew, M.S., and Funt, B.V. 1994. Spectral sharpening: Sensor transformations for improved color constancy. Journal of the Optical Society of America A, 11(5):1553–1563.
Forsyth, D. 1990. A novel algorithm for color constancy. Int. Journal of Computer Vision, 5:5–36.
Funt, B.V. and Drew, M.S. 1988. Color constancy computation in near-Mondrian scenes using a finite dimensional model. In Proc. IEEE, Conf. Computer Vision and Pattern Recognition.
Funt, B.V., Drew, M.S., and Ho, J. 1991. Color constancy from mutual reflection. Int. Journal of Computer Vision, 6(1):5–24.
Gershon, R., Jepson, A.D., and Tsotsos, J.K. 1987. From RGB to surface reflectance: computing color constancy descriptors in images. In Proc.10th Int. Joint Conf. on Artif. Intell., pp. 755–758.
Gershon, R., Jepson, A.D., and Tsotsos, J.K. 1987. The use of color in highlight identification. In Proc. 10th Int. Joint Conf. on Artif. Intell., pp. 752–754.
Healey, G. 1991. Estimating spectral reflectance using highlights. Image and vision computing, 9(5):333–337.
Healey, G. and Slater, D. 1994. Global color constancy: Recognition of objects by use of illumination invariant properties of color distributions. Journal of the Optical Society of America A, 11(11):3003–3010.
Ho, J., Funt, B.V., and Drew, M.S. 1990. Separating a color signal into illumination and surface reflectance components: Theory and applications. IEEE Trans PAMI, 12(10):966–977.
Horn, B.K.P. 1974. Determining lightness from an image. In Proc. Computer Graph. Image Processing., 3:277.
Horn, B.K.P. 1985. Robot Vision. McGrow Hill, NY.
Hurlbert, A. 1986. Formal connections between lightness algorithms. Journal of the Optical Society of America A, 3(10):1684–1693.
Judd, D.B., MacAdam, D.L., and Wyszecki, G. 1964. Spectral distribution of typical daylight as a function of correlated color temperature. Journal of the Optical Society of America, 54:1031–1040.
Kawata, S., Sasaki, S., and Minami, S. 1987. Component analysis of spatial and spectral patterns in multi-spectral images. I Basis, Journal of the Optical Society of America A, 4:2101–2106.
Klinker, G.J., Shafer, S.A., and Kanade, T. 1988. The measurement of highlights in color images. Int. Journal of Computer Vision, 2(1):7–32.
Klinker, G.J., Shafer, S.A., and Kanade, T. 1990. A physical approach to color image understanding. Int. Journal of Computer Vision. 4(1):7–38.
Land, E.H. 1987. An alternative technique for the computation of the designator in the retinex theory of color vision. In Proc. of National Academy of Science USA, 83:3078–3080.
Land, E.H. and McCan, J. 1971. Lightness and retinex theory. Journal of the Optical Society of America, 61(1).
Lee, H.-C. 1986. A method for computing the scene-illuminant chromaticity from specular highlights. Journal of the Optical Society of America A, 3(10):1694–1699.
Lee, H.-C., Breneman, E.J., and Schulte, C.P. 1990. Modeling light reflection of computer vision. IEEE Trans. PAMI, 12:402–409.
Maloney, L.T. 1986. Evaluation of linear models of surface reflectance with small number of parameters. Journal of the Optical Society of America A, 3:1673–1683.
Maloney, L.T. and Wandell, B.A. 1986. A computational model of color constancy. Journal of the Optical Society of America A, 1:29–33.
Nayar, S.K., Ikeuchi, K., and kanade, T. 1991. Surface reflection: Physical and geometrical perspectives. IEEE Trans. PAMI, 13(7):611–634.
Novak, C.L. and Shafer, S.A. 1992. Supervised color constancy. In Physics-Based Vision, Color, Jones and Bartlett Publishing, Inc., Massachusetts, USA, pp. 284–299.
Shafer, S.A. 1985. Using color to separate reflection components. Color Research and Applications, 10:210–218.
Shafer, S.A., Kanade, T., Klinker, G.J., and Novak, C.L. 1990. Physics-based models for early vision by Machine. In Proc. of Perceiving, Measuring and Using Color, SPIE, 1250:222–235.
Tominaga, S. and Wandell, B.A. 1989. Standard surface reflectance model and illuminant estimation. Journal of the Optical Society of America A, 6(4):576–584.
Tominaga, S. and Wandell, B.A. 1990. Component estimation of surface spectral reflectance. Journal of the Optical Society of America, 7(2):312–317.
Tsukada, M. and Ohta, Y. 1990. An approach to color constancy using multiple images. In Proc. IEEE 3rd Int. Conf. on Computer Vision, 385–389.
Wandell, B.A. 1987. The synthesis and analysis of color images. IEEE Trans. PAMI, 9(1):2–13.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Abdellatif, M., Tanaka, Y., Gofuku, A. et al. Color Constancy Using the Inter-Reflection from a Reference Nose. International Journal of Computer Vision 39, 171–194 (2000). https://doi.org/10.1023/A:1026559628005
Issue Date:
DOI: https://doi.org/10.1023/A:1026559628005