skip to main content
research-article

Simulating and compensating changes in appearance between day and night vision

Published: 27 July 2014 Publication History

Abstract

The same physical scene seen in bright sunlight and in dusky conditions does not appear identical to the human eye. Similarly, images shown on an 8000 cd/m2 high-dynamic-range (HDR) display and in a 50 cd/m2 peak luminance cinema screen also differ significantly in their appearance. We propose a luminance retargeting method that alters the perceived contrast and colors of an image to match the appearance under different luminance levels. The method relies on psychophysical models of matching contrast, models of rod-contribution to vision, and our own measurements. The retargeting involves finding an optimal tone-curve, spatial contrast processing, and modeling of hue and saturation shifts. This lets us reliably simulate night vision in bright conditions, or compensate for a bright image shown on a darker display so that it reveals details and colors that would otherwise be invisible.

Supplementary Material

MP4 File (a147-sidebyside.mp4)

References

[1]
Barten, P. G. J. 1999. Contrast sensitivity of the human eye and its effects on image quality. SPIE Press.
[2]
Bartleson, C. J., and Breneman, E. J. 1967. Brightness Perception in Complex Fields. Journal of the Optical Society of America 57, 7, 953--956.
[3]
Berns, R. S. 1996. Methods for characterizing crt displays. Displays 16, 4, 173--182.
[4]
Brady, N., and Field, D. J. 1995. What's constant in contrast constancy? The effects of scaling on the perceived contrast of bandpass patterns. Vision Research 35, 6, 739--756.
[5]
Cao, D., Pokorny, J., Smith, V. C., and Zele, A. J. 2008. Rod contributions to color perception: linear with rod contrast. Vision Research 48, 26, 2586--92.
[6]
Chang, N., Choi, I., and Shim, H. 2004. DLS: Dynamic backlight luminance scaling of liquid crystal display. IEEE Trans. on Very Large Scale Integration Systems 12, 8, 837--846.
[7]
Eilertsen, G., Wanat, R., Mantiuk, R. K., and Unger, J. 2013. Evaluation of Tone Mapping Operators for HDR-Video. Computer Graphics Forum 32, 7 (Oct.), 275--284.
[8]
Fairchild, M. D. 2005. Color Appearance Models, 2nd ed. John Wiley & Sons.
[9]
Georgeson, B. Y. M. A., and Sullivan, G. D. 1975. Contrast constancy: deblurring in human vision by spatial frequency channels. The Journal of Physiology 252, 627--656.
[10]
Iranli, A., Lee, W., and Pedram, M. 2006. Backlight dimming in power-aware mobile displays. In Proc. of the Annual Conference on Design Automation - DAC '06, 604--607.
[11]
Irawan, P., Ferwerda, J., and Marschner, S. 2005. Perceptually based tone mapping of high dynamic range image streams. In Proc. of EGSR, 231--242.
[12]
Kane, J. P., and Kurtz, F. A., 2012. Adapting display color for low luminance conditions. Patent app. EP 2526688 A1.
[13]
Kerofsky, L., and Daly, S. 2006. Brightness preservation for LCD backlight dimming. Journal of the Society for Information Display 14, 12, 1111--1118.
[14]
Kirk, A. G., and O'Brien, J. F. 2011. Perceptually based tone mapping for low-light conditions. ACM Trans Graph 30, 4, 42:1--42:10.
[15]
Kuang, J., Johnson, G., and Fairchild, M. 2007. iCAM06: A refined image appearance model for HDR image rendering. Journal of Visual Communication and Image Representation 18, 5, 406--414.
[16]
Kulikowski, J. J. 1976. Effective contrast constancy and linearity of contrast sensation. Vision Research 16, 12, 1419--31.
[17]
Mantiuk, R., Daly, S., and Kerofsky, L. 2008. ACM Trans Graph 27, 3, 68:1--68:10.
[18]
Mantiuk, R., Mantiuk, R. K., Tomaszewska, A., and Heidrich, W. 2009. Color correction for tone mapping. Computer Graphics Forum 28, 2, 193--202.
[19]
Mantiuk, R., Kim, K. J., Rempel, A. G., and Heidrich, W. 2011. HDR-VDP-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions. ACM Trans Graph 30, 4, 40:1--40:14.
[20]
Moroney, N., Fairchild, M., Hunt, R., Li, C., Luo, M., and Newman, T. 2002. The CIECAM02 color appearance model. In Proc. IS&T/SID 10th Color Imaging Conference, Society for Imaging Science and Technology, 23--27.
[21]
Pattanaik, S. N., Ferwerda, J. A., Fairchild, M. D., and Greenberg, D. P. 1998. A multiscale model of adaptation and spatial vision for realistic image display. In Proc. of SIGGRAPH '98, 287--298.
[22]
Peli, E. 1990. Contrast in complex images. Journal of the Optical Society of America A 7, 10, 2032--2040.
[23]
Petit, J., and Mantiuk, R. K. 2013. Assessment of video tone-mapping: Are cameras S-shaped tone-curves good enough? Journal of Visual Communication and Image Representation 24, 1020--1030.
[24]
Reinhard, E., Pouli, T., Kunkel, T., Long, B., Ballestad, A., and Damberg, G. 2012. Calibrated image appearance reproduction. ACM Trans Graph 31, 6, 201:1--201:11.
[25]
Smith, V. C., and Pokorny, J. 1975. Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm. Vision Research 15, 2, 161--171.
[26]
Thompson, W., Shirley, P., and Ferwerda, J. 2002. A spatial post-processing algorithm for images of night scenes. Journal of Graphics Tools 7, 1, 1--12.
[27]
Vos, J. J., and van den Berg, T. J. 1999. CIE 135/1-6 Disability Glare. Tech. rep.
[28]
Witkin, A. 1984. Scale-space filtering: A new approach to multi-scale description. In IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, vol. 9, 150--153.

Cited By

View all
  • (2025)Impact of Layer Materials, Their Thicknesses, and Their Reflectivities on Emission Color and NVIS Compatibility in OLED Devices for Avionic Display ApplicationsMicromachines10.3390/mi1602019116:2(191)Online publication date: 7-Feb-2025
  • (2024)Quality Assessment of Tone-Mapped Images Using Fundamental Color and Structural FeaturesIEEE Transactions on Multimedia10.1109/TMM.2023.327898926(1244-1254)Online publication date: 2024
  • (2024)G-SemTMO: Tone Mapping With a Trainable Semantic GraphIEEE Access10.1109/ACCESS.2024.349149412(164210-164225)Online publication date: 2024
  • Show More Cited By

Index Terms

  1. Simulating and compensating changes in appearance between day and night vision

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Transactions on Graphics
        ACM Transactions on Graphics  Volume 33, Issue 4
        July 2014
        1366 pages
        ISSN:0730-0301
        EISSN:1557-7368
        DOI:10.1145/2601097
        Issue’s Table of Contents
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 27 July 2014
        Published in TOG Volume 33, Issue 4

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. backlight dimming
        2. color perception
        3. computational display
        4. contrast perception
        5. low luminance display
        6. retargeting

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)62
        • Downloads (Last 6 weeks)9
        Reflects downloads up to 16 Feb 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2025)Impact of Layer Materials, Their Thicknesses, and Their Reflectivities on Emission Color and NVIS Compatibility in OLED Devices for Avionic Display ApplicationsMicromachines10.3390/mi1602019116:2(191)Online publication date: 7-Feb-2025
        • (2024)Quality Assessment of Tone-Mapped Images Using Fundamental Color and Structural FeaturesIEEE Transactions on Multimedia10.1109/TMM.2023.327898926(1244-1254)Online publication date: 2024
        • (2024)G-SemTMO: Tone Mapping With a Trainable Semantic GraphIEEE Access10.1109/ACCESS.2024.349149412(164210-164225)Online publication date: 2024
        • (2023)Perceptually Adaptive Real-Time Tone MappingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618222(1-10)Online publication date: 10-Dec-2023
        • (2023)Image EnhancementHandbook of Visual Display Technology10.1007/978-3-642-35947-7_214-1(1-15)Online publication date: 13-Jan-2023
        • (2022)Dark stereoACM Transactions on Graphics10.1145/3528223.353013641:4(1-12)Online publication date: 22-Jul-2022
        • (2021)Ten seconds of my nights: Exploring methods to measure brightness, loudness and attendance and their associations with alcohol use from video clipsPLOS ONE10.1371/journal.pone.025044316:4(e0250443)Online publication date: 28-Apr-2021
        • (2019)Towards Eye-Friendly VR: How Bright Should It Be?2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR.2019.8797752(566-574)Online publication date: Mar-2019
        • (2019)Low Visibility Street Scenes Recognition with Augmented Image Sets2019 8th International Congress on Advanced Applied Informatics (IIAI-AAI)10.1109/IIAI-AAI.2019.00096(438-443)Online publication date: Jul-2019
        • (2019)Model for assessing organic light‐emitting diode display lifetime across applicationsJournal of the Society for Information Display10.1002/jsid.85828:7(629-640)Online publication date: 20-Nov-2019
        • Show More Cited By

        View Options

        Login options

        Full Access

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media