skip to main content
10.1145/2668904.2668945acmotherconferencesArticle/Chapter ViewAbstractPublication PagescvmpConference Proceedingsconference-collections
research-article

A comparison of night vision simulation methods for video

Published: 13 November 2014 Publication History

Abstract

The properties of the human vision change depending on the absolute luminance of the perceived scene. The change is most noticeable at night, when cones lose their sensitivity and rods activate. This change is imitated in video footage using various tricks and filters. In this study, we compared 4 algorithms that can realistically simulate the appearance of night scenes on a standard display. We conducted a subjective evaluation study to compare the results of night vision simulation with a reference footage dimmed using a photographic filter to determine which algorithm offers the greatest accuracy. The results of our study can be used in computer graphics rendering to apply the most realistic simulation of night vision to the rendered night scenes or in photography to reproduce photographs taken at night as similar as possible to how the human eye would see them.

Supplementary Material

ZIP File (a16-wanat-aux.zip)
Supplemental material.

References

[1]
M. Aguilar and W. Stiles. Saturation of the rod mechanism of the retina at high levels of stimulation. Journal of Modern Optics, 1(1):59--65, 1954.
[2]
M. Ashikhmin and J. Goyal. A reality check for tone-mapping operators. ACM Trans. Appl. Percept., 3(4):399--411, Oct. 2006.
[3]
P. G. J. Barten. Physical model for the contrast sensitivity of the human eye. pages 57--72, 1992.
[4]
R. Boitard, D. Thoreau, K. Bouatouch, and R. Cozot. Temporal coherency in video tone mapping, a survey. In HDRi2013-First International Conference and SME Workshop on HDR imaging, number 1, pages 1--6. Citeseer, 2013.
[5]
D. Cao, J. Pokorny, V. C. Smith, and A. J. Zele. Rod contributions to color perception: linear with rod contrast. Vision research, 48(26):2586--2592, 2008.
[6]
P. Choudhury and J. Tumblin. The trilateral filter for high contrast images and meshes. In EGSR03 14th Eurographics Symposium on Rendering, pages 186--196. The Eurographics Association, 2003.
[7]
G. Eilertsen, R. Wanat, R. K. Mantiuk, and J. Unger. Evaluation of tone mapping operators for HDR-video. In Computer Graphics Forum, volume 32, pages 275--284. Wiley Online Library, 2013.
[8]
E. Hough and K. Ruddock. The Purkinje shift. Vision research, 9(2):313--315, 1969.
[9]
R. W. G. Hunt. Light and Dark Adaptation and the Perception of Color. Journal of the Optical Society of America, 42(3):190, Mar. 1952.
[10]
R. W. G. Hunt. The reproduction of colour. John Wiley & Sons, 2005.
[11]
P. Irawan, J. A. Ferwerda, and S. R. Marschner. Perceptually based tone mapping of high dynamic range image streams. In Proceedings of the Sixteenth Eurographics Conference on Rendering Techniques, pages 231--242. Eurographics Association, 2005.
[12]
K. J. Kim, R. Mantiuk, and K. H. Lee. Measurements of achromatic and chromatic contrast sensitivity functions for an extended range of adaptation luminance. In IS&T/SPIE Human Vision and Electronic Imaging, pages 86511A--86511A. International Society for Optics and Photonics, 2013.
[13]
A. G. Kirk and J. F. O'Brien. Perceptually based tone mapping for low-light conditions. Proceedings of SIGGRAPH 2011, 30(4):42, 2011.
[14]
J. Kuang, G. M. Johnson, and M. D. Fairchild. iCAM06: A refined image appearance model for hdr image rendering. Journal of Visual Communication and Image Representation, 18(5):406--414, 2007.
[15]
J. Kulikowski. Effective contrast constancy and linearity of contrast sensation. Vision research, 16(12):1419--1431, 1976.
[16]
R. Mantiuk, S. Daly, and L. Kerofsky. Display adaptive tone mapping. ACM Trans. Graph., 27(3):68:1--68:10, Aug. 2008.
[17]
R. Mantiuk, A. Tomaszewska, and W. Heidrich. Color correction for tone mapping. In Computer Graphics Forum, volume 28, pages 193--202. Wiley Online Library, 2009.
[18]
R. K. Mantiuk, A. Tomaszewska, and R. Mantiuk. Comparison of four subjective methods for image quality assessment. In Computer Graphics Forum, volume 31, pages 2478--2491. Wiley Online Library, 2012.
[19]
N. Moroney, M. D. Fairchild, R. W. Hunt, C. Li, M. R. Luo, and T. Newman. The CIECAM02 color appearance model. In Color and Imaging Conference, volume 2002, pages 23--27. Society for Imaging Science and Technology, 2002.
[20]
Y. Nayatani. Relations between the two kinds of representation methods in the Helmholtz-Kohlrausch effect. Color Research & Application, 23(5):288--301, 1998.
[21]
S. N. Pattanaik, J. A. Ferwerda, M. D. Fairchild, and D. P. Greenberg. A multiscale model of adaptation and spatial vision for realistic image display. In Proceedings of SIGGRAPH 1998, pages 287--298, New York, New York, USA, 1998.
[22]
S. N. Pattanaik, J. Tumblin, H. Yee, and D. P. Greenberg. Time-dependent visual adaptation for fast realistic image display. In Proceedings of SIGGRAPH 2000, pages 47--54. ACM Press/Addison-Wesley Publishing Co., 2000.
[23]
J. Petit, R. Brémond, and A. Tom. Evaluation of tone mapping operators in night-time virtual worlds. Virtual Reality, 17(4):253--262, 2013.
[24]
J. Petit and R. K. Mantiuk. Assessment of video tone-mapping: Are cameras' s-shaped tone-curves good enough? Journal of Visual Communication and Image Representation, 24(7):1020--1030, 2013.
[25]
Z.-u. Rahman, D. J. Jobson, and G. A. Woodell. Multiscale retinex for color rendition and dynamic range compression. In SPIE's 1996 International Symposium on Optical Science, Engineering, and Instrumentation, pages 183--191. International Society for Optics and Photonics, 1996.
[26]
M. Čadík, M. Wimmer, L. Neumann, and A. Artusi. Evaluation of HDR tone mapping methods using essential perceptual attributes. Computers and Graphics, 32(3):330--349, 2008.
[27]
R. Wanat and R. K. Mantiuk. Simulating and compensating changes in appearance between day and night vision. In Proceedings of SIGGRAPH 2014, volume 33, pages 147:1--12. ACM, July 2014.
[28]
G. Ward. A contrast-based scalefactor for luminance display. Graphics gems IV, pages 415--421, 1994.

Index Terms

  1. A comparison of night vision simulation methods for video

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        CVMP '14: Proceedings of the 11th European Conference on Visual Media Production
        November 2014
        153 pages
        ISBN:9781450331852
        DOI:10.1145/2668904
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        • BMVA: British Machine Vision Association and Society for Pattern Recognition
        • Google Inc.
        • Disney Research: Disney Research
        • NVIDIA
        • framestore: framestore
        • fxphd: fxphd Pty. Ltd.
        • The Foundry: The Foundry Visionmongers Ltd.
        • FXGuide: FXGuide.com LLC

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 13 November 2014

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. computer graphics
        2. night vision
        3. perception-motivated rendering
        4. video processing
        5. video quality assessment

        Qualifiers

        • Research-article

        Conference

        CVMP '14
        Sponsor:
        • BMVA
        • Disney Research
        • framestore
        • fxphd
        • The Foundry
        • FXGuide
        CVMP '14: 11th European Conference on Visual Media Production
        November 13 - 14, 2014
        London, United Kingdom

        Acceptance Rates

        Overall Acceptance Rate 40 of 67 submissions, 60%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 123
          Total Downloads
        • Downloads (Last 12 months)7
        • Downloads (Last 6 weeks)1
        Reflects downloads up to 16 Feb 2025

        Other Metrics

        Citations

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media