skip to main content
research-article

Film Grain Rendering and Parameter Estimation

Published: 26 July 2023 Publication History

Abstract

We propose a realistic film grain rendering algorithm based on statistics derived analytically from a physics-based Boolean model that Newson et al. adopted for Monte Carlo simulations of film grain. We also propose formulas for estimation of the model parameters from scanned film grain images. The proposed rendering is computationally efficient and can be used for real-time film grain simulation for a wide range of film grain parameters when the individual film grains are not visible. Experimental results demonstrate the effectiveness of the proposed approach for both constant and real-world images, for a six orders of magnitude speed-up compared with the Monte Carlo simulations of the Newson et al. approach.

Supplementary Material

ZIP File (papers_315-supplemental.zip)
supplemental material
MP4 File (papers_315_VOD.mp4)
presentation

References

[1]
Lucio Azzari, Lucas Rodrigues Borges, and Alessandro Foi. 2018. Modeling and Estimation of Signal-Dependent and Correlated Noise. Springer International Publishing, Cham, 1--36.
[2]
Soonmin Bae, Sylvain Paris, and Frédo Durand. 2006. Two-Scale Tone Management for Photographic Look. In ACM SIGGRAPH 2006 Papers (Boston, Massachusetts) (SIGGRAPH '06). Association for Computing Machinery, New York, NY, USA, 637--645.
[3]
B. E. Bayer. 1964. Relation between granularity and density for a random-dot model. J. Opt. Soc. Am. 54, 12 (Dec. 1964), 1485--1490.
[4]
W. R. Bennett. 1948. Spectra of quantized signals. The Bell System Technical Journal 27, 3 (1948), 446--472.
[5]
Sung Nok Chiu, Dietrich Stoyan, Wilfrid S. Kendall, and Joseph Mecke. 2013. Stochastic geometry and its applications. John Wiley & Sons.
[6]
K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian. 2007. Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16, 8 (2007), 2080--2095.
[7]
Jingjing Dai, Oscar C. Au, Chao Pang, Wen Yang, and Feng Zou. 2010. Film grain noise removal and synthesis in video coding. In Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP). 890--893.
[8]
Joe Geigel and F. Kenton Musgrave. 1997. A Model for Simulating the Photographic Development Process on Digital Images. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '97). ACM Press/Addison-Wesley Publishing Co., USA, 135--142.
[9]
R.M. Gray and D.L. Neuhoff. 1998. Quantization. IEEE Transactions on Information Theory 44, 6 (1998), 2325--2383.
[10]
David J. Heeger and James R. Bergen. 1995. Pyramid-based texture analysis/synthesis. In Proc. Int. Conf. Image Processing (ICIP), vol. III. Washington, DC, 648--651.
[11]
Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization.
[12]
Robert Livingston. 1945. The Theory of the Photographic Process. By C. E. Kenneth Mees. The Journal of Physical Chemistry 49, 5 (1945), 509--509. arXiv:https://doi.org/10.1021/j150443a017
[13]
Teodor Mihai Moldovan, Stefan Roth, and Michael J. Black. 2006. Denoising archival films using a learned Bayesian model. In 2006 International Conference on Image Processing. 2641--2644.
[14]
Firouz Naderi. 1976. Estimation and detection of images degraded by film-grain noise. Technical Report. Univ. S. California, Image Processing Inst., Los Angeles, CA.
[15]
F. Naderi and A. A. Sawchuk. 1978a. Detection of low-contrast images in film-grain noise. Appl. Opt. 17, 18 (Sep 1978), 2883--2891.
[16]
F. Naderi and A. A. Sawchuk. 1978b. Estimation of images degraded by film-grain noise. Appl. Opt. 17, 8 (Apr 1978), 1228--1237.
[17]
Alasdair Newson, Julie Delon, and Bruno Galerne. 2017a. A Stochastic Film Grain Model for Resolution-Independent Rendering. Computer Graphics Forum 36, 8 (2017), 684--699. arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.13159
[18]
Alasdair Newson, Noura Faraj, Julie Delon, and Bruno Galerne. 2017b. Analysis of a Physically Realistic Film Grain Model, and a Gaussian Film Grain Synthesis Algorithm. In Scale Space and Variational Methods in Computer Vision.
[19]
Alasdair Newson, Noura Faraj, Bruno Galerne, and Julie Delon. 2017c. Realistic Film Grain Rendering. Image Processing On Line 7 (2017), 165--183.
[20]
Andrey Norkin and Neil Birkbeck. 2018. Film Grain Synthesis for AV1 Video Codec. In Data Compression Conference. Snowbird, UT, 3--12.
[21]
P.G. Nutting. 1913. XXXII. On the absorption of light in heterogeneous media. The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science 26, 153 (1913), 423--426. arXiv:https://doi.org/10.1080/14786441308634988
[22]
Byung Tae Oh, C. C. Jay Kuo, Shijun Sun, and Shawmin Lei. 2007. Film grain noise modeling in advanced video coding. In Visual Communications and Image Processing 2007 (Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, Vol. 6508), Chang Wen Chen, Dan Schonfeld, and Jiebo Luo (Eds.). Article 650811, 650811 pages.
[23]
Byung Tae Oh, Shaw-min Lei, and C.-C. Jay Kuo. 2009. Advanced Film Grain Noise Extraction and Synthesis for High-Definition Video Coding. IEEE Trans. Circuits Syst. Video Technol. 19, 12 (2009), 1717--1729.
[24]
W Romer and EWH Selwyn. 1943. An Instrument for the Measurement of Graininess. Phot. J., 83_ 17 (1943).
[25]
Tim Vitale. 2010. Film Grain, Resolution and Fundamental Film Particles. https://cool.culturalheritage.org/videopreservation/library/film_grain_resolution_and_perception_v24.pdf
[26]
B. Widrow. 1956. A Study of Rough Amplitude Quantization by Means of Nyquist Sampling Theory. IRE Transactions on Circuit Theory 3, 4 (1956), 266--276.
[27]
B. Widrow. 1961. Statistical analysis of amplitude-quantized sampled-data systems. Transactions of the American Institute of Electrical Engineers, Part II: Applications and Industry 79, 6 (1961), 555--568.
[28]
Jacky Chun Kit Yan and Dimitris Hatzinakos. 1997. Signal-dependent film grain noise removal and generation based on higher-order statistics. In Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics. 77--81.

Cited By

View all
  • (2024)Media2Face: Co-speech Facial Animation Generation With Multi-Modality GuidanceACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657413(1-13)Online publication date: 13-Jul-2024
  • (2024)CNS-Edit: 3D Shape Editing via Coupled Neural Shape OptimizationACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657412(1-12)Online publication date: 13-Jul-2024
  • (2024)A Persona-Infused Cross-Task Graph Network for Multimodal Emotion Recognition with Emotion Shift Detection in ConversationsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657944(2266-2270)Online publication date: 10-Jul-2024
  • Show More Cited By

Index Terms

  1. Film Grain Rendering and Parameter Estimation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Graphics
    ACM Transactions on Graphics  Volume 42, Issue 4
    August 2023
    1912 pages
    ISSN:0730-0301
    EISSN:1557-7368
    DOI:10.1145/3609020
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 July 2023
    Published in TOG Volume 42, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. film grain rendering
    2. stochastic geometry
    3. boolean model

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)170
    • Downloads (Last 6 weeks)16
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Media2Face: Co-speech Facial Animation Generation With Multi-Modality GuidanceACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657413(1-13)Online publication date: 13-Jul-2024
    • (2024)CNS-Edit: 3D Shape Editing via Coupled Neural Shape OptimizationACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657412(1-12)Online publication date: 13-Jul-2024
    • (2024)A Persona-Infused Cross-Task Graph Network for Multimodal Emotion Recognition with Emotion Shift Detection in ConversationsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657944(2266-2270)Online publication date: 10-Jul-2024
    • (2024)ArabicaQA: A Comprehensive Dataset for Arabic Question AnsweringProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657889(2049-2059)Online publication date: 10-Jul-2024
    • (2023)CIRAL at FIRE 2023: Cross-Lingual Information Retrieval for African LanguagesProceedings of the 15th Annual Meeting of the Forum for Information Retrieval Evaluation10.1145/3632754.3633076(4-6)Online publication date: 15-Dec-2023
    • (undefined)Graph Augmentation Empowered Contrastive Learning for RecommendationACM Transactions on Information Systems10.1145/3677377

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media