skip to main content
research-article

Noise brush: interactive high quality image-noise separation

Published:01 December 2009Publication History
Skip Abstract Section

Abstract

This paper proposes an interactive approach using joint image-noise filtering for achieving high quality image-noise separation. The core of the system is our novel joint image-noise filter which operates in both image and noise domain, and can effectively separate noise from both high and low frequency image structures. A novel user interface is introduced, which allows the user to interact with both the image and the noise layer, and apply the filter adaptively and locally to achieve optimal results. A comprehensive and quantitative evaluation shows that our interactive system can significantly improve the initial image-noise separation results. Our system can also be deployed in various noise-consistent image editing tasks, where preserving the noise characteristics inherent in the input image is a desired feature.

Skip Supplemental Material Section

Supplemental Material

References

  1. ABSoft Inc. 2008. Neat Image User Guide.Google ScholarGoogle Scholar
  2. Adobe Systems. 2008. Adobe After Effects CS4 User Guide.Google ScholarGoogle Scholar
  3. Adobe Systems. 2008. Adobe Photoshop CS4 User Guide.Google ScholarGoogle Scholar
  4. Buades, A., Coll, B., and Morel, J.-M. 2008. Nonlocal image and movie denoising. International Journal of Computer Vision 76, 2, 123--139. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Dabov, K., Foi, A., Katkovnik, V., and Egiazarian, K. 2007. Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE TIP 16, 8, 2080--2095. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Efros, A., and Freeman, W. 2001. Image quilting for texture synthesis and transfer. In Proc. SIGGRAPH, 341--346. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. 27, 3, 67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Imagenomic Inc. 2008. Noiseware User Guide.Google ScholarGoogle Scholar
  9. Laroche, C., and Prescott, M. 1994. Apparatus and methods for adaptively interpolating a full color image utilizing chrominance gradients. U.S. patent 5,373,322.Google ScholarGoogle Scholar
  10. Liu, C., Szeliski, R., Kang, S. B., Zitnick, C. L., and Freeman, W. T. 2008. Automatic estimation and removal of noise from a single image. IEEE TPAMI 30, 2, 299--314. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Mallat, S. 1989. A theory for multiresolution signal decomposition: The wavelet representation. IEEE TPAMI 11, 7, 674--693. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Martin, D., Fowlkes, C., Tal, D., and Malik, J. 2001. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In ICCV.Google ScholarGoogle Scholar
  13. Motwani, M., Gadiya, M., Motwani, R., and Frederick C. Harris, J. 2004. A survey of image denoising techniques. In Proc. of GSPx.Google ScholarGoogle Scholar
  14. Perona, P., and Malik, J. 1990. Scale-space and edge detection using anisotropic diffusion. IEEE TPAMI 12, 7, 629--639. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Petschnigg, G., Agrawala, M., Hoppe, H., Szeliski, R., Cohen, M., and Toyama, K. 2004. Digital photography with flash and no-flash image pairs. In ACM Trans. Graph., vol. 23, 664--672. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. PictureCode Inc. 2008. Noise Ninjia User Guide.Google ScholarGoogle Scholar
  17. Portilla, J., Strela, V., Wainwright, M., and Simoncelli, E. P. 2003. Image denoising using scale mixtures of gaussians in the wavelet domain. IEEE TIP 12(11), 1338--1351. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Roth, S., and Black, M. J. 2005. Fields of experts: A framework for learning image priors. In CVPR. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Salomon, D. 2005. Coding for Data and Computer Communications, 1 ed. Springer. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Simoncelli, E. P., and Adelson, E. H. 1996. Noise removal via Bayesian wavelet coring. In Proc 3rd IEEE Int'l Conf on Image Proc, IEEE Sig Proc Society, Lausanne, vol. I, 379--382.Google ScholarGoogle Scholar
  21. Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In ICCV, 839--846. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Wang, Z., Bovik, A. C., Sheikh, H. R., Member, S., Simoncelli, E. P., and Member, S. 2004. Image quality assessment: From error visibility to structural similarity. IEEE TIP 13, 600--612. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Weiss, Y., and Freeman, B. 2007. What makes a good model of natural images. In CVPR.Google ScholarGoogle Scholar

Index Terms

  1. Noise brush: interactive high quality image-noise separation

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Graphics
          ACM Transactions on Graphics  Volume 28, Issue 5
          December 2009
          646 pages
          ISSN:0730-0301
          EISSN:1557-7368
          DOI:10.1145/1618452
          Issue’s Table of Contents

          Copyright © 2009 ACM

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 1 December 2009
          Published in tog Volume 28, Issue 5

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader