skip to main content
research-article
Free access

Local Laplacian filters: edge-aware image processing with a Laplacian pyramid

Published: 23 February 2015 Publication History

Abstract

The Laplacian pyramid is ubiquitous for decomposing images into multiple scales and is widely used for image analysis. However, because it is constructed with spatially invariant Gaussian kernels, the Laplacian pyramid is widely believed to be ill-suited for representing edges, as well as for edge-aware operations such as edge-preserving smoothing and tone mapping. To tackle these tasks, a wealth of alternative techniques and representations have been proposed, for example, anisotropic diffusion, neighborhood filtering, and specialized wavelet bases. While these methods have demonstrated successful results, they come at the price of additional complexity, often accompanied by higher computational cost or the need to postprocess the generated results. In this paper, we show state-of-the-art edge-aware processing using standard Laplacian pyramids. We characterize edges with a simple threshold on pixel values that allow us to differentiate large-scale edges from small-scale details. Building upon this result, we propose a set of image filters to achieve edge-preserving smoothing, detail enhancement, tone mapping, and inverse tone mapping. The advantage of our approach is its simplicity and flexibility, relying only on simple point-wise nonlinearities and small Gaussian convolutions; no optimization or postprocessing is required. As we demonstrate, our method produces consistently high-quality results, without degrading edges or introducing halos.

References

[1]
Aubert, G. and Kornprobst, P. Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations. Vol. 147 of Applied Mathematical Sciences. Springer, 2002.
[2]
Aubry, M., Paris, S., Hasinoff, S.W., Kautz, J., and Durand, F. Fast and Robust Pyramid-based Image Processing. Tech. Rep. MIT-CSAILTR-2011-049. MIT, 2011.
[3]
Bae, S., Paris, S., and Durand, F. Two-scale tone management for photographic look. ACM Trans. Graph. (Proc. SIGGRAPH) 25, 3 (2006), 637--645.
[4]
Bhat, P., Zitnick, C.L., Cohen, M., and Curless, B. Gradientshop: A gradient-domain optimization framework for image and video filtering. ACM Trans. Graph. 29 (2010), 2.
[5]
Buades, A., Coll, B., and Morel, J.-M. The staircasing effect in neighborhood filters and its solution. IEEE Trans. Image Process. 15 (2006), 6.
[6]
Burt, P.J. and Adelson, E.H. The Laplacian pyramid as a compact image code. IEEE Trans. Commun. 31 (1983), 4.
[7]
Chen, J., Paris, S., and Durand, F. Real-time edge-aware image processing with the bilateral grid. ACM Trans. Graph. (Proc. SIGGRAPH) 26 (2007), 3.
[8]
Criminisi, A., Sharp, T., Rother, C., and Perez, P. Geodesic image and video editing. ACM Trans. Graph. 29 (2010), 5.
[9]
Dippel, S., Stahl, M., Wiemker, R., and Blaffert, T. Multiscale contrast enhancement for radiographies: Laplacian pyramid versus fast wavelet transform. IEEE Trans. Med. Imaging 21 (2002), 4.
[10]
Durand, F. and Dorsey, J. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. (Proc. SIGGRAPH) 21 (2002), 3.
[11]
Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. (Proc. SIGGRAPH) 27 (2008), 3.
[12]
Fattal, R. Edge-avoiding wavelets and their applications. ACM Trans. Graph. (Proc. SIGGRAPH) 28 (2009), 3.
[13]
Fattal, R., Lischinski, D., and Werman, M. Gradient domain high dynamic range compression. ACM Trans. Graph. (Proc. SIGGRAPH) 21 (2002), 3.
[14]
Fattal, R., Agrawala, M., and Rusinkiewicz, S. Multiscale shape and detail enhancement from multi-light image collections. ACM Trans. Graph. (Proc. SIGGRAPH) 26 (2007), 3.
[15]
Fattal, R., Carroll, R., and Agrawala, M. Edge-based image coarsening. ACM Trans. Graph. 29 (2009), 1.
[16]
Hadwiger, M., Sicat, R., Beyer, J., Krüger, J., and Möller, T. Sparse PDF maps for non-linear multiresolution image operations. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 31 (2012), 5.
[17]
He, K., Sun, J., and Tang, X. Guided image filtering. In Proceedings of European Conference on Computer Vision (Proc. ECCV) (2010).
[18]
Heeger, D.J. and Bergen, J.R. Pyramid-based texture analysis/synthesis. In Proceedings of the ACM SIGGRAPH Conference (Proc. SIGGRAPH) (1995).
[19]
Kass, M. and Solomon, J. Smoothed local histogram filters. ACM Tran. Graph. (Proc. SIGGRAPH) 29 (2010), 3.
[20]
Kimmel, R. Numerical Geometry of Images: Theory, Algorithms, and Applications. Springer, 2003.
[21]
Li, Y., Sharan, L., and Adelson, E.H. Compressing and companding high dynamic range images with subband architectures. ACM Trans. Graph. (Proc. SIGGRAPH) 24 (2005), 3.
[22]
Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. Interactive local adjustment of tonal values. ACM Trans. Graph. (Proc. SIGGRAPH) 25 (2006), 3.
[23]
Mantiuk, R., Myszkowski, K., and Seidel, H.-P. A perceptual framework for contrast processing of high dynamic range images. ACM Trans. Appl. Percept. 3 (2006), 3.
[24]
Mantiuk, R., Mantiuk, R., Tomaszewska, A., and Heidrich, W. Color correction for tone mapping. Comput. Graph. Forum (Proc. Eurographics) 28 (2009), 2.
[25]
Masia, B., Agustin, S., Fleming, R.W., Sorkine, O., and Gutierrez, D. Evaluation of reverse tone mapping through varying exposure conditions. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 28 (2009), 5.
[26]
Paris, S. and Durand, F. Tone-mapping code. http://people.csail.mit.edu/sparis/code/src/tone_mapping.zip.
[27]
Paris, S., Kornprobst, P., Tumblin, J., and Durand, F. Bilateral filtering: Theory and applications. Found. Trends Comput. Graph. Vision 4, 1 (2009), 1--74.
[28]
Paris, S., Hasinoff, S.W., and Kautz, J. Local Laplacian Filters: Edge-aware image processing with a Laplacian pyramid. ACM Trans. Graph. (Proc. SIGGRAPH) 30 (2011), 4.
[29]
Perona, P. and Malik, J. Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 12 (1990), 7.
[30]
Reinhard, E., Stark, M., Shirley, P., and Ferwerda, J. Photographic tone reproduction for digital images. ACM Trans. Graph. (Proc. SIGGRAPH) 21 (2002), 3.
[31]
Subr, K., Soler, C., and Durand, F. Edge-preserving multiscale image decomposition based on local extrema. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 28 (2009), 5.
[32]
Sunkavalli, K., Johnson, M.K., Matusik, W., and Pfister, H. Multiscale image harmonization. ACM Trans. Graph. (Proc. SIGGRAPH) 29 (2010), 3.
[33]
Szeliski, R. Locally adapted hierarchical basis preconditioning. ACM Trans. Graph. (Proc. SIGGRAPH) 25 (2006), 3.
[34]
Tomasi, C. and Manduchi, R. Bilateral filtering for gray and color images. In Proceedings of the IEEE International Conference on Computer Vision (Bombay, India, 1998).
[35]
Tumblin, J. and Turk, G. Low curvature image simplifiers (LCIS): A boundary hierarchy for detail-preserving contrast reduction. In Proc. SIGGRAPH (1999).
[36]
Vuylsteke, P. and Schoeters, E.P. Multiscale image contrast amplification (MUSICA). In Proc. SPIE, Volume 2167 (1994).
[37]
Witkin, A. Scale-space filtering. In Proceedings of the International Joint Conference on Artificial Intelligence, Volume 2 (Karlsruhe, Federal Republic of Germany (a.k.a. West Germany), 1983.
[38]
Witkin, A., Terzopoulos, D., and Kass, M. Signal matching through scale space. Int. J. Comput. Vision 1 (1987), 2.
[39]
Xu, L., Lu, C., Xu, Y., and Jia, J. Image smoothing via L0 gradient minimization. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 30 (2011), 5.
[40]
Xu, L., Yan, Q., Xia, Y., and Jia, J. Structure extraction from texture via relative total variation. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 31 (2012), 5.

Cited By

View all
  • (2025)Weighted quasi-elastic net gradient regularization for image smoothingJournal of Electronic Imaging10.1117/1.JEI.34.1.01305334:01Online publication date: 1-Jan-2025
  • (2024)Dynamic Image Optimization and Code Generation Platform for Enhanced Data AugmentationInternational Journal of Engineering and Advanced Technology10.35940/ijeat.D4432.1304042413:4(23-28)Online publication date: 30-Apr-2024
  • (2024)The Secrets of Penalty Functions on Edge-preserving Image SmoothingSIGGRAPH Asia 2024 Technical Communications10.1145/3681758.3698017(1-4)Online publication date: 3-Dec-2024
  • Show More Cited By

Index Terms

  1. Local Laplacian filters: edge-aware image processing with a Laplacian pyramid

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Communications of the ACM
      Communications of the ACM  Volume 58, Issue 3
      March 2015
      83 pages
      ISSN:0001-0782
      EISSN:1557-7317
      DOI:10.1145/2739250
      • Editor:
      • Moshe Y. Vardi
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 23 February 2015
      Published in CACM Volume 58, Issue 3

      Permissions

      Request permissions for this article.

      Check for updates

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)702
      • Downloads (Last 6 weeks)72
      Reflects downloads up to 28 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)Weighted quasi-elastic net gradient regularization for image smoothingJournal of Electronic Imaging10.1117/1.JEI.34.1.01305334:01Online publication date: 1-Jan-2025
      • (2024)Dynamic Image Optimization and Code Generation Platform for Enhanced Data AugmentationInternational Journal of Engineering and Advanced Technology10.35940/ijeat.D4432.1304042413:4(23-28)Online publication date: 30-Apr-2024
      • (2024)The Secrets of Penalty Functions on Edge-preserving Image SmoothingSIGGRAPH Asia 2024 Technical Communications10.1145/3681758.3698017(1-4)Online publication date: 3-Dec-2024
      • (2024)Chromaticity Gradient Mapping for Interactive Control of Color Contrast in Images and VideoProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676340(1-16)Online publication date: 13-Oct-2024
      • (2024)Modeling the Interplay between Loop Tiling and Fusion in Optimizing Compilers Using Affine RelationsACM Transactions on Computer Systems10.1145/363530541:1-4(1-45)Online publication date: 15-Jan-2024
      • (2024)Scene-Segmentation-Based Exposure Compensation for Tone Mapping of High Dynamic Range Scenes2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)10.1109/APSIPAASC63619.2025.10849135(1-6)Online publication date: 3-Dec-2024
      • (2024)Multi-scale fusion for image enhancement in shield tunneling: a combined MSRCR and CLAHE approachMeasurement Science and Technology10.1088/1361-6501/ad25e435:5(056112)Online publication date: 19-Feb-2024
      • (2024)Unveiling Key Pathological Indicators for Disease Progression in Vogt Koyanagi Harada Disease and Sympathetic Ophthalmia Through Advanced Choroidal Volume AnalysisOcular Immunology and Inflammation10.1080/09273948.2024.233783632:9(2170-2178)Online publication date: 6-May-2024
      • (2024)Enhancing YOLO for occluded vehicle detection with grouped orthogonal attention and dense object repulsionScientific Reports10.1038/s41598-024-70695-x14:1Online publication date: 23-Aug-2024
      • (2024)Gaussian error loss function for image smoothingImage and Vision Computing10.1016/j.imavis.2024.105300152:COnline publication date: 1-Dec-2024
      • Show More Cited By

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDFChinese translation

      eReader

      View online with eReader.

      eReader

      Digital Edition

      View this article in digital edition.

      Digital Edition

      Magazine Site

      View this article on the magazine site (external)

      Magazine Site

      Login options

      Full Access

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media