Sylvain Paris
ABSTRACT
This course reviews the wealth of work related to bilateral filtering. The bilateral filter is ubiquitous in computational photography applications. It is increasingly common in computer graphics research papers but no single reference summarizes its properties and applications. This course provides a graphical, intuitive introduction to bilateral filtering, and a practical guide for image editing, tone-mapping, video processing and more.
Supplemental Material
- D. Adalsteinsson and J. A. Sethian. A fast level set method for propagating interfaces. Journal of Computational Physics, 118:269--277, 1995. Google Scholar
Digital Library
- M. Aleksic, M. Smirnov, and S. Goma. Novel bilateral filter approach: Image noise reduction with sharpening. In Proceedings of the Digital Photography II conference, volume 6069. SPIE, 2006.Google ScholarCross Ref
- G. Aubert and P. Kornprobst. Mathematical Problems in Image Processing -- Partial Differential Equations and the Calculus of Variations, volume 147 of Applied Mathematical Sciences. Springer-Verlag, 2006. Google ScholarDigital Library
- V. Aurich and J. Weule. Non-linear gaussian filters performing edge preserving diffusion. In Proceedings of the DAGM Symposium, 1995. Google ScholarDigital Library
- S. Bae, S. Paris, and F. Durand. Two-scale tone management for photographic look. ACM Transactions on Graphics, 25(3):637--645, 2006. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- D. Barash. A fundamental relationship between bilateral filtering, adaptive smoothing and the nonlinear diffusion equation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(6):844, 2002. Google ScholarDigital Library
- D. Barash and D. Comaniciu. A common framework for nonlinear diffusion, adaptive smoothing, bilateral filtering and mean shift. Image and Video Computing, 22(1):73--81, 2004.Google ScholarCross Ref
- D. Barash, T. Schlick, M. Israeli, and R. Kimmel. Multiplicative operator splittings in non-linear diffusion: from spatial splitting to multiplicative timesteps. Journal of Mathematical Imaging and Vision, 19:33--48, 2003. Google ScholarDigital Library
- B. E. Bayer. Color imaging array. US Patent 3971065, 1976.Google Scholar
- E. P. Bennett, J. L. Mason, and L. McMillan. Multispectral bilateral video fusion. IEEE Transactions on Image Processing, 16(5):1185--1194, May 2007. Google ScholarDigital Library
- E. P. Bennett and L. McMillan. Video enhancement using per-pixel virtual exposures. ACM Transactions on Graphics, 24(3):845--852, July 2005. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- M. J. Black, G. Sapiro, D. H. Marimont, and D. Heeger. Robust anisotropic diffusion. IEEE Transactions on Image Processing, 7(3):421--432, March 1998. Google ScholarDigital Library
- A. Buades, B. Coll, and J. Morel. On image denoising method. Technical report, CMLA, 2004.Google Scholar
- A. Buades, B. Coll, and J. Morel. Neighborhood filters and PDE's. Technical Report 04, CMLA, 2005a.Google Scholar
- A. Buades, B. Coll, and J.-M. Morel. Denoising image sequences does not require motion estimation. Technical Report 18, CMLA, 2005b. URL http://www.cmla.ens-cachan.fr/Cmla/Publications/2005/CMLA2005--18.pdf.Google Scholar
- A. Buades, B. Coll, and J.-M. Morel. Neighborhood filters and PDE's. Technical Report 2005--04, CMLA, 2005c.Google Scholar
- A. Buades, B. Coll, and J.-M. Morel. A non local algorithm for image denoising. In Proceedings of the conference on Computer Vision and Pattern Recognition, 2005d. Google ScholarDigital Library
- A. Buades, B. Coll, and J.-M. Morel. A review of image denoising algorithms, with a new one. Multiscale Modeling and Simulation, 4(2):490--530, 2005e.Google ScholarCross Ref
- A. Buades, B. Coll, and J.-M. Morel. The staircasing effect in neighborhood filters and its solution. IEEE Transactions on Image Processing, 15(6):1499--1505, 2006. Google ScholarDigital Library
- F. Catté, P.-L. Lions, J.-M. Morel, and T. Coll. Image selective smoothing and edge detection by nonlinear diffusion. SIAM Journal of Numerical Analysis, 29(1):182--193, February 1992. Google ScholarDigital Library
- J. Chen, S. Paris, and F. Durand. Real-time edge-aware image processing with the bilateral grid. ACM Transactions on Graphics, 26(3), 2007. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- P. Choudhury and J. E. Tumblin. The trilateral filter for high contrast images and meshes. In Proceedings of the Eurographics Symposium on Rendering, 2003. Google ScholarDigital Library
- D. DeCarlo and A. Santella. Stylization and abstraction of photographs. In Proceedings of the SIGGRAPH conference, 2002. Google ScholarDigital Library
- F. Durand and J. Dorsey. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics, 21(3), 2002. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- E. Eisemann and F. Durand. Flash photography enhancement via intrinsic relighting. ACM Transactions on Graphics, 23(3), July 2004. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- M. Elad. On the bilateral filter and ways to improve it. IEEE Transactions On Image Processing, 11(10):1141--1151, October 2002. Google ScholarDigital Library
- M. Elad. Retinex by two bilateral filters. In Proceedings of the Scale-Space conference, 2005. Google ScholarDigital Library
- M. Felsberg, P.-E. Forssén, and H. Scharr. Channel smoothing: Efficient robust smoothing of low-level signal features. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(2):209--222, February 2006. Google ScholarDigital Library
- S. Fleishman, I. Drori, and D. Cohen-Or. Bilateral mesh denoising. ACM Transactions on Graphics, 22(3), July 2003. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- G. Flint, C. Aves, and M. T. Jones. The gigapxl project. http://www.gigapxl.org/.Google Scholar
- F. R. Hampel, E. M. Ronchetti, P. M. Rousseeuw, and W. A. Stahel. Robust Statistics -- The Approach Based on Influence Functions. Wiley Interscience, 1986. ISBN 0-471-73577-9.Google Scholar
- P. J. Huber. Robust Statistics. Probability and Statistics. Wiley-Interscience, February 1981.Google ScholarCross Ref
- L. Itti and C. Koch. Computational modeling of visual attention. Nature Reviews Neuroscience, 2001.Google Scholar
- T. Jones, F. Durand, and M. Zwicker. Normal improvement for point rendering. IEEE Computer Graphics & Applications, 2004. Google ScholarDigital Library
- T. R. Jones, F. Durand, and M. Desbrun. Non-iterative, feature-preserving mesh smoothing. ACM Transactions on Graphics, 22(3), July 2003. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- E. A. Khan, E. Reinhard, R. Fleming, and H. Buelthoff. Image-based material editing. ACM Transactions on Graphics, 25(3), 2006. Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
- R. Kimmel. Numerical Geometry of Images: Theory, Algorithms, and Applications. Verlag, 2003. Google ScholarDigital Library
- J. J. Koenderink and A. J. Van Doorn. The structure of locally orderless images. International Journal of Computer Vision, 31(2--3), 1999. Google ScholarDigital Library
- J. Kopf, M. Uyttendaele, O. Deussen, and M. Cohen. Capturing and viewing gigapixel images. ACM Transactions on Graphics, 26(3), 2007. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- W. Li, S. Xu, and G. Zhao. Adaptive bilateral filter for irregularly sampled meshes. In Proceedings of the Computer Graphics International conference, 2004.Google Scholar
- C. Liu, W. T. Freeman, R. Szeliski, and S. Kang. Noise estimation from a single image. In Proceedings of the conference on Computer Vision and Pattern Recognition. IEEE, 2006. Google ScholarDigital Library
- B. D. Lucas and T. Kanade. An iterative image registration technique with an application to stereo vision. In Proceedings of the Image Understanding Workshop. DARPA, 1981.Google Scholar
- A. Miropolsky and A. Fischer. Reconstruction with 3D geometric bilateral filter. In Proceedings of the Symposium on Solid Modeling and Applications. ACM, 2004. Google ScholarDigital Library
- P. Mrázek, J. Weickert, and A. Bruhn. Geometric Properties from Incomplete Data, chapter On Robust Estimation and Smoothing with Spatial and Tonal Kernels. Springer, 2006.Google Scholar
- D. A. Murio. The Mollification Method and the Numerical Solution of Ill-Posed Problems. Wiley-Interscience, 1993.Google ScholarCross Ref
- B. M. Oh, M. Chen, J. Dorsey, and F. Durand. Image-based modeling and photo editing. In Proceedings of the SIGGRAPH conference. ACM, 2001. Google ScholarDigital Library
- S. Paris. Extraction of Three-dimensional Information from Images -- Application to Computer Graphics. PhD thesis, Université Joseph Fourier, 2004.Google Scholar
- S. Paris, H. Briceño, and F. Sillion. Capture of hair geometry from multiple images. ACM Transactions on Graphics, 23(3), July 2004. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- S. Paris and F. Durand. A fast approximation of the bilateral filter using a signal processing approach. In Proceedings of the European Conference on Computer Vision, 2006a. Google ScholarDigital Library
- S. Paris and F. Durand. A fast approximation of the bilateral filter using a signal processing approach. Technical Report MIT-CSAIL-TR-2006-073, Massachusetts Institute of Technology, 2006b.Google Scholar
- P. Perona and J. Malik. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions Pattern Analysis Machine Intelligence, 12(7):629--639, July 1990. Google ScholarDigital Library
- G. Petschnigg, M. Agrawala, H. Hoppe, R. Szeliski, M. Cohen, and K. Toyama. Digital photography with flash and no-flash image pairs. ACM Transactions on Graphics, 23(3), July 2004. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- T. Q. Pham. Spatiotonal adaptivity in Super-Resolution of Undersampled Image Sequences. PhD thesis, Delft University of Technology, 2006.Google Scholar
- T. Q. Pham and L. J. van Vliet. Separable bilateral filtering for fast video preprocessing. In International Conference on Multimedia and Expo. IEEE, 2005.Google ScholarCross Ref
- C. Poynton. Poynton's colour faq (http://www.poynton.com/colorfaq.html). Web page, 1995. URL http://www.inforamp.net/~poynton/Poynton-color.html.Google Scholar
- R. Ramanath and W. E. Snyder. Adaptive demosaicking. Journal of Electronic Imaging, 12 (4):633--642, 2003.Google ScholarCross Ref
- P. Sand and S. Teller. Particle video: Long-range motion estimation using point trajectories. In Proceedings of the Computer Vision and Pattern Recognition Conference, 2006. Google ScholarDigital Library
- S. Smith and J. Brady. Susan - a new approach to low level image processing. IJCV, 23(1): 45--78, 1997a. URL http://www.fmrib.ox.ac.uk/~steve/susan/index.html. Google ScholarDigital Library
- S. M. Smith and J. M. Brady. SUSAN - a new approach to low level image processing. International Journal of Computer Vision, 23(1):45--78, May 1997b. Google ScholarDigital Library
- N. Sochen, R. Kimmel, and A. M. Bruckstein. Diffusions and confusions in signal and image processing. Journal of Mathematical Imaging and Vision, 14(3):237--244, 2001. Google ScholarDigital Library
- N. Sochen, R. Kimmel, and R. Malladi. A general framework for low level vision. IEEE Transactions in Image Processing, 7:310--318, 1998. Google ScholarDigital Library
- C. Tomasi and R. Manduchi. Bilateral filtering for gray and color images. In Proceedings of the International Conference on Computer Vision, pages 839--846. IEEE, 1998. Google ScholarDigital Library
- J. Tumblin and G. Turk. Low curvature image simplifiers (LCIS): A boundary hierarchy for detail-preserving contrast reduction. In Proceedings of the SIGGRAPH conference. ACM, 1999. Google ScholarDigital Library
- J. van de Weijer and R. van den Boomgaard. Local mode filtering. In Proceedings of the conference on Computer Vision and Pattern Recognition, 2001.Google Scholar
- J. van de Weijer and R. van den Boomgaard. On the equivalence of local-mode finding, robust estimation and mean-shift analysis as used in early vision tasks. In Proceedings of the International Conference on Pattern Recognition, 2002. Google ScholarDigital Library
- L. A. Vese and S. J. Osher. Modeling textures with total variation minimization and oscillating patterns in image processing. Journal of Scientific Computing, 2003. Google ScholarDigital Library
- C. C. Wang. Bilateral recovering of sharp edges on feature-insensitive sampled meshes. IEEE Transactions on Visualization and Computer Graphics, 12(4):629--639, 2006. Google ScholarDigital Library
- S. Wang and W. Heidrich. The design of an inexpensive very high resolution scan camera system. In Proceedings of the Eurographics conference, 2004.Google ScholarCross Ref
- G. S. Watson. Statistics on spheres. John Wiley and Sons, 1983.Google Scholar
- J. Weickert, B. M. ter Haar Romeny, and M. A. Viergever. Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Transactions on Image Processing, 7:398--410, 1998. Google ScholarDigital Library
- B. Weiss. Fast median and bilateral filtering. ACM Transactions on Graphics, 25(3):519--526, 2006. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- H. Winnemöller, S. C. Olsen, and B. Gooch. Real-time video abstraction. ACM Transactions on Graphics, 25(3):1221--1226, 2006. Proceedings of the SIGGRAPH conference. Google ScholarDigital Library
- W. C. K. Wong, A. C. S. Chung, and S. C. H. Yu. Trilateral filtering for biomedical images. In Proceedings of the International Symposium on Biomedical Imaging. IEEE, 2004.Google ScholarCross Ref
- J. Xiao, H. Cheng, H. Sawhney, C. Rao, and M. Isnardi. Bilateral filtering-based optical flow estimation with occlusion detection. In Proceedings of the European Conference on Computer Vision, 2006. Google ScholarDigital Library
- L. P. Yaroslavsky. Digital Picture Processing. An Introduction. Springer Verlag, 1985. Google ScholarDigital Library
Recommendations
Fast median and bilateral filtering
Median filtering is a cornerstone of modern image processing and is used extensively in smoothing and de-noising applications. The fastest commercial implementations (e.g. in Adobe® Photoshop® CS2) exhibit O(r) runtime in the radius of the filter, which ...
A gentle introduction to bilateral filtering and its applications
SIGGRAPH '08: ACM SIGGRAPH 2008 classesThe bilateral filter is a non-linear technique that can blur an image while respecting strong edges. Its ability to decompose an image into different scales without causing haloes after modification has made it ubiquitous in computational photography ...
Impulse Noise Denoising via Eight Directional Searching and Modified Bilateral Filtering
MACE '12: Proceedings of the 2012 Third International Conference on Mechanic Automation and Control EngineeringA new filtering mechanism for denoising impulse noise is presented. At the beginning, the shortcomings of the median-based filtering mechanisms are analyzed, and then the new filtering mechanism is proposed to overcome the drawbacks. To search ...
Comments