Abstract
An accurate quantitative noise estimate is required in many image/video processing applications like denoising, computer vision, pattern recognition and tracking. But blind and accurate estimation of noise in an unknown image is a challenging task and hence is an open area of research. We propose the first elegant and novel blind noise estimation method based on random image tile selection and statistical sampling theory for estimating standard deviation of zero mean Gaussian and speckle noise in digital images. Randomly selected samples, i.e., pixels with \(3\times 3\) neighborhood, are checked for availability of edges in the tile. If there is an edge in the tile at more than one neighboring pixel, the tile is excluded. Only non-edge tiles are used for estimation of noise in the tile and subsequently in the image using the concepts of statistical sampling theory. Finally, we propose a supervised curve fitting approach using the proposed noise estimation model for more accurate estimation of standard deviation of the two types of noise. The proposed technique is computationally efficient as it is a selective random sample-based spatial domain technique. Benchmarking with other contemporary techniques published so far shows that the proposed technique clearly outperforms the others by at least 5% improved noise estimates, over a very wide range of noise.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Buades, A., Coll, B., Morel, J.-M.: A non-local algorithm for image denoising. In: Computer Vision and Pattern Recognition (CVPR), San Deigo, CA, USA, pp. 60-65. IEEE (2005)
Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)
Easley, G.R., Labate, D., Colonna, F.: Shearlet-based total variation diffusion for denoising. IEEE Trans. Image Process. 18(2), 260–268 (2009)
Selesnick, I.W.: Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency. IEEE Trans. Signal Process. 50(11), 2744–2756 (2002)
Chang, Y., Saito, S., Nakajima, M.: Example-based color transformation of image and video using basic color categories. IEEE Trans. Image Process. 16(2), 329–336 (2007). doi:10.1109/TIP.2006.888347
Yu, S., Zhao, Y., Mou, Y., Wu, J., Han, L., Yang, X., Zhao, B.: Content-adaptive rain and snow removal algorithms for single image. In: Zeng, Z., Li, Y., King, I. (eds.) Advances in Neural Networks—ISNN 2014: 11th International Symposium on Neural Networks, ISNN 2014, Hong Kong and Macao, China, November 28–December 1, 2014, Proceedings. pp. 439–448. Springer, Cham (2014)
Yu, S., Mou, Y., Xu, D., You, X., Zhou, L., Zeng, W.: A new algorithm for shoreline extraction from satellite imagery with non-separable wavelet and level set method. Int. J. Mach. Learn. Comput. 3(1), 158 (2013)
Jin-Chao, L., Hui-Ming, T., Chao, L.: Noise estimation in video surveillance systems. In: World Congress on Computer Science and Information Engineering, Los Angeles, CA, USA, pp. 578–582. IEEE (2009)
Wang, X., Türetken, E., Fleuret, F., Fua, P.: Tracking interacting objects optimally using integer programming. In: European Conference on Computer Vision (ECCV), Zurich, Switzerland, pp. 17–32. Springer (2014)
Turetken, E., Wang, X., Becker, C.J., Haubold, C., Fua, P.: Network flow integer programming to track elliptical cells in time-lapse sequences. IEEE Trans. Med. Imaging 36(4), 942–951 (2016)
Wang, X., Türetken, E., Fleuret, F., Fua, P.: Tracking interacting objects using intertwined flows. IEEE Trans. Pattern Anal. Mach. Intell. 38(11), 2312–2326 (2016)
Donoho, D.L., Johnstone, J.M.: Ideal spatial adaptation by wavelet shrinkage. Biometrika 81(3), 425–455 (1994)
Hashemi, M., Beheshti, S.: Adaptive noise variance estimation in BayesShrink. IEEE Signal Process. Lett. 17(1), 12–15 (2010). doi:10.1109/LSP.2009.2030856
Zoran, D., Weiss, Y.: Scale invariance and noise in natural images. In: International Conference on Computer Vision, Kyoto, Japan, pp. 2209–2216. IEEE (2009)
Shin, D.-H., Park, R.-H., Yang, S., Jung, J.-H.: Block-based noise estimation using adaptive Gaussian filtering. IEEE Trans. Consum. Electron. 51(1), 218–226 (2005)
Pyatykh, S., Hesser, J., Zheng, L.: Image noise level estimation by principal component analysis. IEEE Trans. Image Process. 22(2), 687–699 (2013)
Liu, X., Tanaka, M., Okutomi, M.: Estimation of signal dependent noise parameters from a single image. In: International Conference on Image Processing (ICIP), Melbourne, Australia, pp. 79–82. IEEE (2013)
Ghazal, M., Amer, A.: Homogeneity localization using particle filters with application to noise estimation. IEEE Trans. Image Process. 20(7), 1788–1796 (2011). doi:10.1109/TIP.2010.2097272
Azzari, L., Foi, A.: Indirect estimation of signal-dependent noise with nonadaptive heterogeneous samples. IEEE Trans. Image Process. 23(8), 3459–3467 (2014)
Chen, G., Zhu, F., Ann Heng, P.: An efficient statistical method for image noise level estimation. In: International Conference on Computer Vision, Santiago, Chile, pp. 477–485 (2015)
Granados, M., Aydın, T.O., Tena, J.R., Lalonde, J.-F., Theobalt, C.: HDR image noise estimation for denoising tone mapped images. In: European Conference on Visual Media Production, London, UK, pp. 1–8. ACM (2015)
Liu, X., Tanaka, M., Okutomi, M.: Practical signal-dependent noise parameter estimation from a single noisy image. IEEE Trans. Image Process. 23(10), 4361–4371 (2014)
Cui, G., Feng, H., Xu, Z., Li, Q., Chen, Y.: No-reference image noise estimation based on noise level accumulation. Opt. Rev. 23(2), 208–219 (2016)
Khmag, A., Ramli, A.R., Al-haddad, S.A.R., Kamarudin, N.: Natural image noise level estimation based on local statistics for blind noise reduction. Vis. Comput. (2017). doi:10.1007/s00371-017-1362-0
Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice-Hall, Inc., Upper Saddle River (2006)
Jain, A.K.: Fundamentals of Digital Image Processing. Prentice-Hall, Inc., Upper Saddle River (1989)
Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)
Shima, T., Saito, S., Nakajima, M.: Design and evaluation of more accurate gradient operators on hexagonal lattices. IEEE Trans. Pattern Anal. Mach. Intell. 32(6), 961–973 (2010). doi:10.1109/TPAMI.2009.99
Sunter, A.: List sequential sampling with equal or unequal probabilities without replacement. Appl. Stat. 26(3), 261–268 (1977)
Dollár, P., Tu, Z., Tao, H., Belongie, S.: Feature mining for image classification. In: Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, USA, pp. 1–8. IEEE (2007)
Cooper, G.R., McGillem, C.D.: Elements of statistics. In: Probabilistic methods of signal and system analysis, pp. 159–168. Oxford University Press, Oxford (1986)
Casella, G., Berger, R.L.: Statistical Inference, vol. 2. Duxbury Pacific Grove, Los Angeles (2002)
Lancaster, P., Salkauskas, K.: Curve Fitting with Polynomials. In: Curve and surface fitting. An Introduction. Academic Press, London (1986)
Zhang, Y., Cao, J., Chen, Z., Li, X., Zeng, X.-M.: B-spline surface fitting with knot position optimization. Comput. Gr. 58, 73–83 (2016)
Xu, G., Kwok, T.-H., Wang, C.C.: Isogeometric computation reuse method for complex objects with topology-consistent volumetric parameterization. Comput. Aided Des. 91, 1–13 (2017)
Sheikh, H.R., Wang, Z., Cormack, L., Bovik, A.C.: LIVE image quality assessment database release 2. http://live.ece.utexas.edu/research/quality/subjective.htm
Immerkaer, J.: Fast noise variance estimation. Comput. Vis. Image Underst. 64(2), 300–302 (1996)
Liu, X., Tanaka, M., Okutomi, M.: Single-image noise level estimation for blind denoising. IEEE Trans. Image Process. 22(12), 5226–5237 (2013)
Karibasappa, K., Karibasappa, K.: AI based automated identification and estimation of noise in digital images. In: Advances in Intelligent Informatics, pp. 49–60. Springer, New York (2015)
Virtanen, T., Nuutinen, M., Vaahteranoksa, M., Oittinen, P., Häkkinen, J.: CID2013: a database for evaluating no-reference image quality assessment algorithms. IEEE Trans. Image Process. 24(1), 390–402 (2015)
Author information
Authors and Affiliations
Corresponding author
Appendix A: How many samples should be taken?
Appendix A: How many samples should be taken?
An image I of size \(M\times N\) has approximately the same number of \(3\times 3\) tiles neglecting the boundary pixel positions. In this work, we consider a small square tile as a sample of the complete image for noise estimation. For example, an image of size 1K \(\times \) 1K = 1M pixels will have exactly (1M-4K-4) \(3\times 3\) tiles or approximately equal to 1M (with accuracy of more than 99.5%) tiles. Thus out of the available 1M tiles, how many tiles should be randomly taken to represent the complete image population accurately is an issue of concern. Obviously, for smaller size images, the same number of samples will be more than enough.
Let us assume that an image I is added a zero mean Gaussian noise of standard deviation \(\sigma \). The noisy image \(I_{N }\) modeled using a Gaussian variable has a measured mean \(\mu \) and standard deviation \(\sigma \)\(_{n}\). Let the unknown number ‘n’ of tile samples taken randomly has complete true mean \(\bar{{X}}\), while each sample mean is \(\hat{{\bar{{X}}}}\) and the variance of sample mean is Var(\(\hat{{\bar{{X}}}})\). Then, the minimum number of samples n for truly representing the complete population (\(I_{N}\)) for estimating the mean of the population to p% accuracy of the true mean value \(\mu \) is given by (14) [31].
Leading to,
Thus, using (14), for around 2% estimation error in estimation of the population mean that overall represents the complete population; the number of required samples are 1200. Further, for 5% error in the estimation of the true mean \(\mu \), it comes down to around 100. In the experiment section, we experimentally establish that the number of samples above 100 (0.0004%) and up to 5000 does not yield much improvement in the accuracy of the estimate over a wide range of the added noise standard deviation for image Lena of size \(512\times 512\).
The theoretical error in computation of noise standard deviation estimation can be obtained using (6). A simple re-arrangement of terms in (6) leads to (15).
where \(\sigma _{\mathrm{est}}\) is the estimated standard deviation estimated using (6) and \(\sigma _{\mathrm{added}}\) is the true noise standard deviation of the complete population, i.e., added noise in our experiments.
It is clear from (15) that, as ntends to \(\infty \), i.e., the complete population, error e tends to 0. This is obviously true. In case of practical images, object edges and segment texture region make the distribution of image non-Gaussian. Hence, selecting a large sample size will invalidate the basis of sampling theory due to increased probability of image edges and textures being included in the sample tiles. If we consider the smallest symmetric sample tile size \(3\times 3\), it yields sample size of 9. Using (15) yields the percent error e as 5.71%. For 7% error in estimation, we require \(\sim \)7.4 samples (i.e., 8 samples) leading to unsymmetrical tile size. For a sample size 100, the percentage error yield using (15) is 0.5%. The error in estimation will go on reducing for larger sample size for a truly random distribution. However, practical noisy images are not truly random variables. Also bigger tile sizes lead to inaccurate estimates as already discussed.
Thus, we take number of samples \(n = 100\) and the smallest symmetric and most probably smooth 3\(\times 3 = 9\) sample (tile) size for our experiments.
Rights and permissions
About this article
Cite this article
Kamble, V.M., Parate, M.R. & Bhurchandi, K.M. No reference noise estimation in digital images using random conditional selection and sampling theory. Vis Comput 35, 5–21 (2019). https://doi.org/10.1007/s00371-017-1437-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-017-1437-y