Skip to main content
Log in

Optimal filter based on scale-invariance generation of natural images

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

One of the most striking properties of natural image statistics is the scale invariance. Some earlier studies have assumed that the kurtosis of marginal band pass filter response to be constant throughout scales for a natural image. In our study, this assumption is loosened by adaptively estimating an optimal filter computation whose response distributions through scales have the least Kullback–Leibler divergence. The adaptive filter and its responses characterize the scale-invariance property more accurately and effectively and are further utilized to model the statistics scale-invariance prior in this paper. Extensive experiments on image super-resolution and de-noising manifest that the explored natural images scale-invariance prior model achieves significant performance improvements over the current state-of-the-art schemes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Mumford D, Gidas B (2001) Stochastic models for generic images. Q Appl Math 59(1):85–111

    MathSciNet  MATH  Google Scholar 

  2. Srivastava A, Grenander U, Liu X (2002) Universal analytical forms for modeling image probabilities. IEEE Pattern Anal Mach Intell 24(9):1200–1214

    Article  Google Scholar 

  3. Schellmann M, Gorlatch S, Meiländer D, Kösters T (2011) Parallel medical image reconstruction: from graphics processing units (GPU) to grids. J Supercomput 57(2):151–160

    Article  Google Scholar 

  4. Skaruz J (2014) Two-dimensional patterns and images reconstruction with use of cellular automata. J Supercomput 69(1):9–16

    Article  Google Scholar 

  5. Atick JJ (1992) Could information theory provide an ecological theory of sensory processing. Network 3:213–251

    Article  MATH  Google Scholar 

  6. Bialek W (2002) In Physics of biomolecules and cells. In: Flyvbjerg H, Jülicher F, Ormos P, David F (eds) Proceedings of the Les Houches Summer School, Session LXXV, Springer-Verlag, Berlin, pp 485–577. arXiv:physics/0205030

  7. Lim H-Y, Kang D-S (2013) Efficient noise reduction in images using directional modified sigma filter. J Supercomput 65(2):580–592

    Article  Google Scholar 

  8. Weng C-Y, Zhang YH, Li LC, Wang S-J (2013) Visible watermarking images in high quality of data hiding. J Supercomput 66(2):1033–1048

    Article  Google Scholar 

  9. Chen B-W, Chen C-Y, Wang J-F (2013) Smart homecare surveillance system: behavior identification based on state transition support vector machines and sound directivity pattern analysis. IEEE Trans Syst Man Cybern-Part A: Syst 43(6):1279–1289

    Article  Google Scholar 

  10. Jiang F, Rho S, Chen B-W, Du X, Zhao D (2014) Face hallucination and recognition in social network services. J Supercomput. doi:10.1007/s11227-014-1257-z

  11. Barlow HB (1961) Possible principles underlying the transformation of sensory messages. In: Rosenblith WA (ed) Sensory communication. MIT Press, Cambridge (Mass) London, pp 217–234

  12. Simoncelli EP, Olshausen BA (2001) Natural image statistics and neural representation. Annu Rev Neurosci 24(1):1193–1216

    Article  Google Scholar 

  13. Bialek W (2002) Thinking about the brain. Physics of bio-molecules and cells. Physique des biomolécules et des cellules. Springer, Berlin, pp 485–578

  14. Zoran D, Weiss Y (2009) Scale invariance and noise in natural images. In: IEEE 12th international conference on computer vision, pp 2209–2216

  15. Ruderman DL (1994) The statistics of natural images. Network 5:517–548

    Article  MATH  Google Scholar 

  16. Field DJ (1987) Relations between the statistics of natural images and the response properties of cortical cells. J Opt Soc Am A 4:2379

  17. Weiss Y, Freeman WT (2007) What makes a good model of natural images. In: IEEE conference on computer vision and patern recognition (CVPR), pp 1–8

  18. Zhang H, Zhang Y, Li H, Huang TS (2012) Generative Bayesian image super-resolution with natural image prior. IEEE Trans Image Process 21(9):4054–4067

  19. Lam E, Goodman J (2000) A mathematical analysis of the dct coefficient distributions for images. IEEE Trans Image Process 9(10):1661–1666

  20. Bethge M (2006) Factorial coding of natural images: how effective are linear models in removing higher-order dependencies. J Opt Soc Am A Opt Image Sci Vis 23(6):1253–1268

  21. Ruderman DL, Bialek W (1993) Statistics of natural images: scaling in the woods. In NIPS, pp 551–558

  22. Srivastava A, Lee AB, Simoncelli EP, Zhu S-C (2003) On advances in statistical modeling of natural images. J Math Imaging Vis 18(1):17–33

    Article  MathSciNet  MATH  Google Scholar 

  23. Ruderman DL (1997) Origins of scaling in natural images. Vis Res 37:3385–3398

    Article  Google Scholar 

  24. Domínguez-Molina J, González-Farías G, Rodríguez-Dagnino R, Monterrey I A practical procedure to estimate the shape parameter in the generalized Gaussian distribution. Technique report I-01-18\_eng. pdf. http://www.cimat.mx/reportes/enlinea/I-01-18_eng.pdf

  25. Hou T, Wang S, Qin H (2011) Image deconvolution with multi-stage convex relaxation and its perceptual evaluation. IEEE Trans Image Process 20(12):3383–3392

  26. Gluckman J (2006) Scale variant image pyramids. Comput Vis Pattern Recognit 2006 IEEE Computer Society conference on, vol 1. IEEE

  27. Ren X, Malik J (2002) A probabilistic multi-scale model for contour completion based on image statistics. Computer vision–ECCV, Springer, Berlin, pp 312–327

  28. Freeman WT, Jones TR, Pasztor EC (2002) Example based superresolution. IEEE Comput Graph Appl 22(2):56–65

    Article  Google Scholar 

  29. Glasner D, Bagon S, Irani M (2009) Super-resolution from a single image. In: Proceedings of IEEE international conference on computer vision, Oct 2009, pp 349–356

  30. Zhang H, Yang J, Zhang Y, Huang T (2010) Non-local kernel regression for image and video restoration. In: Proceedings of European conference on computer vision, 2010, pp 566–579

  31. Yang J, Wright J, Huang T, Ma Y (2010) Image super-resolution via sparse representation. IEEE Trans Image Process 19(11):2861–2873

    Article  MathSciNet  Google Scholar 

  32. Baker S, Kanade T (2002) Limits on super-resolution and how to break them. IEEE Trans Pattern Anal Mach Intell 24(9):1167–1183

    Article  Google Scholar 

  33. Li X, Orchard MT (2001) New edge-directed interpolation. IEEE Trans Image Process 10(10):1521–1527

    Article  Google Scholar 

  34. Takeda H, Farsiu S, Milanfar P (2007) Kernel regression for image processing and reconstruction. IEEE Trans Image Process 16(2):349–366

    Article  MathSciNet  Google Scholar 

  35. Tappen MF, Russell BC, Freeman WT (2003) Exploiting the sparse derivative prior for super-resolution and image demosaicing. In: Proceedings of IEEE workshop statistics computer theories vision, Oct 2003, pp 1–24

  36. Keys RG (1981) Cubic convolution interpolation for digital image processing. IEEE Trans Acoust Speech Signal Process ASSP–29(6):1153–1160

    Article  MathSciNet  Google Scholar 

  37. Zhang L, Wu X (2006) Image interpolation via directional filtering and data fusion. IEEE Trans Image Process 15(8):2226–2238

    Article  Google Scholar 

  38. Zhang X, Wu X (2008) Image interpolation by adaptive 2-D autoregressive modeling and soft-decision estimation. Image Process IEEE Trans 17(6):887–896

    Article  Google Scholar 

  39. Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of ICCV 2:416–423

  40. Cai JF, Chan R, Nikolova M (2008) Two-phase methods for deblurring images corrupted by impulse plus Gaussian noise. Inverse Probl Imaging 2(2):187–204

  41. Huang Y, Ng M, Wen Y (2009) Fast image restoration methods for impulse and Gaussian noise removal. IEEE Signal Process Lett 16(6):457–460

  42. Li Y-R, Shen L, Dai D-Q, Suter BW (2011) Framelet algorithms for de-blurring images corrupted by impulse plus Gaussian noise. IEEE Trans Image Process 20(7):1822–1837

    Article  MathSciNet  Google Scholar 

  43. Hwang H, Haddad R (1995) Adaptive median filters: new algorithms and results. IEEE Trans Image Process 4(4):499–502

Download references

Acknowledgments

This work was supported in part by the Major State Basic Research Development Program of China (973 Program 2015CB351804), the National Natural Science Foundation of China under Grant Nos. 61272386 and 61100096, the National Science Council of the Republic of China under Grant Nos. 103-2917-I-564-058, and the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2013R1A1A2061978).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bo-Wei Chen.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, F., Chen, BW., Rho, S. et al. Optimal filter based on scale-invariance generation of natural images. J Supercomput 72, 5–23 (2016). https://doi.org/10.1007/s11227-015-1398-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-015-1398-8

Keywords

Navigation