Skip to main content

Advertisement

Springer Nature Link
Log in

Blind Image Deconvolution via Enhancing Significant Segments

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

Blind image deconvolution aims to estimate both a blur kernel and a sharp image from a blurry observation. It is not only a classical problem in image processing, but also serves as preprocessing in many advanced tasks including affective image content analysis. In terms of statistical inference, this problem can be viewed as maximizing the probability of latent image and kernel, given the observed blurry image. Proper formulation of latent image prior is crucial to the success of blind deconvolution methods. A novel latent image prior is proposed to penalize low contrast and dense gradients, thus playing the role of enhancing significant segments. Our latent image prior is based on a one-dimensional regularizer, which involves normalizing reciprocals of absolute differences between two neighbouring unequal components. To solve the resulting optimization problem, a dynamic programming based method is derived to approximately evaluate the proximal operator associated with the proposed regularizer. Both quantitative and qualitative experiments illustrate that our method is comparable to the top-performing algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. By convention, \(\frac{[u_m \ne u_{m+1}]}{|u_{m+1}-u_m|} = 0\) if \(u_m=u_{m+1}\).

  2. \(x_{j:m}\) denotes the subsequence of x from \(x_j\) to \(x_m\).

  3. Here a vector or a segment of a vector is constant means that all of its components are the same.

References

  1. Babacan SD, Molina R, Do MN, Katsaggelos AK (2012) Bayesian blind deconvolution with general sparse image priors. In: European conference on computer vision, pp 341–355

  2. Cao X, Ren W, Zuo W, Guo X (2015) Scene text deblurring using text-specific multiscale dictionaries. IEEE Trans Image Process 24(4):1302–1314

    MathSciNet  MATH  Google Scholar 

  3. Cho S, Lee S (2009) Fast motion deblurring. ACM Trans Graph 28(5):145:1–145:8

    Google Scholar 

  4. Fergus R, Singh B, Hertzmann A, Roweis ST, Freeman WT (2006) Removing camera shake from a single photograph. ACM Trans Graph 25(3):787–794

    MATH  Google Scholar 

  5. Geman S, Geman D (1984) Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell 6(6):721–741

    MATH  Google Scholar 

  6. Gong D, Tan M, Zhang Y, van den Hengel A, Shi Q (2016) Blind image deconvolution by automatic gradient activation. In: IEEE conference on computer vision and pattern recognition, pp 1827–1836

  7. Hunt BR (1973) The application of constrained least squares estimation to image restoration by digital computer. IEEE Trans Comput 22(9):805–812

    Google Scholar 

  8. Jiang X, Yao H, Zhao S (2017) Text image deblurring via two-tone prior. Neurocomputing 242:1–14

    Google Scholar 

  9. Köhler R, Hirsch M, Mohler B, Schölkopf B, Harmeling S (2012) Recording and playback of camera shake: benchmarking blind deconvolution with a real-world database. In: European conference on computer vision, pp 27–40

  10. Lai WS, Ding JJ, Lin YY, Chuang YY (2015) Blur kernel estimation using normalized color-line priors. In: IEEE conference on computer vision and pattern recognition, pp 64–72

  11. Lai WS, Huang JB, Hu Z, Ahuja N, Yang MH (2016) A comparative study for single image blind deblurring. In: IEEE conference on computer vision and pattern recognition, pp 1701–1709

  12. Levin A, Weiss Y, Durand F, Freeman WT (2011) Efficient marginal likelihood optimization in blind deconvolution. In: IEEE conference on computer vision and pattern recognition, pp 2657–2664

  13. Pan J, Su Z (2013) Fast \(l_0\)-regularized kernel estimation for robust motion deblurring. IEEE Signal Process Lett 20(9):841–844

    Google Scholar 

  14. Pan J, Hu Z, Su Z, Yang MH (2017) \(l_0\)-regularized intensity and gradient prior for deblurring text images and beyond. IEEE Trans Pattern Anal Mach Intell 39(2):342–355

    Google Scholar 

  15. Pan J, Sun D, Pfister H, Yang MH (2018) Deblurring images via dark channel prior. IEEE Trans Pattern Anal Mach Intell 40(10):2315–2328

    Google Scholar 

  16. Parikh N, Boyd S (2014) Proximal algorithms. Found Trends Optim 1(3):127–239

    Google Scholar 

  17. Ren W, Cao X, Pan J, Guo X, Zuo W, Yang MH (2016) Image deblurring via enhanced low rank prior. IEEE Trans Image Process 25(7):3426–3437

    MathSciNet  MATH  Google Scholar 

  18. Ren W, Pan J, Cao X, Yang MH (2017) Video deblurring via semantic segmentation and pixel-wise non-linear kernel. In: IEEE international conference on computer vision, pp 1086–1094

  19. Schuler CJ, Hirsch M, Harmeling S, Schölkopf B (2016) Learning to deblur. IEEE Trans Pattern Anal Mach Intell 38(7):1439–1451

    Google Scholar 

  20. Serra JG, Mateos J, Molina R, Katsaggelos AK (2017) Spike and slab variational inference for blind image deconvolution. In: IEEE international conference on image processing, pp 3765–3769

  21. Shan Q, Jia J, Agarwala A (2008) High-quality motion deblurring from a single image. ACM Trans Graph 27(3):73:1–73:10

    Google Scholar 

  22. Storath M, Weinmann A (2014) Fast partitioning of vector-valued images. SIAM J Imaging Sci 7(3):1826–1852

    MathSciNet  MATH  Google Scholar 

  23. Sun L, Cho S, Wang J, Hays J (2013) Edge-based blur kernel estimation using patch priors. In: IEEE international conference on computational photography, pp 1–8

  24. Whyte O, Sivic J, Zisserman A, Ponce J (2012) Non-uniform deblurring for shaken images. Int J Comput Vis 98(2):168–186

    MathSciNet  MATH  Google Scholar 

  25. Wipf D, Zhang H (2014) Revisiting Bayesian blind deconvolution. J Mach Learn Res 15(1):3595–3634

    MathSciNet  MATH  Google Scholar 

  26. Xu L, Jia J (2010) Two-phase kernel estimation for robust motion deblurring. In: European conference on computer vision, pp 157–170

  27. Xu L, Zheng S, Jia J (2013) Unnatural \(l_0\) sparse representation for natural image deblurring. In: IEEE conference on computer vision and pattern recognition, pp 1107–1114

  28. Yan R, Shao L (2016) Blind image blur estimation via deep learning. IEEE Trans Image Process 25(4):1910–1921

    MathSciNet  MATH  Google Scholar 

  29. Yan Y, Ren W, Guo Y, Wang R, Cao X (2017) Image deblurring via extreme channels prior. In: IEEE conference on computer vision and pattern recognition, pp 6978–6986

  30. Zhang G, Roberts TD, Kingsbury N (2014) Image deconvolution using tree-structured Bayesian group sparse modeling. In: IEEE international conference on image processing, pp 4537–4541

  31. Zhang H, Wipf D, Zhang Y (2014) Multi-observation blind deconvolution with an adaptive sparse prior. IEEE Trans Pattern Anal Mach Intell 36(8):1628–1643

    Google Scholar 

  32. Zhao S, Ding G, Gao Y, Han J (2017) Approximating discrete probability distribution of image emotions by multi-modal features fusion. In: International joint conference on artificial intelligence, pp 4669–4675

  33. Zhao S, Yao H, Gao Y, Ji R, Ding G (2017) Continuous probability distribution prediction of image emotions via multitask shared sparse regression. IEEE Trans Multimed 19(3):632–645

    Google Scholar 

  34. Zhao S, Ding G, Huang Q, Chua TS, Schuller BW, Keutzer K (2018) Affective image content analysis: a comprehensive survey. In: International joint conference on artificial intelligence, pp 5534–5541

  35. Zhao S, Gao Y, Ding G, Chua TS (2018) Real-time multimedia social event detection in microblog. IEEE Trans Cybern 48(11):3218–3231

    Google Scholar 

  36. Zhao S, Yao H, Gao Y, Ding G, Chua TS (2018) Predicting personalized image emotion perceptions in social networks. IEEE Trans Affect Comput 9(4):526–540

    Google Scholar 

  37. Zhao S, Zhao X, Ding G, Keutzer K (2018) Emotiongan: unsupervised domain adaptation for learning discrete probability distributions of image emotions. In: ACM international conference on multimedia, pp 1319–1327

  38. Zhao S, Gholaminejad A, Ding G, Gao Y, Han J, Keutzer K (2019) Personalized emotion recognition by personality-aware high-order learning of physiological signals. ACM Trans Multimed Comput Commun Appl 15(1s):14:1–14:18

    Google Scholar 

  39. Zhao S, Lin C, Xu P, Zhao S, Guo Y, Krishna R, Ding G, Keutzer K (2019) Cycleemotiongan: emotional semantic consistency preserved cyclegan for adapting image emotions. In: AAAI conference on artificial intelligence, pp 2620–2627

  40. Zhong L, Cho S, Metaxas D, Paris S, Wang J (2013) Handling noise in single image deblurring using directional filters. In: IEEE conference on computer vision and pattern recognition, pp 612–619

  41. Zuo W, Ren D, Zhang D, Gu S, Zhang L (2016) Learning iteration-wise generalized shrinkage–thresholding operators for blind deconvolution. IEEE Trans Image Process 25(4):1751–1764

    MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

This work was supported by “the Fundamental Research Funds for the Central Universities (2019MS113)”.

Author information

Authors and Affiliations

  1. School of Control and Computer Engineering, North China Electric Power University, Baoding, 071003, China

    Xiaolei Jiang, Erchong Liao & Xiaofeng Liu

Authors
  1. Xiaolei Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Erchong Liao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaofeng Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaolei Jiang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, X., Liao, E. & Liu, X. Blind Image Deconvolution via Enhancing Significant Segments. Neural Process Lett 51, 2139–2154 (2020). https://doi.org/10.1007/s11063-019-10123-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-019-10123-8

Keywords

Search

Navigation