Skip to main content
SpringerLink
Log in

Adaptive bound-constrained image deblurring with learned ringing suppression

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Image deblurring is an important task for digital cameras. This paper introduces spatial-variant upper and lower bound constraints to regularize Total Variation blind deconvolution. The local upper and lower bound constraints are computed based on the local structure of the observed image. We demonstrate that the proposed spatial-variant constraints can be useful in PSF estimation and image blind deconvolution. Secondly, as other traditional deblurring techniques, the TV blind deconvolution can also produce ringing artifacts. This paper study the GMM-based method to learn the ringing patch distributions. The learned distribution function is then incorporated into the deblurring objective function to suppress the ringing artifacts. Experiments demonstrated the efficacy of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Almeida MS, Almeida LB (2010) Blind and semi-blind deblurring of natural images. IEEE Trans Image Process 19:36–52

    Article  MathSciNet  Google Scholar 

  2. Babacan SD, Molina R, Katsaggelos AK (2009) Variational Bayesian blind deconvolution using a total variation prior. IEEE Trans Image Process 18:12–26

    Article  MathSciNet  Google Scholar 

  3. Beck A, Teboulle M (2009) Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Trans Image Process 18:2419–2434

    Article  MathSciNet  Google Scholar 

  4. Bertsekas DP (1999) Nonlinear programming. Athena scientific Belmont

  5. Cai J-F, Ji H, Liu C, Shen Z (2009) High-quality curvelet-based motion deblurring from an image pair. IEEE Conference on Computer Vision and Pattern Recognition, pp 1566–1573

  6. Chan TF, Wong C-K (1998) Total variation blind deconvolution. IEEE Trans Image Process 7:370–375

    Article  Google Scholar 

  7. Chan TF, Yip AM, Park FE (2005) Simultaneous total variation image inpainting and blind deconvolution. Int J Imaging Syst Technol 15:92–102

    Article  Google Scholar 

  8. Chartrand R, Wohlberg B (2010) Total-variation regularization with bound constraints. IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP), pp 766–769

  9. Chen X, He X, Yang J, Wu Q (2011) An effective document image deblurring algorithm. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 369–376

  10. Chen X, Yang J, Wu Q (2010) Image deblur in gradient domain. Opt Eng 49:117003

    Article  Google Scholar 

  11. Chen J, Yuan L, Tang C-K, Quan L (2008) Robust dual motion deblurring. IEEE Conference on Computer Vision and Pattern Recognition, pp 1–8

  12. Cho S, Lee S (2009) Fast motion deblurring. ACM Trans Graph (TOG) 145

  13. Cho H, Wang J, Lee S (2012) Text image deblurring using text-specific properties. Computer Vision-ECCV 2012. Springer, pp 524–537

  14. Fergus R, Singh B, Hertzmann A, Roweis ST, Freeman WT (2006) Removing camera shake from a single photograph. ACM Trans Graph (TOG) 25:787–794

    Article  Google Scholar 

  15. Gonzalez RC (2009) Digital image processing. Pearson Education India

  16. Harmeling S, Hirsch M, Sra S, Scholkopf B (2009) Online blind deconvolution for astronomical imaging. IEEE International Conference on Computational Photography (ICCP), pp 1–7

  17. He L, Marquina A, Osher SJ (2005) Blind deconvolution using TV regularization and Bregman iteration. Int J Imaging Syst Technol 15:74–83

    Article  Google Scholar 

  18. Hirsch M, Sra S, Schölkopf B, Harmeling S (2010) Efficient filter flow for space-variant multiframe blind deconvolution. CVPR2010, pp 607–614

  19. Jia J (2007) Single image motion deblurring using transparency. IEEE Conference on Computer Vision and Pattern Recognition, pp 1–8

  20. Joshi N, Kang SB, Zitnick CL, Szeliski R (2010) Image deblurring using inertial measurement sensors. ACM Trans Graph (TOG) 30

  21. Krishnan D, Fergus R (2009) Fast image deconvolution using hyper-Laplacian priors. Advances in Neural Information Processing Systems, pp 1033–1041

  22. Krishnan D, Fergus R (2009) Dark flash photography. ACM Transactions on Graphics, SIGGRAPH

  23. Krishnan D, Tay T, Fergus R (2011) Blind deconvolution using a normalized sparsity measure. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 233–240

  24. Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401:788–791

    Article  Google Scholar 

  25. Lee DD, Seung HS (2001) Algorithms for non-negative matrix factorization. Advances in neural information processing systems, pp 556–562

  26. Levin A, Fergus R, Durand F, Freeman WT (2007) Image and depth from a conventional camera with a coded aperture. ACM Trans Graph (TOG) 70

  27. Levin A, Weiss Y, Durand F, Freeman WT (2009) Understanding and evaluating blind deconvolution algorithms. IEEE Conference on Computer Vision and Pattern Recognition, pp 1964–1971

  28. Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. IEEE International Conference on Computer Vision, pp 416–423

  29. Money JH, Kang SH (2008) Total variation minimizing blind deconvolution with shock filter reference. Image Vis Comput 26:302–314

    Article  Google Scholar 

  30. Nayar S, Ben-Ezra M (2004) Motion-based motion deblurring. IEEE Trans Pattern Anal Mach Intell 26:689–698

    Article  Google Scholar 

  31. Rahmani P, Vozel B, Chehdi K (2008) Sequential blind PSF estimation and restoration of aerial multispectral images. Adv Concepts Intell Vis Syst 5259:410–421

    Article  Google Scholar 

  32. Raskar R, Agrawal A, Tumblin J (2006) Coded exposure photography: motion deblurring using fluttered shutter. ACM Trans Graph (TOG) 25:795–804

    Article  Google Scholar 

  33. Rudin LI, Osher S, Fatemi E (1992) Nonlinear total variation based noise removal algorithms. Physica D Nonlinear Phenom 60:259–268

    Article  MathSciNet  MATH  Google Scholar 

  34. Schuler CJ, Burger HC, Harmeling S, Scholkopf B (2013) A machine learning approach for non-blind image deconvolution. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 1067–1074

  35. Shan Q, Jia J, Agarwala A (2008) High-quality motion deblurring from a single image. ACM Trans Graph (TOG) 73:1–73:10

  36. Tai Y-W, Chen X, Kim S et al (2013) Nonlinear camera response functions and image deblurring: theoretical analysis and practice. IEEE Trans Pattern Anal Mach Intell 35:2498–2512

    Article  Google Scholar 

  37. Tai Y-W, Du H, Brown MS, Lin S (2010) Correction of spatially varying image and video motion blur using a hybrid camera. IEEE Trans Pattern Anal Mach Intell 32:1012–1028

    Article  Google Scholar 

  38. Vogel CR, Oman ME (1996) Iterative methods for total variation denoising. SIAM J Sci Comput 17:227–238

    Article  MathSciNet  MATH  Google Scholar 

  39. Wang Y, Yang J, Yin W, Zhang Y (2008) A new alternating minimization algorithm for total variation image reconstruction. SIAM J Imaging Sci 1:248–272

    Article  MathSciNet  MATH  Google Scholar 

  40. Whyte O, Sivic J, Zisserman A, Ponce J (2012) Non-uniform deblurring for shaken images. Int J Comput Vis 98:168–186

    Article  MathSciNet  MATH  Google Scholar 

  41. Xu L, Jia J (2010) Two-phase kernel estimation for robust motion deblurring. Computer Vision-ECCV 2010. Springer, pp 157–170

  42. You Y-L, Kaveh M (1999) Blind image restoration by anisotropic regularization. IEEE Trans Image Process 8:396–407

    Article  Google Scholar 

  43. Yuan L, Sun J, Quan L, Shum H-Y (2007) Image deblurring with blurred/noisy image pairs. ACM Trans Graph (TOG) 26:1

    Article  Google Scholar 

  44. Zhuo S, Guo D, Sim T (2010) Robust flash deblurring. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 2440–2447

  45. Zoran D, Weiss Y (2011) From learning models of natural image patches to whole image restoration. IEEE International Conference on Computer Vision (ICCV), pp 479–486

Download references

Author information

Authors and Affiliations

  1. Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai, China

    Wei Long & Jie Yang

  2. University of Shanghai for Science and Technology, Shanghai, China

    Xiaogang Chen

Authors
  1. Wei Long
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaogang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jie Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei Long.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Long, W., Chen, X. & Yang, J. Adaptive bound-constrained image deblurring with learned ringing suppression. Multimed Tools Appl 75, 11327–11346 (2016). https://doi.org/10.1007/s11042-015-2856-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2856-2

Keywords

Search

Navigation