Skip to main content
Log in

Blind Image Deconvolution: When Patch-wise Minimal Pixels Prior Meets Fractional-Order Method

  • Published:
Journal of Mathematical Imaging and Vision Aims and scope Submit manuscript

Abstract

Blind image deconvolution is a challenging issue in image processing. In blind image deconvolution, the typical approach involves iteratively estimating both the blur kernel and latent image until convergence to the blur kernel of the observed image is achieved. Recently, several approaches have been attempted to develop a sophisticated regularization to obtain the clean image. However, existing methods often struggle to effectively handle ringing artifacts and local blur. To overcome these limitations, we introduce a fractional-order variational model. This model alleviates the ringing artifacts through the selection of an optimal derivative. Subsequently, to refine the latent image further, we leverage the local prior, namely patch-wise minimal pixels (PMP) prior. Since the PMP prior of clean images blocks is much sparser than that of blurred ones, it is capable of discriminating between clean and blurred image blocks. We illustrate the effective integration of the fractional-order operations and the PMP prior within our proposed approach. Moreover, the convergence of our algorithm has been proved as the values of the objective function monotonically decrease. Extensive experiments on different datasets demonstrate the superiority of the proposed method compared with other methods in terms of reconstruction quality for blind deconvolution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Data Availability

Enquiries about data availability should be directed to the authors.

References

  1. Cho, Sunghyun, Lee, Seungyong: Fast motion deblurring. In Acm Siggraph Asia, pages 1–8. ACM, (2009)

  2. XiaoYuan, Yu., Xie, Wei: Single image blind deblurring based on salient edge-structures and elastic-net regularization. J. Math. Imaging Vis. 62(8), 1049–1061 (2020)

    Article  MathSciNet  MATH  Google Scholar 

  3. Pan, Jinshan, Sun, Deqing, Pfister, Hanspeter, Yang, Ming-Hsuan: Blind image deblurring using dark channel prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition

  4. Xu, Li, Jia, Jiaya: Two-phase kernel estimation for robust motion deblurring. In Computer Vision–ECCV 2010: 11th European Conference on Computer Vision, pages 157–170. Springer, (2010)

  5. Whyte, Oliver, Sivic, Josef, Zisserman, Andrew: Deblurring shaken and partially saturated images. Int. J. Comput. Vis. 110, 185–201 (2014)

    Article  MATH  Google Scholar 

  6. Chang, Chia-Feng., Jiunn-Lin, Wu., Chen, Kuan-Jen.: A hybrid motion deblurring strategy using patch based edge restoration and bilateral filter. J. Math. Imaging Vis. 60, 1081–1094 (2018)

    Article  MathSciNet  MATH  Google Scholar 

  7. Li, Bo., Xie, Wei: Adaptive fractional differential approach and its application to medical image enhancement. Comput. Electr. Eng. 45, 324–335 (2015)

    Article  MATH  Google Scholar 

  8. Köhler, Rolf, Hirsch, Michael, Mohler, Betty, Schölkopf, Bernhard, Harmeling, Stefan: Recording and Playback of Camera Shake: Benchmarking Blind Deconvolution with a Real-World Database. Springer, Berlin (2012)

    MATH  Google Scholar 

  9. Creswell, Antonia, White, Tom, Dumoulin, Vincent, Arulkumaran, Kai, Sengupta, Biswa, Bharath, Anil A.: Generative adversarial networks: an overview. IEEE Signal Process. Mag. 35(1), 53–65 (2018)

    Article  Google Scholar 

  10. Lai, Weisheng, Huang, Jiabin, Hu, Zhe, Ahuja, Narendra, Yang, Minghsuan.: A comparative study for single image blind deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1701–1709. IEEE, (2016)

  11. Li, Xiaopan, Shiqian, Wu., Xie, Shoulie, Agaian, Sos: Dynamic-clustering extreme intensity prior based blind image deblurring. J. Math. Imaging Vis. 66(1), 22–36 (2024)

    Article  MathSciNet  MATH  Google Scholar 

  12. Chen, Liang, Fang, Faming, Wang, Tingting, Zhang, Guixu: Blind image deblurring with local maximum gradient prior. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1742–1750. IEEE, (2019)

  13. Hu, Zhe, Cho, Sunghyun, Wang, Jue, Yang, Ming-Hsuan.: Deblurring low-light images with light streaks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3382–3389. IEEE, (2014)

  14. Sun, Libin, Cho, Sunghyun, Wang, Jue, Hays, James.: Edge-based blur kernel estimation using patch priors. In IEEE international conference on computational photography pages 1–8. IEEE, 859(2013)

  15. Pan, Jinshan, Hu, Zhe, Su, Zhixun, Yang, Ming-Hsuan: Deblurring face images with exemplars. In Computer vision–ECCV 2014: 13th European conference, pages 47–62. Springer, (2014)

  16. Rob Fergus, Barun Singh, Aaron Hertzmann, Sam T Roweis, and William T Freeman. Removing camera shake from a single photograph. In ACM Siggraph 2006 Papers, pages 787–794. ACM, 2006

  17. Anat Levin, Yair Weiss, Fredo Durand, and William T Freeman. Understanding and evaluating blind deconvolution algorithms. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1964–1971. IEEE, 2009

  18. Li Xu, Shicheng Zheng, and Jiaya Jia. Unnatural l0 sparse representation for natural image deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 8741107–1114. IEEE, 2013

  19. Wen, Fei, Ying, Rendong, Liu, Yipeng, Liu, Peilin, Truong, Trieu-Kien.: A simple local minimal intensity prior and an improved algorithm for blind image deblurring. IEEE Trans. Circuits Syst. Video Technol. 31(8), 2923–2937 (2021)

    Article  MATH  Google Scholar 

  20. Shao, Wenze: Revisiting the regularizers in blind image deblurring with a new one. IEEE Trans. Image Process. 32(8), 3994–4009 (2023)

    Article  MATH  Google Scholar 

  21. Xiaoyuan, Yu., Xie, Wei, Jinwei, Yu.: A single image deblurring approach based on a fractional order dark channel prior. Int. J. Ap. Mat. Com. Pol. 32(3), 441–454 (2022)

    MathSciNet  MATH  Google Scholar 

  22. Liu, Jing, Tan, Jieqing, Ge, Xianyu, Dandan, Hu., He, Lei: Blind deblurring with fractional-order calculus and local minimal pixel prior. J. Vis. Commun. Image R. 89(2), 103–115 (2022)

    MATH  Google Scholar 

  23. Lyu, Chengyao, Zhao, Xile, Li, Benzheng, Zhang, Hao, Huang, Tingzhu: Multi-dimensional image recovery via fully-connected tensor network decomposition under the learnable transforms. J. Sci. Comput. 93, 49 (2022)

    Article  MathSciNet  MATH  Google Scholar 

  24. Liu, Yunan, Wang, Chunpeng, Mingyu, Lu., Yang, Jian, Gui, Jie, Zhang, Shanshan: From simple to complex scenes: learning robust feature representations for accurate human parsing. IEEE T. Pattern Anal. 46(8), 5449–5462 (2024)

    Article  MATH  Google Scholar 

  25. Mao, Yuxin, Wan, Zhexiong, Dai, Yuchao, Xin, Yu.: Deep idempotent network for efficient single image blind deblurring. IEEE T. Circ. Syst. Vid. 33(1), 172–185 (2022)

    Article  MATH  Google Scholar 

  26. Kaufman, Adam, Fattal, Raanan: Deblurring using analysis-synthesis networks pair. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 5811–5820. 901IEEE, (2020)

  27. Carbajal, Guillermo, Vitoria, Patricia, Lezama, José, Musé, Pablo: Blind motion deblurring with pixel-wise kernel estimation via kernel prediction networks. IEEE Trans. Comput. Imaging 9, 928–943 (2023)

    Article  Google Scholar 

  28. Wei, Zhihao, Zhang, Bo., Jiang, Yanwei: Analysis and modeling of fractional-order buck converter based on riemann-liouville derivative. IEEE Access 7, 162768–162777 (2019)

    Article  MATH  Google Scholar 

  29. Caputo, Michele: Mean fractional-order-derivatives differential equations and filters. Ann. Univ. Ferrara. 41(1), 73–84 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  30. Zhang, Jianping, Chen, Ke.: A total fractional-order variation model for image restoration with nonhomogeneous boundary conditions and its numerical solution. SIAM J. Imag. Sci. 8(4), 2487–2518 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  31. Wang, Xiangyang, Deng, Maoying, Niu, Panpan, Yang, Hongying: Qfpjfms: quaternion fractional-order pseudo-jacobi-fourier moments. J. Math. Imaging Vis. 66(2), 93–114 (2024)

    Article  MathSciNet  MATH  Google Scholar 

  32. Kumar, Ahlad , Ahmad, M. Omair, Swamy, M. N. S.: Image denoising based on fractional gradient vector flow and overlapping group sparsity as priors. IEEE Trans. Image Process., 30(6):7527–7540, (2021)

  33. Jin, Bangti: Fractional differential equations: an approach via fractional derivatives. Applied Mathematical Sciences, (2022)

  34. Podlubny, Igor, Chechkin, Aleksei, Skovranek, Tomas, Chen, YangQuan, Jara, Blas M Vinagre. Matrix approach to discrete fractional calculus ii: partial fractional differential equations. J. Comput. Phys., 228(8):3137–3153, (2009)

  35. Wang, Hong, Ning, Du.: Fast solution methods for space-fractional diffusion equations. J. Comput. Appl. Math. 255, 376–383 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  36. Zhihao, Gu., Li, Fang, Fang, Faming, Zhang, Guixu: A novel retinex-based fractional-order variational model for images with severely low light. IEEE Trans. Image Process. 29, 3239–3253 (2020)

    Article  MathSciNet  MATH  Google Scholar 

  37. Wei-Sheng Lai, Jian-Jiun Ding, Yen-Yu Lin, and Yung-Yu Chuang. Blur kernel estimation using normalized color-line priors. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 64–72. IEEE, 2015

  38. Liang Chen, Jiawei Zhang, Songnan Lin, Faming Fang, and Jimmy S Ren. Blind deblurring for saturated images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 6308–6316. IEEE, 2021

  39. Phong Tran, Anh Tuan Tran, Quynh Phung, and Minh Hoai. Explore image deblurring via encoded blur kernel space. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 11956–11965. IEEE, 2021

  40. Zhenhua, Xu., Chen, Huasong, Li, Zhenhua: Fast blind deconvolution using a deeper sparse patch-wise maximum gradient prior. Signal Process. Image Commun. 90, 116050 (2021)

  41. Jinshan Pan, Zhe Hu, Zhixun Su, and Ming-Hsuan Yang. Deblurring text images via l0-regularized intensity and gradient prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2901–2908. IEEE, 2014

  42. Meina Zhang, Yingying Fang, Guoxi Ni, and Tieyong Zeng. Pixel screening based intermediate correction for blind deblurring. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 5892–5900. IEEE, 2022

  43. Beck, Amir: First-order methods in optimization. Society for Industrial and Applied Mathematics, Philadelphia (2017)

    Book  MATH  Google Scholar 

  44. Dilip Krishnan, Terence Tay, and Rob Fergus. Blind deconvolution using a normalized sparsity measure. In CVPR 2011, pages 233–240. IEEE, 2011

  45. Zhou Wang, A.C., Bovik, H.R. Sheikh., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process 13, 600–612 (2004)

    Article  MATH  Google Scholar 

  46. Sidi Yang, Tianhe Wu, Shuwei Shi, Shanshan Lao, Yuan Gong, Mingdeng Cao, Jiahao Wang, and Yujiu Yang. Maniqa: Multi-dimension attention network for no-reference image quality assessment. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pages 1191–1200. IEEE, June 2022

  47. Levin, Anat, Weiss, Yair, Durand, Fredo, Freeman, William T.: Understanding blind deconvolution algorithms. IEEE Trans. Pattern Anal. Mach. Intell 33, 2354–2367 (2011)

    Article  Google Scholar 

  48. Haichao Zhang, David Wipf, and Yanning Zhang. Multi-image blind deblurring using a coupled adaptive sparse prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1051–1058. IEEE, 2013

  49. Tomer Michaeli and Michal Irani. Blind deblurring using internal patch recurrence. In Computer Vision–ECCV 2014: 13th European Conference, pages 783–798. Springer, 2014

  50. Perrone, Daniele, Favaro, Paolo: A clearer picture of total variation blind deconvolution. IEEE Trans. Pattern Anal. Mach. Intell. 38(6), 1041–1055 (2015)

    Article  MATH  Google Scholar 

  51. Dongwei Ren, Kai Zhang, Qilong Wang, Qinghua Hu, and Wangmeng Zuo. Neural blind deconvolution using deep priors. In 2020 IEEE Conference on Computer Vision and Pattern Recognition, pages 3338–3347. IEEE, 2020

  52. Jinshan Pan, Zhouchen Lin, Zhixun Su, and Ming-Hsuan Yang. Robust kernel estimation with outliers handling for image deblurring. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, pages 2800–2808. IEEE, 2016

Download references

Funding

This work was supported in part by Postgraduate Research & Practice Innovation Program of Jiangsu Province (Grant KYCX23_0960), in part by the Natural Science Foundation of China (Grant No. 61971234), and in part by the Scientific Research Foundation of NUPT (Grant No. NY223008).

Author information

Authors and Affiliations

Authors

Contributions

T.W. and T.Z. : Conceptualization, Methodology, Investigation, Formal Analysis, Supervision. S.W., C.F., H.Z. : Data Curation, Writing - Review & Editing, Visualization, Software.

Corresponding authors

Correspondence to Hao Zhang or Tieyong Zeng.

Ethics declarations

Conflict of interest

The authors have no conflict of interest to declare that is relevant to the content of this article.

Additional information

Communicated by Pablo Musé.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix A Proof of (22)

Appendix A Proof of (22)

Proof

For the problem (21a), we can split it into element-wise forms

$$\begin{aligned} \displaystyle \sum _{i}^{m}\displaystyle \sum _{j}^{n}{{\min } \, }( \nabla ^{\alpha } I{_{i,j}}^{t}-G{_{i,j}})^{2} +\frac{\mu }{{\lambda }_{1}}H( G{_{i,j}}), \end{aligned}$$
(A.1)

where \(H( G{_{i,j}})\) is a binary function returning 1 if \(G{_{i,j}}\ne 0\) and 0 otherwise. For a single element, we can establish the equation

$$\begin{aligned} \mathbb {S}{_{i,j}}=( \nabla ^{\alpha } I{_{i,j}}^{t}-G{_{i,j}})^{2} +\frac{\mu }{{\lambda }_{1}}H( G{_{i,j}}). \end{aligned}$$
(A.2)

When \((\nabla ^{\alpha }I{_{i,j}}^{t})^{2} <\mu /{\lambda }_{1} \) and \(G{_{i,j}}=0\), we have \(\mathbb {S}{_{i,j}}=(\nabla ^{\alpha }I{_{i,j}}^{t})^{2}\). Note that \(G{_{i,j}}\ne 0\), then

$$\begin{aligned} \mathbb {S}{_{i,j}}=( \nabla ^{\alpha } I{_{i,j}}^{t}-G{_{i,j}})^{2} +\frac{\mu }{{\lambda }_{1}}\ge \frac{\mu }{{\lambda }_{1}}. \end{aligned}$$
(A.3)

Therefore, we have \(\min \mathbb {S}{_{i,j}} = (\nabla ^{\alpha }{I}_{i,j}^{t})^{2}\) when \(G{_{i,j}}=0\).

When \((\nabla ^{\alpha }I{_{i,j}}^{t})^{2} \ge \mu /{\lambda }_{1} \) and \(G{_{i,j}}=0\), \(\mathbb {S}{_{i,j}}=(\nabla ^{\alpha }I{_{i,j}}^{t})^{2}\). Note that \(G{_{i,j}}\ne 0\), then

$$\begin{aligned} \mathbb {S}{_{i,j}}=( \nabla ^{\alpha } I{_{i,j}}^{t}-G{_{i,j}})^{2} +\frac{\mu }{{\lambda }_{1}}= \frac{\mu }{{\lambda }_{1}} \end{aligned}$$
(A.4)

as \(G{_{i,j}}=\nabla ^{\alpha } I{_{i,j}}^{t}\). Thus \(\min \mathbb {S}{_{i,j}} = \frac{\mu }{{\lambda }_{1}}\) when \(G{_{i,j}}=\nabla ^{\alpha } I{_{i,j}}^{t}\).

As a consequence, when

$$\begin{aligned} G{_{i,j}}=\left\{ \begin{matrix}0,& (\nabla ^{\alpha }I_{i,j}^{t})^{2} <\mu /{\lambda }_{1}, \\ \nabla ^{\alpha }I_{i,j}^{t}, & otherwise, \end{matrix}\right. \end{aligned}$$
(A.5)

\(\mathbb {S}{_{i,j}}\) has a minimum value, and then for the problem (21a), the solution can be explicitly obtained as follows:

$$\begin{aligned} G^{t+1}=\left\{ \begin{matrix}0,& (\nabla ^{\alpha }I^{t})^{2} <\mu /{\lambda }_{1}, \\ \nabla ^{\alpha }I^{t}, & otherwise. \end{matrix}\right. \end{aligned}$$
(A.6)

\(\square \)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, T., Wan, S., Feng, C. et al. Blind Image Deconvolution: When Patch-wise Minimal Pixels Prior Meets Fractional-Order Method. J Math Imaging Vis 67, 3 (2025). https://doi.org/10.1007/s10851-024-01221-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10851-024-01221-x

Keywords