Abstract
Blind image deconvolution is a challenging issue in image processing. In blind image deconvolution, the typical approach involves iteratively estimating both the blur kernel and latent image until convergence to the blur kernel of the observed image is achieved. Recently, several approaches have been attempted to develop a sophisticated regularization to obtain the clean image. However, existing methods often struggle to effectively handle ringing artifacts and local blur. To overcome these limitations, we introduce a fractional-order variational model. This model alleviates the ringing artifacts through the selection of an optimal derivative. Subsequently, to refine the latent image further, we leverage the local prior, namely patch-wise minimal pixels (PMP) prior. Since the PMP prior of clean images blocks is much sparser than that of blurred ones, it is capable of discriminating between clean and blurred image blocks. We illustrate the effective integration of the fractional-order operations and the PMP prior within our proposed approach. Moreover, the convergence of our algorithm has been proved as the values of the objective function monotonically decrease. Extensive experiments on different datasets demonstrate the superiority of the proposed method compared with other methods in terms of reconstruction quality for blind deconvolution.















Similar content being viewed by others
Data Availability
Enquiries about data availability should be directed to the authors.
References
Cho, Sunghyun, Lee, Seungyong: Fast motion deblurring. In Acm Siggraph Asia, pages 1–8. ACM, (2009)
XiaoYuan, Yu., Xie, Wei: Single image blind deblurring based on salient edge-structures and elastic-net regularization. J. Math. Imaging Vis. 62(8), 1049–1061 (2020)
Pan, Jinshan, Sun, Deqing, Pfister, Hanspeter, Yang, Ming-Hsuan: Blind image deblurring using dark channel prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
Xu, Li, Jia, Jiaya: Two-phase kernel estimation for robust motion deblurring. In Computer Vision–ECCV 2010: 11th European Conference on Computer Vision, pages 157–170. Springer, (2010)
Whyte, Oliver, Sivic, Josef, Zisserman, Andrew: Deblurring shaken and partially saturated images. Int. J. Comput. Vis. 110, 185–201 (2014)
Chang, Chia-Feng., Jiunn-Lin, Wu., Chen, Kuan-Jen.: A hybrid motion deblurring strategy using patch based edge restoration and bilateral filter. J. Math. Imaging Vis. 60, 1081–1094 (2018)
Li, Bo., Xie, Wei: Adaptive fractional differential approach and its application to medical image enhancement. Comput. Electr. Eng. 45, 324–335 (2015)
Köhler, Rolf, Hirsch, Michael, Mohler, Betty, Schölkopf, Bernhard, Harmeling, Stefan: Recording and Playback of Camera Shake: Benchmarking Blind Deconvolution with a Real-World Database. Springer, Berlin (2012)
Creswell, Antonia, White, Tom, Dumoulin, Vincent, Arulkumaran, Kai, Sengupta, Biswa, Bharath, Anil A.: Generative adversarial networks: an overview. IEEE Signal Process. Mag. 35(1), 53–65 (2018)
Lai, Weisheng, Huang, Jiabin, Hu, Zhe, Ahuja, Narendra, Yang, Minghsuan.: A comparative study for single image blind deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1701–1709. IEEE, (2016)
Li, Xiaopan, Shiqian, Wu., Xie, Shoulie, Agaian, Sos: Dynamic-clustering extreme intensity prior based blind image deblurring. J. Math. Imaging Vis. 66(1), 22–36 (2024)
Chen, Liang, Fang, Faming, Wang, Tingting, Zhang, Guixu: Blind image deblurring with local maximum gradient prior. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1742–1750. IEEE, (2019)
Hu, Zhe, Cho, Sunghyun, Wang, Jue, Yang, Ming-Hsuan.: Deblurring low-light images with light streaks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3382–3389. IEEE, (2014)
Sun, Libin, Cho, Sunghyun, Wang, Jue, Hays, James.: Edge-based blur kernel estimation using patch priors. In IEEE international conference on computational photography pages 1–8. IEEE, 859(2013)
Pan, Jinshan, Hu, Zhe, Su, Zhixun, Yang, Ming-Hsuan: Deblurring face images with exemplars. In Computer vision–ECCV 2014: 13th European conference, pages 47–62. Springer, (2014)
Rob Fergus, Barun Singh, Aaron Hertzmann, Sam T Roweis, and William T Freeman. Removing camera shake from a single photograph. In ACM Siggraph 2006 Papers, pages 787–794. ACM, 2006
Anat Levin, Yair Weiss, Fredo Durand, and William T Freeman. Understanding and evaluating blind deconvolution algorithms. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1964–1971. IEEE, 2009
Li Xu, Shicheng Zheng, and Jiaya Jia. Unnatural l0 sparse representation for natural image deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 8741107–1114. IEEE, 2013
Wen, Fei, Ying, Rendong, Liu, Yipeng, Liu, Peilin, Truong, Trieu-Kien.: A simple local minimal intensity prior and an improved algorithm for blind image deblurring. IEEE Trans. Circuits Syst. Video Technol. 31(8), 2923–2937 (2021)
Shao, Wenze: Revisiting the regularizers in blind image deblurring with a new one. IEEE Trans. Image Process. 32(8), 3994–4009 (2023)
Xiaoyuan, Yu., Xie, Wei, Jinwei, Yu.: A single image deblurring approach based on a fractional order dark channel prior. Int. J. Ap. Mat. Com. Pol. 32(3), 441–454 (2022)
Liu, Jing, Tan, Jieqing, Ge, Xianyu, Dandan, Hu., He, Lei: Blind deblurring with fractional-order calculus and local minimal pixel prior. J. Vis. Commun. Image R. 89(2), 103–115 (2022)
Lyu, Chengyao, Zhao, Xile, Li, Benzheng, Zhang, Hao, Huang, Tingzhu: Multi-dimensional image recovery via fully-connected tensor network decomposition under the learnable transforms. J. Sci. Comput. 93, 49 (2022)
Liu, Yunan, Wang, Chunpeng, Mingyu, Lu., Yang, Jian, Gui, Jie, Zhang, Shanshan: From simple to complex scenes: learning robust feature representations for accurate human parsing. IEEE T. Pattern Anal. 46(8), 5449–5462 (2024)
Mao, Yuxin, Wan, Zhexiong, Dai, Yuchao, Xin, Yu.: Deep idempotent network for efficient single image blind deblurring. IEEE T. Circ. Syst. Vid. 33(1), 172–185 (2022)
Kaufman, Adam, Fattal, Raanan: Deblurring using analysis-synthesis networks pair. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 5811–5820. 901IEEE, (2020)
Carbajal, Guillermo, Vitoria, Patricia, Lezama, José, Musé, Pablo: Blind motion deblurring with pixel-wise kernel estimation via kernel prediction networks. IEEE Trans. Comput. Imaging 9, 928–943 (2023)
Wei, Zhihao, Zhang, Bo., Jiang, Yanwei: Analysis and modeling of fractional-order buck converter based on riemann-liouville derivative. IEEE Access 7, 162768–162777 (2019)
Caputo, Michele: Mean fractional-order-derivatives differential equations and filters. Ann. Univ. Ferrara. 41(1), 73–84 (1995)
Zhang, Jianping, Chen, Ke.: A total fractional-order variation model for image restoration with nonhomogeneous boundary conditions and its numerical solution. SIAM J. Imag. Sci. 8(4), 2487–2518 (2015)
Wang, Xiangyang, Deng, Maoying, Niu, Panpan, Yang, Hongying: Qfpjfms: quaternion fractional-order pseudo-jacobi-fourier moments. J. Math. Imaging Vis. 66(2), 93–114 (2024)
Kumar, Ahlad , Ahmad, M. Omair, Swamy, M. N. S.: Image denoising based on fractional gradient vector flow and overlapping group sparsity as priors. IEEE Trans. Image Process., 30(6):7527–7540, (2021)
Jin, Bangti: Fractional differential equations: an approach via fractional derivatives. Applied Mathematical Sciences, (2022)
Podlubny, Igor, Chechkin, Aleksei, Skovranek, Tomas, Chen, YangQuan, Jara, Blas M Vinagre. Matrix approach to discrete fractional calculus ii: partial fractional differential equations. J. Comput. Phys., 228(8):3137–3153, (2009)
Wang, Hong, Ning, Du.: Fast solution methods for space-fractional diffusion equations. J. Comput. Appl. Math. 255, 376–383 (2014)
Zhihao, Gu., Li, Fang, Fang, Faming, Zhang, Guixu: A novel retinex-based fractional-order variational model for images with severely low light. IEEE Trans. Image Process. 29, 3239–3253 (2020)
Wei-Sheng Lai, Jian-Jiun Ding, Yen-Yu Lin, and Yung-Yu Chuang. Blur kernel estimation using normalized color-line priors. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 64–72. IEEE, 2015
Liang Chen, Jiawei Zhang, Songnan Lin, Faming Fang, and Jimmy S Ren. Blind deblurring for saturated images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 6308–6316. IEEE, 2021
Phong Tran, Anh Tuan Tran, Quynh Phung, and Minh Hoai. Explore image deblurring via encoded blur kernel space. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 11956–11965. IEEE, 2021
Zhenhua, Xu., Chen, Huasong, Li, Zhenhua: Fast blind deconvolution using a deeper sparse patch-wise maximum gradient prior. Signal Process. Image Commun. 90, 116050 (2021)
Jinshan Pan, Zhe Hu, Zhixun Su, and Ming-Hsuan Yang. Deblurring text images via l0-regularized intensity and gradient prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2901–2908. IEEE, 2014
Meina Zhang, Yingying Fang, Guoxi Ni, and Tieyong Zeng. Pixel screening based intermediate correction for blind deblurring. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 5892–5900. IEEE, 2022
Beck, Amir: First-order methods in optimization. Society for Industrial and Applied Mathematics, Philadelphia (2017)
Dilip Krishnan, Terence Tay, and Rob Fergus. Blind deconvolution using a normalized sparsity measure. In CVPR 2011, pages 233–240. IEEE, 2011
Zhou Wang, A.C., Bovik, H.R. Sheikh., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process 13, 600–612 (2004)
Sidi Yang, Tianhe Wu, Shuwei Shi, Shanshan Lao, Yuan Gong, Mingdeng Cao, Jiahao Wang, and Yujiu Yang. Maniqa: Multi-dimension attention network for no-reference image quality assessment. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pages 1191–1200. IEEE, June 2022
Levin, Anat, Weiss, Yair, Durand, Fredo, Freeman, William T.: Understanding blind deconvolution algorithms. IEEE Trans. Pattern Anal. Mach. Intell 33, 2354–2367 (2011)
Haichao Zhang, David Wipf, and Yanning Zhang. Multi-image blind deblurring using a coupled adaptive sparse prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1051–1058. IEEE, 2013
Tomer Michaeli and Michal Irani. Blind deblurring using internal patch recurrence. In Computer Vision–ECCV 2014: 13th European Conference, pages 783–798. Springer, 2014
Perrone, Daniele, Favaro, Paolo: A clearer picture of total variation blind deconvolution. IEEE Trans. Pattern Anal. Mach. Intell. 38(6), 1041–1055 (2015)
Dongwei Ren, Kai Zhang, Qilong Wang, Qinghua Hu, and Wangmeng Zuo. Neural blind deconvolution using deep priors. In 2020 IEEE Conference on Computer Vision and Pattern Recognition, pages 3338–3347. IEEE, 2020
Jinshan Pan, Zhouchen Lin, Zhixun Su, and Ming-Hsuan Yang. Robust kernel estimation with outliers handling for image deblurring. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, pages 2800–2808. IEEE, 2016
Funding
This work was supported in part by Postgraduate Research & Practice Innovation Program of Jiangsu Province (Grant KYCX23_0960), in part by the Natural Science Foundation of China (Grant No. 61971234), and in part by the Scientific Research Foundation of NUPT (Grant No. NY223008).
Author information
Authors and Affiliations
Contributions
T.W. and T.Z. : Conceptualization, Methodology, Investigation, Formal Analysis, Supervision. S.W., C.F., H.Z. : Data Curation, Writing - Review & Editing, Visualization, Software.
Corresponding authors
Ethics declarations
Conflict of interest
The authors have no conflict of interest to declare that is relevant to the content of this article.
Additional information
Communicated by Pablo Musé.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A Proof of (22)
Appendix A Proof of (22)
Proof
For the problem (21a), we can split it into element-wise forms
where \(H( G{_{i,j}})\) is a binary function returning 1 if \(G{_{i,j}}\ne 0\) and 0 otherwise. For a single element, we can establish the equation
When \((\nabla ^{\alpha }I{_{i,j}}^{t})^{2} <\mu /{\lambda }_{1} \) and \(G{_{i,j}}=0\), we have \(\mathbb {S}{_{i,j}}=(\nabla ^{\alpha }I{_{i,j}}^{t})^{2}\). Note that \(G{_{i,j}}\ne 0\), then
Therefore, we have \(\min \mathbb {S}{_{i,j}} = (\nabla ^{\alpha }{I}_{i,j}^{t})^{2}\) when \(G{_{i,j}}=0\).
When \((\nabla ^{\alpha }I{_{i,j}}^{t})^{2} \ge \mu /{\lambda }_{1} \) and \(G{_{i,j}}=0\), \(\mathbb {S}{_{i,j}}=(\nabla ^{\alpha }I{_{i,j}}^{t})^{2}\). Note that \(G{_{i,j}}\ne 0\), then
as \(G{_{i,j}}=\nabla ^{\alpha } I{_{i,j}}^{t}\). Thus \(\min \mathbb {S}{_{i,j}} = \frac{\mu }{{\lambda }_{1}}\) when \(G{_{i,j}}=\nabla ^{\alpha } I{_{i,j}}^{t}\).
As a consequence, when
\(\mathbb {S}{_{i,j}}\) has a minimum value, and then for the problem (21a), the solution can be explicitly obtained as follows:
\(\square \)
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wu, T., Wan, S., Feng, C. et al. Blind Image Deconvolution: When Patch-wise Minimal Pixels Prior Meets Fractional-Order Method. J Math Imaging Vis 67, 3 (2025). https://doi.org/10.1007/s10851-024-01221-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10851-024-01221-x