Abstract
It is well-known that shaken cameras or mobile phones during exposure usually lead to motion blurry photographs. Therefore, camera shake deblurring or motion deblurring is required and requested in many practical scenarios. The contribution of this paper is the proposal of a simple yet effective approach for motion blur kernel estimation, i.e., blind motion deblurring. Though there have been proposed several methods for motion blur kernel estimation in the literature, we impose a type of non-stationary Gaussian prior on the gradient fields of sharp images, in order to automatically detect and purse the salient edges of images as the important clues to blur kernel estimation. On one hand, the prior is able to promote sparsity inherited in the non-stationarity of the precision parameters (inverse of variances). On the other hand, since the prior is in a Gaussian form, there exists a great possibility of deducing a conceptually simple and computationally tractable inference scheme. Specifically, the well-known expectation–maximization algorithm is used to alternatingly estimate the motion blur kernels, the salient edges of images as well as the precision parameters in the image prior. In difference from many existing methods, no hyperpriors are imposed on any parameters in this paper; there are not any pre-processing steps involved in the proposed method, either, such as explicit suppression of random noise or prediction of salient edge structures. With estimated motion blur kernels, the deblurred images are finally generated using an off-the-shelf non-blind deconvolution method proposed by Krishnan and Fergus (Adv Neural Inf Process Syst 22:1033–1041, 2009). The rationality and effectiveness of our proposed method have been well demonstrated by the experimental results on both synthetic and realistic motion blurry images, showing state-of-the-art blind motion deblurring performance of the proposed approach in the term of quantitative metric as well as visual perception.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. ACM Trans. Graph 25(3), 787–794 (2006)
Shan, Q., Jia, J., Agarwala, A.: High-Quality Motion Deblurring from a Single Image. SIGGRAPH, pp. 1–10. ACM, New York (2008)
Cho, S., Lee, S.: Fast motion deblurring. ACM Trans. Graph. (SIGGRAPH ASIA 2009), 28(5), article no. 145 (2009)
Almeida, M., Almeida, L.: Blind and semi-blind deblurring of natural images. IEEE Trans. Image Process. 19, 36–52 (2010)
Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding and evaluating blind deconvolution algorithms. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1964–1971 (2009)
Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Efficient marginal likelihood optimization in blind deconvolution. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2657–2664 (2011)
Amizic, B., Molina, R., Katsaggelos, A.K.: Sparse Bayesian blind image deconvolution with parameter estimation. EURASIP J. Image Video Process. 2012(20), 1–15 (2012)
Krishnan, D., Tay, T., Fergus, R.: Blind deconvolution using a normalized sparsity measure. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 233–240 (2011)
Babacan, S.D., Molina, R., Do, M.N., Katsaggelos, A.K.: Bayesian blind deconvolution with general sparse image priors. In: Fitzgibbon A. et al. (eds.) ECCV 2012, Part VI, LNCS, vol. 7577, pp. 341–355
Miskin, J.W., MacKay, D.J.C.: Advances in Independent Component Analysis. Ensemble learning for blind image separation and deconvolution. Springer, Berlin (2000)
Xu, L., Jia, J.: Two-phase kernel estimation for robust motion deblurring. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.): ECCV 2010, Part I, LNCS, vol. 6311, pp. 157–170
Joshi, N., Szeliski, R., Kriegman, D.J.: PSF estimation using sharp edge prediction. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2008)
Joshi, N.: Enhancing photographs using content-specific image priors. PhD thesis, University of California, San Diego (2008)
Cai, J.F., Ji, H., Liu, C., Shen, Z.: Blind motion deblurring from a single image using sparse approximation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 104–111 (2009)
Vera, E., Vega, M., Molina, R., Katsaggelos A.K.: A novel iterative image restoration algorithm using nonstationary image priors. In: The 18th IEEE International Conference on Image Processing (ICIP), pp. 3457–3460 (2011)
Tzikas, D., Likas, A., Galatsanos, N.P.: Variational Bayesian sparse kernel-based blind image deconvolution with Student’s-t priors. IEEE Trans. Image Process. 18(4), 753–764 (2009)
Tipping, M.E.: Sparse Bayesian learning and the relevance vector machine. J. Mach. Learn. Res. 1, 211–244 (2001)
Huang, Y., Ng, M.K., Wen, Y.: A fast total variation minimization method for image restoration. SIAM J. Multiscale Model. Simul. 7(2), 774–795 (2008)
Shao, W.-Z., Deng, H.-S., Wei, Z.-H.: Multi-Parseval frame-based nonconvex sparse image deconvolution. Opt. Eng. 51(6), 067008-1–067008-12 (2012)
Krishnan, D., Fergus, R.: Fast image deconvolution using hyper-Laplacian priors. Adv. Neural Inf. Process. Syst. 22, 1033–1041 (2009)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error measurement to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)
Levin, A., Fergus, R., Durand, F., Freeman, W.T.: Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26(3), 1–9 (2007). Article 70
Lucy, L.: An iterative technique for the rectification of observed distributions. Astron. J. 79, 745–754 (1974)
Richardson, W.: Bayesian-based iterative method of image restoration. J. Opt. Soc. Am. 62(1), 55–59 (1972)
Fish, D.A., Brinicombe, A.M., Pike, E.R., Walker, J.G.: Blind deconvolution by means of the Richardson–Lucy algorithm. J. Opt. Soc. Am. A 12, 58–65 (1995)
Xu, L., Zheng, S., Jia, J. : Unnatural \(L_{0}\) sparse representation for natural image deblurring. In: IEEE Conference Computer Vision and Pattern Recognition (CVPR), pp. 1107–1114 (2013)
Wipf, D., Zhang, H.: Revisiting Bayesian blind deconvolution. arXiv: 1305.2362 (2013)
Dempster, A., Laird, N., Rubin, D.: Maximum likelihood from incomplete data via the EM algorithm. J. R Stat. Soc. A 39(1), 1–38 (1977)
Acknowledgments
Many thanks are given to the anonymous reviewers for their serious, pertinent and helpful comments significantly strengthening this paper. Wen-Ze Shao is grateful to Professor Michael Elad for the financial support allowing him to work at Department of Computer Science, Technion-Israel Institute of Technology, as well as Professor Yi-Zhong Ma and Dr. Min Wu for their kind supports in the past years. He would also like to show many thanks to Mr. Ya-Tao Zhang and other kind people for helping him through his lost and sad years. The work is supported in part by the National Natural Science Foundation (NSF) of China for Youth under Grant No. 61402239, the NSF of Jiangsu Province for Youth under Grant No. BK20130868, the NSF of Jiangsu Higher Education Institutions under Grant No. 13KJB510022 and 13KJB120005, and the NSF of Nanjing University of Posts and Telecommunications under Grant No. NY212014, NY213007.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Shao, WZ., Ge, Q., Deng, HS. et al. Motion Deblurring Using Non-stationary Image Modeling. J Math Imaging Vis 52, 234–248 (2015). https://doi.org/10.1007/s10851-014-0537-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-014-0537-9