Abstract
Nowadays, people are more and more used to taking pictures with handheld devices. However, the photos taken by handheld devices are easy to blur. Recent state-of-the-art methods for image deblurring often restore image through multiple stages, which leads to excessive network parameters and slow running speed, and makes it difficult to apply to mobile devices. While one-stage image deblurring methods have fewer parameters and faster running speed, the performance of their models is not so satisfactory. To solve these problems, we propose a lightweight one-stage image deblurring network called Global Cognition and Local Perception Network (GCLPN) in this paper. We design the Global Cognition Module (GCM) to obtain global feature descriptors and present the Local Perception Module (LPM) to help image reconstruction in local regions. Furthermore, we introduce a gradient loss that focuses on subtle image texture information during network training. Experimental results illustrate that our GCLPN surpasses the state-of-the-art methods in standard metrics of PSNR and SSIM with the least number of parameters (about 1.7M) and real-time running speed (about 0.37 s per \(720 \times 1280\) image).
This work was supported by Fudan University-CIOMP Joint Fund (FC2019-005), National Key R&D Program of China (2019YFC1711800).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Aljadaany, R., Pal, D.K., Savvides, M.: Douglas-Rachford networks: learning both the image prior and data fidelity terms for blind image deconvolution. In: IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2019, Long Beach, CA, USA, 16–20 June 2019 (2019). https://doi.org/10.1109/CVPR.2019.01048
Chakrabarti, A.: A neural approach to blind motion deblurring. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9907, pp. 221–235. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46487-9_14
Dai, J., et al.: Deformable convolutional networks. In: IEEE International Conference on Computer Vision. ICCV 2017, Venice, Italy, 22–29 October 2017 (2017). https://doi.org/10.1109/ICCV.2017.89
Gao, H., Tao, X., Shen, X., Jia, J.: Dynamic scene deblurring with parameter selective sharing and nested skip connections. In: IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2019, Long Beach, CA, USA, 16–20 June 2019 (2019). https://doi.org/10.1109/CVPR.2019.00397
Gong, D., et al.: From motion blur to motion flow: a deep learning solution for removing heterogeneous motion blur. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2017, Honolulu, HI, USA, 21–26 July 2017 (2017). https://doi.org/10.1109/CVPR.2017.405
Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: 2018 IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2018, Salt Lake City, UT, USA, 18–22 June 2018 (2018). https://doi.org/10.1109/CVPR.2018.00745
Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 694–711. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46475-6_43
Kim, T.H., Lee, K.M.: Segmentation-free dynamic scene deblurring. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2014, Columbus, OH, USA, 23–28 June 2014 (2014). https://doi.org/10.1109/CVPR.2014.348
Kupyn, O., Budzan, V., Mykhailych, M., Mishkin, D., Matas, J.: DeblurGAN: blind motion deblurring using conditional adversarial networks. In: 2018 IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2018, Salt Lake City, UT, USA, 18–22 June 2018 (2018). https://doi.org/10.1109/CVPR.2018.00854
Kupyn, O., Martyniuk, T., Wu, J., Wang, Z.: DeblurGAN-v2: deblurring (orders-of-magnitude) faster and better. In: 2019 IEEE/CVF International Conference on Computer Vision. ICCV 2019, Seoul, Korea (South), 27 October–2 November 2019 (2019). https://doi.org/10.1109/ICCV.2019.00897
Nah, S., Kim, T.H., Lee, K.M.: Deep multi-scale convolutional neural network for dynamic scene deblurring. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2017, Honolulu, HI, USA, 21–26 July 2017 (2017). https://doi.org/10.1109/CVPR.2017.35
Ramakrishnan, S., Pachori, S., Gangopadhyay, A., Raman, S.: Deep generative filter for motion deblurring. In: 2017 IEEE International Conference on Computer Vision Workshops. ICCV Workshops 2017, Venice, Italy, 22–29 October 2017 (2017). https://doi.org/10.1109/ICCVW.2017.353
Sun, J., Cao, W., Xu, Z., Ponce, J.: Learning a convolutional neural network for non-uniform motion blur removal. In: IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2015, Boston, MA, USA, 7–12 June 2015 (2015). https://doi.org/10.1109/CVPR.2015.7298677
Tao, X., Gao, H., Shen, X., Wang, J., Jia, J.: Scale-recurrent network for deep image deblurring. In: 2018 IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2018, Salt Lake City, UT, USA, 18–22 June 2018 (2018). https://doi.org/10.1109/CVPR.2018.00853
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, Long Beach, CA, USA, 4–9 December 2017 (2017)
Wang, X., Girshick, R.B., Gupta, A., He, K.: Non-local neural networks. In: 2018 IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2018, Salt Lake City, UT, USA, 18–22 June 2018 (2018). https://doi.org/10.1109/CVPR.2018.00813
Zhang, H., Dai, Y., Li, H., Koniusz, P.: Deep stacked hierarchical multi-patch network for image deblurring. In: IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2019, Long Beach, CA, USA, 16–20 June 2019 (2019). https://doi.org/10.1109/CVPR.2019.00613
Zhang, J., et al.: Dynamic scene deblurring using spatially variant recurrent neural networks. In: 2018 IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2018, Salt Lake City, UT, USA, 18–22 June 2018 (2018). https://doi.org/10.1109/CVPR.2018.00267
Zhu, X., Hu, H., Lin, S., Dai, J.: Deformable convnets V2: more deformable, better results. In: IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2019, Long Beach, CA, USA, 16–20 June 2019 (2019). https://doi.org/10.1109/CVPR.2019.00953
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, C., Zhang, W., Chen, F., Cheng, Y., Gao, S., Zhang, W. (2021). Global Cognition and Local Perception Network for Blind Image Deblurring. In: Lokoč, J., et al. MultiMedia Modeling. MMM 2021. Lecture Notes in Computer Science(), vol 12572. Springer, Cham. https://doi.org/10.1007/978-3-030-67832-6_25
Download citation
DOI: https://doi.org/10.1007/978-3-030-67832-6_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-67831-9
Online ISBN: 978-3-030-67832-6
eBook Packages: Computer ScienceComputer Science (R0)