Restoring Blurred Image with Capsule Network
Pages 96 - 101
Abstract
Image deblurring can effectively improve image quality and machine recognition accuracy. Existing methods use universal prior information in the data to deblur, and rarely consider image semantic prior information. In the field of deep learning, using more prior information can achieve better results. Inspired by the powerful object semantic information representation ability of the capsule network, we propose a capsule neural network based on semantic information deblurring. The blurred image and the clear image have different semantic distributions in the capsule feature space. A mapping network is used to map the blurred image capsule feature distribution to the clear image capsule feature distribution, and then input the clear image training decoder to obtain the corresponding clear image. We demonstrate that our proposed method can achieve good visual effects on the MNIST and Fashion-MNIST data sets, the PSNR and SSIM evaluation indicators are better than the classic deblurring methods.
References
[1]
X. Tao, H. Gao, X. Shen, J. Wang, and J. Jia, “Scale-recurrent network for deep image deblurring,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 8174–8182.
[2]
J. Cai, W. Zuo, and L. Zhang, “Dark and bright channel prior embedded network for dynamic scene deblurring,” IEEE Transactions on Image Processing, vol. 29, pp. 6885–6897, 2020.
[3]
J. Sun, Wenfei Cao, Zongben Xu, and J. Ponce, “Learning a convolutional neural network for non-uniform motion blur removal,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 769–777.
[4]
A. Chakrabarti, “A neural approach to blind motion deblurring,” in European Conference on Computer Vision, 2016.
[5]
D. Gong, J. Yang, L. Liu, Y. Zhang, I. Reid, C. Shen, A. Van Den Hengel, and Q. Shi, “From motion blur to motion flow: A deep learning solution for removing heterogeneous motion blur,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 3806–3815.
[6]
C. J. Schuler, M. Hirsch, S. Harmeling, and B. Schölkopf, “Learning to deblur,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 7, pp. 1439–1451, 2016.
[7]
O. Kupyn, V. Budzan, M. Mykhailych, D. Mishkin, and J. Matas, “Deblurgan: Blind motion deblurring using conditional adversarial networks,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 8183– 8192.
[8]
S. Ramakrishnan, S. Pachori, A. Gangopadhyay, and S. Raman, “Deep generative filter for motion deblurring,” in 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), 2017, pp. 2993–3000.
[9]
S. Nah, T. H. Kim, and K. M. Lee, “Deep multi-scale convolutional neural network for dynamic scene deblurring,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 257–265.
[10]
S. Sabour, N. Frosst, and G. E. Hinton, “Dynamic routing between capsules,” in Advances in Neural Information Processing Systems, vol. 30, 2017, pp. 3856–3866.
[11]
F. Chen, R. Ji, C. Dai, X. Sun, C. Lin, J. Ji, B. Zhang, F. Huang, and L. Cao, “Semantic-aware image deblurring,” CoRR, vol. abs/1910.03853, 2019. [Online]. Available: http://arxiv.org/abs/1910.03853
[12]
G. Hinton, A. Krizhevsky, and S. Wang, “Transforming autoencoders,” vol. 6791, 06 2011, pp. 44–51.
[13]
G. Hinton, S. Sabour, and N. Frosst, “Matrix capsules with em routing,” 2018. [Online]. Available: https://openreview.net/pdf?id=HJWLfGWRb
[14]
Marzieh Edraki, Nazanin Rahnavard, Mubarak Shah, “Subspace capsule network,” in Proceedings of the AAAI Conference on Artificial Intelligence, 202020, pp. 10 745–10 753.
[15]
L. Zhang, M. Edraki, and G.-J. Qi, “Cappronet: Deep feature learning via orthogonal projections onto capsule subspaces,” in Advances in Neural Information Processing Systems, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, Eds., vol. 31. Curran Associates, Inc., 2018, pp. 5814–5823.
[16]
S. Anwar, C. P. Huynh and F. Porikli, "Image Deblurring with a Class-Specific Prior," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 41, no. 9, 1 Sept. 2019, pp. 2112-2130.
[17]
S. Anwar, C. P. Huynh and F. Porikli, "Class-Specific Image Deblurring," 2015 IEEE International Conference on Computer Vision (ICCV), 2015, pp. 495-503.
Index Terms
- Restoring Blurred Image with Capsule Network
Index terms have been assigned to the content through auto-classification.
Recommendations
Two motion-blurred images are better than one
Special issue: In memoriam Azriel RosenfeldMotion blur is a smearing of the image due to a long aperture time. We show that when two motion-blurred images are available, having different blur directions, image restoration can be improved substantially. In particular, the direction of the motion ...
Deep non-blind deblurring network for saturated blurry images
AbstractNon-blind image deblurring has attracted a lot of attention in the field of low-level vision. However, the existing non-blind deblurring methods cannot effectively deal with a saturated blurry image. The key point is that the degradation model of ...
Spatially variant defocus blur map estimation and deblurring from a single image
A blur map estimation method using edge information is proposed.The blur map is segmented into multiple superpixels according to the image contours.Ringing artifacts and noise are detected and removed after deconvolution. In this paper, we propose a ...
Comments
Information & Contributors
Information
Published In
September 2021
715 pages
ISBN:9781450384087
DOI:10.1145/3488933
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 25 February 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
AIPR 2021
AIPR 2021: 2021 4th International Conference on Artificial Intelligence and Pattern Recognition
September 24 - 26, 2021
Xiamen, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 48Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format