Abstract
Compressive sensing (CS) has drawn enormous amount of attention in recent years owing to its sub-Nyquist sampling rate and low-complexity requirement at the encoder. However, it turns out that the decoder in lieu of the encoder suffers from heavy computation in order to decently recover the signal from its CS measurements. Inspired by the recent success of deep learning in low-level computer vision problems, in this paper, we propose a solution that utilizes deep convolutional neural network (CNN) to recover image signals from CS measurements effectively and efficiently. Rather than training a neural network from scratch that inputs CS measurements and outputs images, we incorporate an off-the-shelf CNN model into the CS reconstruction framework even without the effort of finetuning. To this end, we formulate the CS recovery problem into two subproblems via the alternate direction method of multiplers (ADMM): a convex quadratic problem and an image denoising problem, in which CNN has exhibited its desirable reconstruction performance and low computational complexity. Hereby, powerful GPU could be utilized to speed up the reconstruction. Experiments demonstrate that our proposed CS image reconstruction solution surpasses state-of-the-art CS models by a significant margin in speed and performance.
This work is supported by National Postdoctoral Program for Innovative Talents (BX201600006), National Natural Science Foundation of China (61672063, 61370115), China 863 project (2015AA015905), which are gratefully acknowledged.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
To avoid confusion, we use the word ‘parameter’ specially for the weights and biases in the deep neural network, and use ‘argument’ instead for the factors that possibly affect the algorithm and need to be manually set.
References
Donoho, D.L.: Compressed sensing. IEEE Trans. Inf. Theor. 52(4), 1289–1306 (2006)
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)
Burger, H.C., Schuler, C.J., Harmeling, S.: Image denoising: can plain neural networks compete with BM3D? In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition, pp. 2392–2399 (2012)
Zhang, K., Zuo, W., Chen, Y., Meng, D., Zhang, L.: Beyond a Gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans. Image Process. 26, 3142–3155 (2017)
Li, C., Yin, W., Zhang, Y.: Users guide for TVAL3: TV minimization by augmented lagrangian and alternating direction algorithms. CAAM report (2009)
Mun, S., Fowler, J.E.: Block compressed sensing of images using directional transforms. In: IEEE International Conference on Image Processing (ICIP), pp. 3021–3024 (2009)
Zhao, C., Ma, S., Gao, W.: Image compressive-sensing recovery using structured laplacian sparsity in DCT domain and multi-hypothesis prediction. In: IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2014)
Zhao, C., Ma, S., Zhang, J., Xiong, R., Gao, W.: Video compressive sensing reconstruction via reweighted residual sparsity. IEEE Trans. Circuits Syst. Video Technol. 27, 1182–1195 (2016)
Wu, X., Zhang, X., Wang, J.: Model-guided adaptive recovery of compressive sensing. In: Proceedings of IEEE Data Compression Conference, pp. 123–132 (2009)
Kim, Y., Nadar, M.S., Bilgin, A.: Compressed sensing using a Gaussian scale mixtures model in wavelet domain. In: Proceedings of IEEE International Conference on Image Processing, pp. 3365–3368 (2010)
He, L., Carin, L.: Exploiting structure in wavelet-based Bayesian compressive sensing. IEEE Trans. Signal Process. 57(9), 3488–3497 (2009)
Zhang, J., Zhao, D., Zhao, C., Xiong, R., Ma, S., Gao, W.: Image compressive sensing recovery via collaborative sparsity. IEEE J. Emerg. Selec. Topics Circuits Syst. 2(3), 380–391 (2012)
Zhang, J., Zhao, D., Gao, W.: Group-based sparse representation for image restoration. IEEE Trans. Image Process. 23(8), 3336–3351 (2014)
Zhang, J., Zhao, D., Jiang, F., Gao, W.: Structural group sparse representation for image compressive sensing recovery. In: IEEE Data Compression Conference (DCC), pp. 331–340 (2013)
Zhang, J., Zhao, C., Zhao, D., Gao, W.: Image compressive sensing recovery using adaptively learned sparsifying basis via L0 minimization. Sig. Process. 103, 114–126 (2014)
Chen, C., Tramel, E.W., Fowler, J.E.: Compressed-sensing recovery of images and video using multihypothesis predictions. In: Asilomar Conference on Signals, Systems and Computers, pp. 1193–1198 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Zhao, C., Wang, R., Gao, W. (2018). Better and Faster, when ADMM Meets CNN: Compressive-Sensed Image Reconstruction. In: Zeng, B., Huang, Q., El Saddik, A., Li, H., Jiang, S., Fan, X. (eds) Advances in Multimedia Information Processing – PCM 2017. PCM 2017. Lecture Notes in Computer Science(), vol 10735. Springer, Cham. https://doi.org/10.1007/978-3-319-77380-3_35
Download citation
DOI: https://doi.org/10.1007/978-3-319-77380-3_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-77379-7
Online ISBN: 978-3-319-77380-3
eBook Packages: Computer ScienceComputer Science (R0)