Skip to main content

Better and Faster, when ADMM Meets CNN: Compressive-Sensed Image Reconstruction

  • Conference paper
  • First Online:
Advances in Multimedia Information Processing – PCM 2017 (PCM 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10735))

Included in the following conference series:

Abstract

Compressive sensing (CS) has drawn enormous amount of attention in recent years owing to its sub-Nyquist sampling rate and low-complexity requirement at the encoder. However, it turns out that the decoder in lieu of the encoder suffers from heavy computation in order to decently recover the signal from its CS measurements. Inspired by the recent success of deep learning in low-level computer vision problems, in this paper, we propose a solution that utilizes deep convolutional neural network (CNN) to recover image signals from CS measurements effectively and efficiently. Rather than training a neural network from scratch that inputs CS measurements and outputs images, we incorporate an off-the-shelf CNN model into the CS reconstruction framework even without the effort of finetuning. To this end, we formulate the CS recovery problem into two subproblems via the alternate direction method of multiplers (ADMM): a convex quadratic problem and an image denoising problem, in which CNN has exhibited its desirable reconstruction performance and low computational complexity. Hereby, powerful GPU could be utilized to speed up the reconstruction. Experiments demonstrate that our proposed CS image reconstruction solution surpasses state-of-the-art CS models by a significant margin in speed and performance.

This work is supported by National Postdoctoral Program for Innovative Talents (BX201600006), National Natural Science Foundation of China (61672063, 61370115), China 863 project (2015AA015905), which are gratefully acknowledged.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    To avoid confusion, we use the word ‘parameter’ specially for the weights and biases in the deep neural network, and use ‘argument’ instead for the factors that possibly affect the algorithm and need to be manually set.

References

  1. Donoho, D.L.: Compressed sensing. IEEE Trans. Inf. Theor. 52(4), 1289–1306 (2006)

    Article  MathSciNet  Google Scholar 

  2. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)

    Article  Google Scholar 

  3. Burger, H.C., Schuler, C.J., Harmeling, S.: Image denoising: can plain neural networks compete with BM3D? In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition, pp. 2392–2399 (2012)

    Google Scholar 

  4. Zhang, K., Zuo, W., Chen, Y., Meng, D., Zhang, L.: Beyond a Gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans. Image Process. 26, 3142–3155 (2017)

    Article  MathSciNet  Google Scholar 

  5. Li, C., Yin, W., Zhang, Y.: Users guide for TVAL3: TV minimization by augmented lagrangian and alternating direction algorithms. CAAM report (2009)

    Google Scholar 

  6. Mun, S., Fowler, J.E.: Block compressed sensing of images using directional transforms. In: IEEE International Conference on Image Processing (ICIP), pp. 3021–3024 (2009)

    Google Scholar 

  7. Zhao, C., Ma, S., Gao, W.: Image compressive-sensing recovery using structured laplacian sparsity in DCT domain and multi-hypothesis prediction. In: IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2014)

    Google Scholar 

  8. Zhao, C., Ma, S., Zhang, J., Xiong, R., Gao, W.: Video compressive sensing reconstruction via reweighted residual sparsity. IEEE Trans. Circuits Syst. Video Technol. 27, 1182–1195 (2016)

    Article  Google Scholar 

  9. Wu, X., Zhang, X., Wang, J.: Model-guided adaptive recovery of compressive sensing. In: Proceedings of IEEE Data Compression Conference, pp. 123–132 (2009)

    Google Scholar 

  10. Kim, Y., Nadar, M.S., Bilgin, A.: Compressed sensing using a Gaussian scale mixtures model in wavelet domain. In: Proceedings of IEEE International Conference on Image Processing, pp. 3365–3368 (2010)

    Google Scholar 

  11. He, L., Carin, L.: Exploiting structure in wavelet-based Bayesian compressive sensing. IEEE Trans. Signal Process. 57(9), 3488–3497 (2009)

    Article  MathSciNet  Google Scholar 

  12. Zhang, J., Zhao, D., Zhao, C., Xiong, R., Ma, S., Gao, W.: Image compressive sensing recovery via collaborative sparsity. IEEE J. Emerg. Selec. Topics Circuits Syst. 2(3), 380–391 (2012)

    Article  Google Scholar 

  13. Zhang, J., Zhao, D., Gao, W.: Group-based sparse representation for image restoration. IEEE Trans. Image Process. 23(8), 3336–3351 (2014)

    Article  MathSciNet  Google Scholar 

  14. Zhang, J., Zhao, D., Jiang, F., Gao, W.: Structural group sparse representation for image compressive sensing recovery. In: IEEE Data Compression Conference (DCC), pp. 331–340 (2013)

    Google Scholar 

  15. Zhang, J., Zhao, C., Zhao, D., Gao, W.: Image compressive sensing recovery using adaptively learned sparsifying basis via L0 minimization. Sig. Process. 103, 114–126 (2014)

    Article  Google Scholar 

  16. Chen, C., Tramel, E.W., Fowler, J.E.: Compressed-sensing recovery of images and video using multihypothesis predictions. In: Asilomar Conference on Signals, Systems and Computers, pp. 1193–1198 (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chen Zhao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhao, C., Wang, R., Gao, W. (2018). Better and Faster, when ADMM Meets CNN: Compressive-Sensed Image Reconstruction. In: Zeng, B., Huang, Q., El Saddik, A., Li, H., Jiang, S., Fan, X. (eds) Advances in Multimedia Information Processing – PCM 2017. PCM 2017. Lecture Notes in Computer Science(), vol 10735. Springer, Cham. https://doi.org/10.1007/978-3-319-77380-3_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-77380-3_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-77379-7

  • Online ISBN: 978-3-319-77380-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics