skip to main content
10.1145/2093698.2093803acmotherconferencesArticle/Chapter ViewAbstractPublication PagesisabelConference Proceedingsconference-collections
research-article

Efficient minimization for dictionary based sparse representation and signal recovery

Published: 26 October 2011 Publication History

Abstract

This paper provides an efficient minimization algorithm for dictionary based sparse representation and its application in some signal recovery problems. Dictionary has shown great potential in effectively representing various kinds of signals sparsely. However the computational cost associated with dictionary based sparse representation can be tremendous, especially when the representation problem is coupled with the complex encoding processes of the signals. The proposed algorithm tackles this problem by alternating direction minimizations with the use of Barzilai-Borwein's optimal step size selection technique to significantly improve the convergence speed. Numerical experiments demonstrate the high efficiency of the proposed algorithm over traditional optimization methods.

References

[1]
M. Aharon, M. Elad, and A. Bruckstein. The K-SVD: An algorithm for designing of overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process., 54(11):4311--4322, 2006.
[2]
J. Barzilai and J. M. Borwein. Two point step size gradient methods. IMA J. Numer. Anal., 8:141--148, 1988.
[3]
A. Beck and M. Teboulle. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2(1):183--202, 2009.
[4]
S. Becker, J. Bobin, and E. J. Candès. NESTA: a fast and accurate first-order method for sparse recovery. Technical report, Applied and Computational Mathematics, Caltech, Pasadena, CA, April 2009.
[5]
J. Bioucas-Dias and M. Figueiredo. A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration. IEEE Trans. Image Process., 16(12):2992--3004, 2007.
[6]
A. M. Bruckstein, D. L. Donoho, and M. Elad. From sparse solutions of systems of equations to sparse modeling of signals and images. SIAM Review, 51(1):34--81, 2009.
[7]
E. J. Candes, J. K. Romberg, and T. Tao. Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inf. Theory, 52(2):489--509, 2006.
[8]
A. Chambolle, R. A. DeVore, N. Y. Lee, and B. J. Lucier. Nonlinear wavelet image processing: Variational problems, compression, and noise removal through wavelet shrinkage. IEEE Trans. Image Process., 7:319--335, 1998.
[9]
Y. Chen, X. Ye, and F. Huang. A novel method and fast algorithm for mr image reconstruction with significantly under-sampled data. Inverse Probl. Imag., 4(2):223--240, 2010.
[10]
D. Donoho, M. Elad, and V. Temlyakov. Stable recovery of sparse overcomplete represenation in the presence of noise. IEEE Trans. Inf. Theory, 52:6--18, 2006.
[11]
D. L. Donoho. Compressed sensing. IEEE Trans. Inf. Theory, 59(7):907--934, 2006.
[12]
M. Elad. Why simple shrinkage is still relevant for redundant representations? IEEE Trans. Inf. Theory, 52(12):5559--5569, 2006.
[13]
M. Elad and M. Aharon. Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Process., 15(12):3736--3745, 2006.
[14]
M. Figueiredo and R. Nowak. An EM algorithm for wavelet-based image restoration. IEEE Trans. Image Process., 12(8):906--916, 2003.
[15]
M. Figueiredo, R. Nowak, and S. Wright. Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems. IEEE J. Sel. Top. Sign. Proces., 1(4):586--598, 2007.
[16]
S. Kim, K. Koh, M. Lustig, and S. Boyd. An efficient method for compressed sensing. IEEE Proc. Intl. Conf. on Image Process., 3:117--120, 2007.
[17]
K. Kreutz-Delgado, J. F. Murray, B. D. Rao, K. Engan, T. Lee, and T. J. Sejnowski. Dictionary learning algorithms for sparse representation. Neural Comp., 15:349--396, 2003.
[18]
K. Kreutz-Delgado and B. D. Rao. FOCUSS-based dictionary learning algorithms. Wavelet Applications in Signal and Image Process. VIII, 4119:459--473, 2000.
[19]
M. Liu, L. Lu, X. Ye, and S. Yu. Coarse-to-fine classification using parametric and nonparametric models for computer-aided diagnosis. In Proceedings of ACM Conference on Information and Knowledge Management (CIKM), 2011.
[20]
M. Liu, L. Lu, X. Ye, S. Yu, and M. Salganicoff. Sparse classification for computer aided diagnosis using learned dictionaries. In International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2011.
[21]
Y. Nesterov. Gradient methods for minimizing composite objective function. CORE Discussion Papers 2007/76, UniversitÃl' catholique de Louvain, Center for Operations Research and Econometrics (CORE), Sept. 2007.
[22]
S. Ravishankar and Y. Bresler. Mr image reconstruction from highly undersampled k-space data by dictionary learning. IEEE Trans. Med. Imaging, 30(5):1028--1041, 2011.
[23]
J. Starck, M. Elad, and D. Donoho. Image decomposition via the combination of sparse representations and a variational approach. IEEE Trans. Image Process., 14:1570--1582, 2005.
[24]
J. A. Tropp and A. C. Gilbert. Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans. Inf. Theory, 53(12):4655--4666, 2007.
[25]
S. J. Wright, R. D. Nowak, and M. Figueiredo. Sparse reconstruction by separable approximation. IEEE Trans. Signal Process., 57(7):2479--2493, 2009.
[26]
X. Ye, Y. Chen, and F. Huang. MR image reconstruction via sparse representation: Modeling and algorithm. International Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV), pages 10--16, 2009.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ISABEL '11: Proceedings of the 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies
October 2011
949 pages
ISBN:9781450309134
DOI:10.1145/2093698
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • Universitat Pompeu Fabra
  • IEEE
  • Technical University of Catalonia Spain: Technical University of Catalonia (UPC), Spain
  • River Publishers: River Publishers
  • CTTC: Technological Center for Telecommunications of Catalonia
  • CTIF: Kyranova Ltd, Center for TeleInFrastruktur

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2011

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Conference

ISABEL '11
Sponsor:
  • Technical University of Catalonia Spain
  • River Publishers
  • CTTC
  • CTIF

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 91
    Total Downloads
  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 10 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media