Skip to main content
SpringerLink
Log in

Nonconvex plus quadratic penalized low-rank and sparse decomposition for noisy image alignment

针对含噪图像对准问题的非凸加二次罚项约束的低秩和稀疏分解方法

  • Research Paper
  • Published:
Science China Information Sciences Aims and scope Submit manuscript

Abstract

This paper proposes a general method for dealing with the problem of recovering the low-rank structure, in which the data can be deformed by some unknown transformations and corrupted by sparse or nonsparse noises. Nonconvex penalization method is used to remedy the drawbacks of existing convex penalization method and a quadratic penalty is further used to better tackle the nonsparse noises in the data. We exploits the local linear approximation (LLA) method for turning the resulting nonconvex penalization problem into a series of weighted convex penalization problems and these subproblems are efficiently solved via the augmented Lagrange multiplier (ALM). Besides comparing with the method of robust alignment by sparse and low-rank decomposition for linearly correlated images (RASL), we also propose a nonconvex penalized lowrank and sparse decomposition (NLSD) model as comparison. Numerical experiments are conducted on both controlled and uncontrolled data to demonstrate the outperformance of the proposed method over RASL and NLSD.

摘要

创新点

本工作的主要创新之处可以概括为以下三点:

  1. (1)

    针对采用 L1 范数进行凸优化时带来的较大偏差问题, 本文提出采用非凸优化的方式来减小偏差并获得了较好的对准效果。

  2. (2)

    实际应用中的数据存在稀疏噪声的同时也经常存在一些非稀疏噪声, 本文提出增加一项二次惩罚函数来对非稀疏噪声部分进行估计。

  3. (3)

    本文提出了一种 LLA-ALM 算法, 来求解一系列非凸优化子问题的局部最优解。

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Eckart C, Young G. The approximation of one matrix by another of lower rank. Psychometrika, 1936, 1: 211–218

    Article  MATH  Google Scholar 

  2. Jolliffe I. Principal Component Analysis. Berlin: Springer-Verlag, 1986

    Book  MATH  Google Scholar 

  3. Candès E J, Li X D, Ma Y, et al. Robust principal component analysis? J ACM, 2011, 58: 1–37

    Article  MathSciNet  MATH  Google Scholar 

  4. Huang G B, Jain V, Learned-Miller E G. Unsupervised joint alignment of complex images. In: Proceedings of IEEE International Conference on Computer Vision (ICCV), Rio de Janeiro, 2007. 1–8

    Google Scholar 

  5. Learned-Miller E G. Data driven image models through continuous joint alignment. IEEE Trans Patt Anal Mach Intell, 2006, 28: 236–250

    Article  Google Scholar 

  6. Cox M, Sridharan S, Lucey S, et al. Least squares congealing for unsupervised alignment of images. In: Proceedings of IEEE International Conference on Computer Vision (ICCV), Kyoto, 2009. 1949–1956

    Google Scholar 

  7. Vedaldi A, Guidi G, Soatto S. Joint data alignment up to (lossy) transformations. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Anchorage Alaska, 2008. 1–8

    Google Scholar 

  8. Fan J Q, Li R Z. Variable selection via nonconcave penalized likelihood and its oracle properties. J Amer Stat Assoc, 2001, 96: 1348–1360

    Article  MathSciNet  MATH  Google Scholar 

  9. Zou H. The adaptive lasso and its oracle properties. J Amer Stat Assoc, 2006, 101: 1418–1429

    Article  MathSciNet  MATH  Google Scholar 

  10. Leng C L, Lin Y, Wahba G. A note on the lasso and related procedures in model selection. Stat Sinica, 2006, 16: 1273–1284

    MathSciNet  MATH  Google Scholar 

  11. Zhang C H. Nearly unbiased variable selection under minimax concave penalty. Ann Stat, 2010, 38: 894–942

    Article  MathSciNet  MATH  Google Scholar 

  12. Zhang C H, Zhang T. A general theory of concave regularization for high-dimensional sparse estimation problems. Stat Sci, 2012, 27: 576–593

    Article  MathSciNet  MATH  Google Scholar 

  13. Fan J Q, Xue L Z, Zou H. Strong oracle optimality of folded concave penalized estimation. Ann Stat, 2014, 42: 819–849

    Article  MathSciNet  MATH  Google Scholar 

  14. Bunea F, She Y Y, Wegkamp M H. Optimal selection of reduced rank estimators of high-dimensional matrices. Ann Stat, 2011, 39: 1282–1309

    Article  MathSciNet  MATH  Google Scholar 

  15. Wang S S, Liu D H, Zhang Z H. Nonconvex relaxation approaches to robust matrix recovery. In: Proceedings of 23rd International Joint Conference on Artificial Intelligence, Beijing, 2013. 1764–1770

    Google Scholar 

  16. Deng Y, Dai Q H, Liu R S, et al. Low-rank structure learning via log-sum heuristic recovery. IEEE Trans Neural Netw Learn Syst, 2013, 24: 383–396

    Article  Google Scholar 

  17. Cao W F, Wang Y, Yang C, et al. Folded-concave penalization appoarches to tensor completion. Neurocoumputing, 2015, 152: 261–273

    Article  Google Scholar 

  18. Zhou Z H, Li X D, Wright J, et al. Stable principal component pursuit. In: Proceedings of IEEE International Symposium on Information Theory (ISIT), Austin, 2010. 1518–1522

    Google Scholar 

  19. Peng Y G, Ganesh A, Wright J, et al. RASL: robust alignment by sparse and low-rank decomposition for linearly correalted images. IEEE Trans Patt Anal Mach Intell, 2012, 34: 2233–2246

    Article  Google Scholar 

  20. Basri R, Jacobs D W. Lambertian reflectance and linear subspaces. IEEE Trans Patt Anal Mach Intell, 2003, 25: 218–233

    Article  Google Scholar 

  21. Wang X G, Zhang Z D, Ma Y, et al. Robust subspace discovery via relaxed rank minimization. Neural Comput, 2014, 26: 611–635

    Article  MathSciNet  Google Scholar 

  22. Guo X H, Zhao R Z, An G Y, et al. An algorithm of face alignment and recognition by sparse and low rank decomposition. In: Proceedings of International Conference on Signal Processing (ICSP), HangZhou, 2014. 1036–1040

    Google Scholar 

  23. Wright J, Yang A Y, Ganesh A, et al. Robust face recognition via sparse representation. IEEE Trans Patt Anal Mach Intell, 2009, 31: 210–227

    Article  Google Scholar 

  24. Huang Z W, Zhao X W, Shan S G, et al. Coupling alignments with recognition for still-to-video face recognition. In: Proceedings of IEEE International Conference on Computer Vision (ICCV), Sydney, 2013. 3296–3303

    Google Scholar 

  25. Zhang Z D, Liang X, Ganesh A, et al. TILT: transform invariant low-rank textures. In: Proceedings of the Asian Conference on Computer Vision (ACCV), Queenstown, 2011. 314–328

    Google Scholar 

  26. Cai J F, Candès E J, Shen Z W. A singular value thresholding algorithm for matrix completion. SIAM J Optim, 2010, 20: 1956–1982

    Article  MathSciNet  MATH  Google Scholar 

  27. Zhang X Q, Wang D, Zhou Z Y, et al. Simultaneous rectification and alignment via robust recovery of low-rank tensors. In: Proceedings of 27th Annual Conference on Neural Information Processing Systems, Lake Tahoe, 2013. 1637–1645

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, 110016, China

    Xiai Chen, Zhi Han, Yandong Tang & Haibin Yu

  2. University of Chinese Academy of Sciences, Beijing, 100049, China

    Xiai Chen, Zhi Han, Yandong Tang & Haibin Yu

  3. School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an, 710049, China

    Yao Wang

Authors
  1. Xiai Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhi Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yandong Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Haibin Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhi Han.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, X., Han, Z., Wang, Y. et al. Nonconvex plus quadratic penalized low-rank and sparse decomposition for noisy image alignment. Sci. China Inf. Sci. 59, 052107 (2016). https://doi.org/10.1007/s11432-015-5419-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11432-015-5419-2

Keywords

关键词

Search

Navigation