Skip to main content
SpringerLink
Log in

Robust multi-view low-rank embedding clustering

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Significant improvements of multi-view subspace clustering have emerged in recent years. However, multi-view data are often lying on high-dimensional space and inevitably corrupted by noise and even outliers, which pose challenges for fully exploiting the intrinsic underlying relevance of multi-view data, as the redundant and corrupted features are highly deceptive. To address the above problems, this paper proposes a robust multi-view low-rank embedding (RMLE) method for clustering. Specifically, RMLE projects each high-dimensional view onto a clean low-rank embedding space without energy loss, such that multiple high-quality candidate affinity graphs are yielded by using self-expressiveness subspace learning. Meanwhile, it integrates the clean complimentary information of multi-view data in semantic space to learn a shared consensus affinity graph. Further, an efficient alternating optimization algorithm is designed to solve our RMLE by the alternating direction method of multipliers. Extensive experiments on four benchmark multi-view datasets demonstrate the performance superiority and advantages of RMLE against many state-of-the-art clustering methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data availability

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Notes

  1. Affinity matrix is deemed as the coefficient matrix \({\bf{Z}}\) of SEP, which is also referred to as affinity graph in graph semantic space.

References

  1. Mi Y, Ren Z, Xu Z, Li H, Sun Q, Chen H, Dai J (2022) Multi-view clustering with dual tensors. Neural Comput Appl 34(10):8027–8038

    Article  Google Scholar 

  2. Pan E, Kang Z (2021) Multi-view contrastive graph clustering. Adv Neural Inf Process Syst 34:2148–2159

    Google Scholar 

  3. Yang M, Li Y, Hu P, Bai J, Lv JC, Peng X (2022) Robust multi-view clustering with incomplete information. IEEE Trans Pattern Anal Mach Intell 45:1055–1069

    Article  Google Scholar 

  4. Zhang C, Fu H, Hu Q, Cao X, Xie Y, Tao D, Xu D (2018) Generalized latent multi-view subspace clustering. IEEE Trans Pattern Anal Mach Intell 42(1):86–99

    Article  Google Scholar 

  5. Lin Z, Kang Z, Zhang L, Tian L (2021) Multi-view attributed graph clustering. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2021.3101227

    Article  Google Scholar 

  6. Lu C, Feng J, Lin Z, Mei T, Yan S (2018) Subspace clustering by block diagonal representation. IEEE Trans Pattern Anal Mach Intell 41(2):487–501

    Article  Google Scholar 

  7. Elhamifar E, Vidal R (2013) Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35(11):2765–2781

    Article  Google Scholar 

  8. Liu G, Lin Z, Yu Y (2010) Robust subspace segmentation by low-rank representation. In: Proceedings of the 27th International conference on machine learning (ICML-10), pp 663–670

  9. Lu C-Y, Min H, Zhao Z-Q, Zhu L, Huang D-S, Yan S (2012) Robust and efficient subspace segmentation via least squares regression. In: European conference on computer vision. Springer, pp 347–360

  10. Lu C, Feng J, Lin Z, Yan S (2013) Correlation adaptive subspace segmentation by trace lasso. In: Proceedings of the IEEE international conference on computer vision, pp 1345–1352

  11. Kang Z, Peng C, Cheng Q, Xu Z (2018) Unified spectral clustering with optimal graph. In: Proceedings of the Thirty-second AAAI conference on artificial intelligence, pp 3366–3373

  12. Wen J, Zhang B, Xu Y, Yang J, Han N (2018) Adaptive weighted nonnegative low-rank representation. Pattern Recogn 81:326–340

    Article  Google Scholar 

  13. Ren Z, Sun Q (2021) Simultaneous global and local graph structure preserving for multiple kernel clustering. IEEE Trans Neural Netw Learn Syst 32(5):1839–1851

    Article  MathSciNet  Google Scholar 

  14. Ren Z, Sun Q, Wei D (2021) Multiple kernel clustering with kernel k-means coupled graph tensor learning. In: Proceedings of the AAAI conference on artificial intelligence, vol 35, pp 9411–9418

  15. Cao X, Zhang C, Fu H, Liu S, Zhang H (2015) Diversity-induced multi-view subspace clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 586–594

  16. Yang B, Zhang X, Lin Z, Nie F, Chen B, Wang F (2022) Efficient and robust multi-view clustering with anchor graph regularization. IEEE Trans Circuits Syst Video Technol 32(9):6200–6213

    Article  Google Scholar 

  17. Chen Y, Wang S, Zheng F, Cen Y (2020) Graph-regularized least squares regression for multi-view subspace clustering. Knowl Based Syst 194:105482

    Article  Google Scholar 

  18. Li R, Zhang C, Hu Q, Zhu P, Wang Z (2019) Flexible multi-view representation learning for subspace clustering. In: Proceedings of the 28th International joint conference on artificial intelligence, pp 2916–2922

  19. Li X, Zhou K, Li C, Zhang X, Liu Y, Wang Y (2021) Multi-view clustering via neighbor domain correlation learning. Neural Comput Appl 33(8):3403–3415

    Article  Google Scholar 

  20. Yan D, Huang L, Jordan MI (2009) Fast approximate spectral clustering. In: Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining, pp 907–916

  21. Brbić M, Kopriva I (2018) Multi-view low-rank sparse subspace clustering. Pattern Recogn 73:247–258

    Article  Google Scholar 

  22. Zhu W, Lu J, Zhou J (2019) Structured general and specific multi-view subspace clustering. Pattern Recogn 93:392–403

    Article  Google Scholar 

  23. Ren Z, Yang SX, Sun Q, Wang T (2020) Consensus affinity graph learning for multiple kernel clustering. IEEE Trans Cybern 51(6):3273–3284

    Article  Google Scholar 

  24. Chen M-S, Wang C-D, Lai J-H (2022) Low-rank tensor based proximity learning for multi-view clustering. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2022.3151861

    Article  Google Scholar 

  25. Gao H, Nie F, Li X, Huang H (2015) Multi-view subspace clustering. In: Proceedings of the IEEE international conference on computer vision, pp 4238–4246

  26. Luo S, Zhang C, Zhang W, Cao X (2018) Consistent and specific multi-view subspace clustering. In: Proceedings of the Thirty-second AAAI conference on artificial intelligence, pp 3730–3737

  27. Wang S, Liu X, Zhu E, Tang C, Liu J, Hu J, Xia J, Yin J (2019) Multi-view clustering via late fusion alignment maximization. In: Proceedings of the 28th International joint conference on artificial intelligence, pp 3778–3784

  28. Li H, Ren Z, Mukherjee M, Huang Y, Sun Q, Li X, Chen L (2020) Robust energy preserving embedding for multi-view subspace clustering. Knowl Based Syst 210:106489

    Article  Google Scholar 

  29. Chen M-S, Huang L, Wang C-D, Huang D, Lai J-H (2021) Relaxed multi-view clustering in latent embedding space. Inf Fusion 68:8–21

    Article  Google Scholar 

  30. Chen M-S, Huang L, Wang C-D, Huang D (2020) Multi-view clustering in latent embedding space. In: Proceedings of the AAAI conference on artificial intelligence, vol 34, pp 3513–3520

  31. Ren Z, Sun Q, Wu B, Zhang X, Yan W (2019) Learning latent low-rank and sparse embedding for robust image feature extraction. IEEE Trans Image Process 29:2094–2107

    Article  MATH  Google Scholar 

  32. Gazzola S, Nagy JG, Landman MS (2021) Iteratively reweighted FGMRES and FLSQR for sparse reconstruction. SIAM J Sci Comput 43(5):47–69

    Article  MathSciNet  MATH  Google Scholar 

  33. Park H (1991) A parallel algorithm for the unbalanced orthogonal procrustes problem. Parallel Comput 17(8):913–923

    Article  MATH  Google Scholar 

  34. Avron H, Kale S, Kasiviswanathan SP, Sindhwani V (2012) Efficient and practical stochastic subgradient descent for nuclear norm regularization. In: Proceedings of the 29th International conference on international conference on machine learning, pp 323–330

  35. Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2012) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–184

    Article  Google Scholar 

  36. Nie F, Cai G, Li X (2017) Multi-view clustering and semi-supervised classification with adaptive neighbours. In: Proceedings of the Thirty-first AAAI conference on artificial intelligence, pp 2408–2414

  37. Zhan K, Zhang C, Guan J, Wang J (2018) Graph learning for multiview clustering. IEEE Trans Cybern 48(10):2887–2895

    Article  Google Scholar 

  38. Wang H, Yang Y, Liu B (2020) GMC: graph-based multi-view clustering. IEEE Trans Knowl Data Eng 32(06):1116–1129

    Article  Google Scholar 

  39. Li X, Chen M, Wang Q (2019) Adaptive consistency propagation method for graph clustering. IEEE Trans Knowl Data Eng 32(4):797–802

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the Project of Key Laboratory of System Control and Information Processing (Grant No. Scip202210), and the Open Project Program of the State Key Lab of CAD &CG of Zhejiang University (Grant No. A2217).

Author information

Authors and Affiliations

  1. School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China

    Jian Dai, Hong Song & Jian Yang

  2. School of National Defence Science and Technology, Southwest University of Science and Technology, Mianyang, 621010, China

    Zhenwen Ren

  3. Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, 200240, China

    Zhenwen Ren

  4. Southwest Automation Research Institute, China South Industries Group Corporation, Mianyang, 621000, China

    Jian Dai, Yunzhi Luo & Zhenwen Ren

Authors
  1. Jian Dai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hong Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yunzhi Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhenwen Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jian Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Zhenwen Ren or Jian Yang.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dai, J., Song, H., Luo, Y. et al. Robust multi-view low-rank embedding clustering. Neural Comput & Applic 35, 7877–7890 (2023). https://doi.org/10.1007/s00521-022-08137-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-08137-w

Keywords

Search

Navigation