Skip to main content
SpringerLink
Log in

Multi-view clustering with dual tensors

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Multi-view clustering methods based on tensor have achieved favorable performance thanks to the powerful capacity of capturing the high-order correlation hidden in multi-view data. However, many existing works only pay attention to exploring the inter-view correlation (i.e., the correlation between views for a same sample) and ignore the intra-view correlation (i.e., the correlation between different samples in a view), such that the high-order information cannot be fully utilized. Toward this issue, we propose an innovative multi-view clustering method in this paper, multi-view clustering with dual tensors (MCDT), which simultaneously exploits the intra-view correlation and the inter-view correlation. Specifically, we first learn a set of specific affinity matrices by using subspace learning in each view. Then, we stack these affinity matrices into a tensor and impose the tensor nuclear norm to exploit the intra-view high-order correlation. Meanwhile, we also rotate this tensor to exploit the inter-view high-order correlation, so as to exploit more comprehensive information hidden in multiple views. Extensive experiments on benchmark datasets demonstrate that the proposed MCDT obtains superior performance in comparison with existing state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Wu J, Lin Z, Zha H (2019) Essential tensor learning for multi-view spectral clustering. IEEE Trans Image Process 28(12):5910–5922

    Article  MathSciNet  Google Scholar 

  2. Chowdhury K, Chaudhuri D, Pal AK (2021) An entropy-based initialization method of k-means clustering on the optimal number of clusters. Neural Comput Appl 33(12):6965–6982

    Article  Google Scholar 

  3. Ng AY, Jordan MI, Weiss Y (2002) On spectral clustering: Analysis and an algorithm. In: Advances in neural information processing systems, pp 849–856

  4. Elhamifar E, Vidal R (2013) Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35(11):2765–2781

    Article  Google Scholar 

  5. Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2012) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–184

    Article  Google Scholar 

  6. Diallo B, Hu J, Li T, Khan GA, Hussein AS (2021) Multi-view document clustering based on geometrical similarity measurement. Int J Mach Learn Cybern pp 1–13

  7. Kang Z, Zhao X, Peng C, Zhu H, Zhou JT, Peng X, Chen W, Xu Z (2020) Partition level multiview subspace clustering. Neural Netw 122:279–288

    Article  Google Scholar 

  8. Khan GA, Hu J, Li T, Diallo B, Wang H (2021) Multi-view data clustering via non-negative matrix factorization with manifold regularization. Int J Mach Learn Cybern pp 1–13

  9. Wang H, Yang Y, Zhang X, Peng B (2020) Parallel multi-view concept clustering in distributed computing. Neural Comput Appl 32(10):5621–5631

    Article  Google Scholar 

  10. Tang C, Liu X, Zhu X, Zhu E, Luo Z, Wang L, Gao W (2020) Cgd: Multi-view clustering via cross-view graph diffusion. Proceed AAAI Conference Artif Intell 34:5924–5931

    Article  Google Scholar 

  11. Zhu W, Lu J, Zhou J (2019) Structured general and specific multi-view subspace clustering. Pattern Recognit 93:392–403

    Article  Google Scholar 

  12. Gao H, Nie F, Li X, Huang H (2015) Multi-view subspace clustering. In: Proceedings of the IEEE international conference on computer vision, pp 4238–4246

  13. Zhang C, Hu Q, Fu H, Zhu P, Cao X (2017) Latent multi-view subspace clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4279–4287

  14. Luo S, Zhang C, Zhang W, Cao X (2018) Consistent and specific multi-view subspace clustering. In: Thirty-second AAAI conference on artificial intelligence, pp 3730–3737

  15. Chen MS, Huang L, Wang CD, Huang D (2020) Multi-view clustering in latent embedding space. Proceed AAAI conference Artif Intell 34:3513–3520

    Article  Google Scholar 

  16. Kang Z, Shi G, Huang S, Chen W, Pu X, Zhou JT, Xu Z (2020) Multi-graph fusion for multi-view spectral clustering. Knowl-Based Syst 189:105102

    Article  Google Scholar 

  17. Wang X, Guo X, Lei Z, Zhang C, Li SZ (2017) Exclusivity-consistency regularized multi-view subspace clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 923–931

  18. Li H, Ren Z, Mukherjee M, Huang Y, Sun Q, Li X, Chen L (2020) Robust energy preserving embedding for multi-view subspace clustering. Knowl-Based Syst 210:106489

    Article  Google Scholar 

  19. Ren Z, Mukherjee M, Bennis M, Lloret J (2020) Multi-kernel clustering via non-negative matrix factorization tailored graph tensor over distributed networks. IEEE J Sel Areas Commun

  20. Ren Z, Yang SX, Sun Q, Wang T (2020) Consensus affinity graph learning for multiple kernel clustering. IEEE Trans Cybern 51(6):3273–3284

    Article  Google Scholar 

  21. Lin Z, Kang Z, Zhang L, Tian L (2021) Multi-view attributed graph clustering. IEEE Trans Knowl Data Eng

  22. Kang Z, Lin Z, Zhu X, Xu W (2021) Structured graph learning for scalable subspace clustering: from single view to multiview. IEEE Trans Cybern

  23. Lv J, Kang Z, Lu X, Xu Z (2021) Pseudo-supervised deep subspace clustering. IEEE Trans Image Process

  24. Yin M, Huang W, Gao J (2020) Shared generative latent representation learning for multi-view clustering. Proce AAAI Conference Artif Intell 34:6688–6695

    Article  Google Scholar 

  25. Yin M, Xie S, Wu Z, Zhang Y, Gao J (2018) Subspace clustering via learning an adaptive low-rank graph. IEEE Trans Image Process 27(8):3716–3728

    Article  MathSciNet  Google Scholar 

  26. Zhang C, Fu H, Liu S, Liu G, Cao X (2015) Low-rank tensor constrained multiview subspace clustering. In: Proceedings of the IEEE international conference on computer vision, pp 1582–1590

  27. Liu J, Musialski P, Wonka P, Ye J (2013) Tensor completion for estimating missing values in visual data. IEEE Trans Pattern Anal Mach Intell 35(1):208–220

    Article  Google Scholar 

  28. Kilmer ME, Braman K, Hao N, Hoover RC (2013) Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34(1):148–172

    Article  MathSciNet  Google Scholar 

  29. Kilmer ME, Martin CD (2011) Factorization strategies for third-order tensors. Linear Algebra Appl 435(3):641–658

    Article  MathSciNet  Google Scholar 

  30. Xie Y, Tao D, Zhang W, Liu Y, Zhang L, Qu Y (2018) On unifying multi-view self-representations for clustering by tensor multi-rank minimization. Int J Comput Vis 126(11):1157–1179

    Article  MathSciNet  Google Scholar 

  31. Yin M, Gao J, Xie S, Guo Y (2016) Low-rank multi-view clustering in third-order tensor space. arXiv preprint arXiv:160808336

  32. Yin M, Gao J, Xie S, Guo Y (2018) Multiview subspace clustering via tensorial t-product representation. IEEE Trans Neural Netw Learn Syst 30(3):851–864

    Article  MathSciNet  Google Scholar 

  33. Phan AH, Yamagishi M, Mandic D, Cichocki A (2020) Quadratic programming over ellipsoids with applications to constrained linear regression and tensor decomposition. Neural Comput Appl 32(11):7097–7120

    Article  Google Scholar 

  34. Zhan K, Nie F, Wang J, Yang Y (2019) Multiview consensus graph clustering. IEEE Trans Image Process 28(3):1261–1270

    Article  MathSciNet  Google Scholar 

  35. Xiao X, Chen Y, Gong YJ, Zhou Y (2020) Prior knowledge regularized multiview self-representation and its applications. IEEE Trans Neural Netw Learn Syst 32(3):1325–1338

    Article  MathSciNet  Google Scholar 

  36. Xie Y, Zhang W, Qu Y, Dai L, Tao D (2020) Hyper-laplacian regularized multilinear multiview self-representations for clustering and semisupervised learning. IEEE Trans Cybern 50(2):572–586

    Article  Google Scholar 

  37. Ren Z, Sun Q, Wei D (2021) Multiple kernel clustering with kernel k-means coupled graph tensor learning. Proc AAAI Conference Artif Intell 35:9411–9418

    Google Scholar 

  38. Ren Z, Sun Q, Wu B, Zhang X, Yan W (2020) Learning latent low-rank and sparse embedding for robust image feature extraction. IEEE Trans Image Process 29(1):2094–2107

    Article  Google Scholar 

  39. Lin Z, Liu R, Su Z (2011) Linearized alternating direction method with adaptive penalty for low-rank representation. In: Advances in neural information processing systems, pp 612–620

  40. Tang C, Zhu X, Liu X, Li M, Wang P, Zhang C, Wang L (2018) Learning a joint affinity graph for multiview subspace clustering. IEEE Trans Multimed 21(7):1724–1736

    Article  Google Scholar 

  41. Zhang C, Fu H, Hu Q, Cao X, Xie Y, Tao D, Xu D (2020) Generalized latent multi-view subspace clustering. IEEE Trans Pattern Analy Mach Intell 42(1):86–99

    Article  Google Scholar 

  42. Zhang C, Fu H, Wang J, Li W, Cao X, Hu Q (2020) Tensorized multi-view subspace representation learning. Int J Comput Vis, pp 1–18

  43. Kang Z, Pan H, Hoi SC, Xu Z (2019) Robust graph learning from noisy data. IEEE Trans Cybern 50(5):1833–1843

    Article  Google Scholar 

  44. Zhan K, Niu C, Chen C, Nie F, Zhang C, Yang Y (2019) Graph structure fusion for multiview clustering. IEEE Trans Knowl Data Eng 31(10):1984–1993

    Article  Google Scholar 

  45. Nie F, Li J, Li X, et al. (2017) Self-weighted multiview clustering with multiple graphs. In: IJCAI, pp 2564–2570

  46. Wu J, Xie X, Nie L, Lin Z, Zha H (2020) Unified graph and low-rank tensor learning for multi-view clustering. Proc AAAI Conference Artif Intell 34:6388–6395

    Article  Google Scholar 

  47. Cheng M, Jing L, Ng MK (2019) Tensor-based low-dimensional representation learning for multi-view clustering. IEEE Trans Image Process 28(5):2399–2414

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

This work was supported by the Sichuan Science and Technology Program (Grant no. 2021YJ0083), the State Key Lab. Foundation for Novel Software Technology of Nanjing University (Grant no. KFKT2021B23), the Sichuan Science and Technology Miaozi Program (Grant no. 2021020), the National Statistical Science Research Project (Grant no. 2020491), the Postgraduate Innovation Fund Project of Southwest University of Science and Technology (Grant no. 20ycx0055), the Guangxi Natural Science Foundation (Grant no. 2020GXNSFAA297186), and the Guangxi Science and Technology Major Project (Grant no. 2018AA32001).

Author information

Authors and Affiliations

  1. Department of Information Engineering, Southwest University of Science and Technology, Mianyang, 621010, China

    Yong Mi & Haoran Li

  2. Department of National Defence Science and Technology, Southwest University of Science and Technology, Mianyang, 621010, China

    Zhenwen Ren

  3. State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, 210008, China

    Zhenwen Ren

  4. Guangxi Key Laboratory of Images and Graphics Intelligent Processing, Guilin University of Electronics Technology, Guilin, 541004, China

    Zhi Xu

  5. Department of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, 210094, China

    Quansen Sun

  6. Southwest Automation Research Institute, China South Industries Group Corporation, Mianyang, 621000, China

    Hongxia Chen & Jian Dai

Authors
  1. Yong Mi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhenwen Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhi Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Haoran Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Quansen Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hongxia Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jian Dai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhenwen Ren.

Ethics declarations

Conflict of Interest Statement

There are no conflicts of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mi, Y., Ren, Z., Xu, Z. et al. Multi-view clustering with dual tensors. Neural Comput & Applic 34, 8027–8038 (2022). https://doi.org/10.1007/s00521-022-06927-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-06927-w

Keywords

Search

Navigation