Skip to main content
SpringerLink
Log in

Multi-view clustering based on view-attention driven

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Multi-view Clustering focuses on discovering coherence information and complementary information about the data among the different views, but often the views are accompanied by related information that is unrelated to the clustering goal. To address this problem, this paper proposes a clustering method named Multi-view Clustering Based on View-Attention Driven. Based on Autoencoder, the method learns feature representations from different views data using contrast learning and attention mechanisms. During the process of learning feature representations of different views, consider information of interest to other views. Guiding information is provided in an attention-driven manner to guide feature learning. On the one hand, it strengthens the focus on information in all views. On the other hand, it reduces the impact on information contained only in a subset of views that isn’t relevant to clustering. In addition, random initialization is used to train the autoencoder, minimizing the network structure’s influence on initialization parameters. Four challenging datasets were used to test the method and it was shown to outperform other competitive multi-view clustering methods. The codes will be available at https://github.com/mzf1998/Multi-view-Clustering-Based-on-View-Attention-Driven.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Hu P, Peng D, Sang Y, Xiang Y (2019) Multi-view linear discriminant analysis network. IEEE Trans Image Process 28(11):5352–5365

    Article  MathSciNet  MATH  Google Scholar 

  2. Kang Z, Zhao X, Peng C, Zhu H, Zhou JT, Peng X, Chen W, Xu Z (2020) Partition level multiview subspace clustering. Neural Netw 122:279–288

    Article  Google Scholar 

  3. Li R, Zhang C, Fu H, Peng X, Zhou T, Hu Q (2019) Reciprocal multi-layer subspace learning for multi-view clustering. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 8172–8180

  4. Nie F, Li J, Li X et al (2017) Self-weighted multiview clustering with multiple graphs. In: IJCAI, pp. 2564–2570

  5. Wang Q, Chen M, Nie F, Li X (2018) Detecting coherent groups in crowd scenes by multiview clustering. IEEE Trans Pattern Anal Machine Intell 42(1):46–58

    Article  Google Scholar 

  6. Zhou R, Shen Y-D (2020) End-to-end adversarial-attention network for multi-modal clustering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 14619–14628

  7. Baltrušaitis T, Ahuja C, Morency L-P (2018) Multimodal machine learning: a survey and taxonomy. IEEE Trans Pattern Anal Machine Intel 41(2):423–443

    Article  Google Scholar 

  8. Chaudhuri K, Kakade SM, Livescu K, Sridharan K (2009) Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 129–136

  9. Wang W, Arora R, Livescu K, Bilmes J (2015) On deep multi-view representation learning. In: International Conference on Machine Learning, pp. 1083–1092. PMLR

  10. Cai X, Nie F, Huang H (2013) Multi-view k-means clustering on big data. In: Twenty-Third International Joint Conference on Artificial Intelligence. Citeseer

  11. Xu C, Tao D, Xu C (2015) Multi-view self-paced learning for clustering. In: Twenty-Fourth International Joint Conference on Artificial Intelligence

  12. Wang J, Tian F, Yu H, Liu CH, Zhan K, Wang X (2017) Diverse non-negative matrix factorization for multiview data representation. IEEE Trans Cybernetics 48(9):2620–2632

    Article  Google Scholar 

  13. Yang Z, Xu Q, Zhang W, Cao X, Huang Q (2019) Split multiplicative multi-view subspace clustering. IEEE Trans Image Process 28(10):5147–5160

    Article  MathSciNet  MATH  Google Scholar 

  14. Yin M, Gao J, Xie S, Guo Y (2018) Multiview subspace clustering via tensorial t-product representation. IEEE Trans Neural Netw Learn Syst 30(3):851–864

    Article  MathSciNet  Google Scholar 

  15. Zhou T, Zhang C, Peng X, Bhaskar H, Yang J (2019) Dual shared-specific multiview subspace clustering. IEEE Trans Cybernetics 50(8):3517–3530

    Article  Google Scholar 

  16. Tao Z, Liu H, Li S, Ding Z, Fu Y (2019) Marginalized multiview ensemble clustering. IEEE Trans Neural Netw Learn Syst 31(2):600–611

    Article  MathSciNet  Google Scholar 

  17. Andrew G, Arora R, Bilmes J, Livescu K (2013) Deep canonical correlation analysis. In: International Conference on Machine Learning, pp. 1247–1255. PMLR

  18. Kumar A, Rai P, Daume H (2011) Co-regularized multi-view spectral clustering. Adv Neural Inform Process Syst, 24

  19. Cao X, Zhang C, Fu H, Liu S, Zhang H (2015) Diversity-induced multi-view subspace clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–594

  20. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. Adv Neural Inform Process Syst, 27

  21. Chen L-C, Yang Y, Wang J, Xu W, Yuille AL (2016) Attention to scale: Scale-aware semantic image segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3640–3649

  22. Jenssen R, Principe JC, Erdogmus D, Eltoft T (2006) The cauchy-schwarz divergence and parzen windowing: connections to graph theory and mercer kernels. J Franklin Instit 343(6):614–629

    Article  MathSciNet  MATH  Google Scholar 

  23. Zhao H, Ding Z, Fu Y (2017) Multi-view clustering via deep matrix factorization. In: Thirty-first AAAI Conference on Artificial Intelligence

  24. Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2012) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Machine Intell 35(1):171–184

    Article  Google Scholar 

  25. Luo S, Zhang C, Zhang W, Cao X (2018) Consistent and specific multi-view subspace clustering. In: Thirty-second AAAI Conference on Artificial Intelligence

  26. Blaschko MB, Lampert CH (2018) Correlational spectral clustering. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE

  27. Li M, Liu X, Wang L, Dou Y, Yin J, Zhu E (2016) Multiple kernel clustering with local kernel alignment maximization

  28. Wang Y, Liu X, Dou Y, Lv Q, Lu Y (2017) Multiple kernel learning with hybrid kernel alignment maximization. Pattern Recognition 70:104–111

    Article  Google Scholar 

  29. Abavisani M, Patel VM (2018) Deep multimodal subspace clustering networks. IEEE J Selected Topics Signal Process 12(6):1601–1614

    Article  Google Scholar 

  30. Hadsell R, Chopra S, LeCun Y (2006) Dimensionality reduction by learning an invariant mapping. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), vol. 2, pp. 1735–1742. IEEE

  31. Zhong H, Chen C, Jin Z, Hua X-S (2020) Deep robust clustering by contrastive learning. arXiv preprint arXiv:2008.03030

  32. Li Y, Hu P, Liu Z, Peng D, Zhou JT, Peng X (2021) Contrastive clustering. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 8547–8555

  33. Lin Y, Gou Y, Liu Z, Li B, Lv J, Peng X (2021) Completer: Incomplete multi-view clustering via contrastive prediction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11174–11183

  34. Liu L, Kang Z, Ruan J, He X (2022) Multilayer graph contrastive clustering network. Inform Sci

  35. Pan E, Kang Z (2021) Multi-view contrastive graph clustering. Adv Neural Inform Process Syst 34:2148–2159

    Google Scholar 

  36. Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507

    Article  MathSciNet  MATH  Google Scholar 

  37. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444

    Article  Google Scholar 

  38. Masci J, Meier U, Cireşan D, Schmidhuber J (2011) Stacked convolutional auto-encoders for hierarchical feature extraction. In: International Conference on Artificial Neural Networks, pp. 52–59. Springer

  39. Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol P-A, Bottou L (2010) Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J Machine Learn Res, 11(12)

  40. Xie J, Girshick R, Farhadi A (2016) Unsupervised deep embedding for clustering analysis. In: International Conference on Machine Learning, pp. 478–487. PMLR

  41. Li Y, Nie F, Huang H, Huang J (2015) Large-scale multi-view spectral clustering via bipartite graph. In: Twenty-Ninth AAAI Conference on Artificial Intelligence

  42. Yang Y, Newsam S (2010) Bag-of-visual-words and spatial extensions for land-use classification. In: Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 270–279

  43. Fei-Fei L, Perona P (2005) A bayesian hierarchical model for learning natural scene categories. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 2, pp. 524–531. IEEE

  44. Zhang Z, Liu L, Shen F, Shen HT, Shao L (2018) Binary multi-view clustering. IEEE Trans Pattern Anal Machine Intell 41(7):1774–1782

    Article  Google Scholar 

  45. Zhao H, Liu H, Fu Y (2016) Incomplete multi-modal visual data grouping. In: IJCAI, pp. 2392–2398

  46. Liu X, Li M, Tang C, Xia J, Xiong J, Liu L, Kloft M, Zhu E (2020) Efficient and effective regularized incomplete multi-view clustering. IEEE Trans Pattern Anal Machine Intell 43(8):2634–2646

    Google Scholar 

  47. Hu M, Chen S (2019) Doubly aligned incomplete multi-view clustering. arXiv preprint arXiv:1903.02785

  48. Wen J, Zhang Z, Xu Y, Zhang B, Fei L, Liu H (2019) Unified embedding alignment with missing views inferring for incomplete multi-view clustering. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 5393–5400

  49. Li S-Y, Jiang Y, Zhou Z-H (2014) Partial multi-view clustering. In: Proceedings of the AAAI Conference on Artificial Intelligence, 28

  50. Zhang C, Liu Y, Fu H (2019) Ae2-nets: Autoencoder in autoencoder networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2577–2585

  51. Wang H, Zong L, Liu B, Yang Y, Zhou W (2019) Spectral perturbation meets incomplete multi-view data. arXiv preprint arXiv:1906.00098

Download references

Acknowledgements

This work was supported in part by the Natural Science Foundation of Henan Province (no.222102210229); in part by the Natural Science Foundation of Henan Province (no.212300410320); in part by the Natural Science Foundation of Henan Province (no.212102210078); in part by the Natural Science Foundation of Henan Province (no.201300210400); in part by the Natural Science Foundation of Henan Province (no.222102210034). The data that support the findings of this study are available https://github.com/mzf1998/Multi-view-Clustering-Based-on-View-Attention-Driven

Author information

Author notes

  1. Zhifeng Ma, Junyang Yu, Longge Wang and Huazhu Chen contributed equally to this work.

Authors and Affiliations

  1. College of Software, Henan University, Kaifeng, 475004, China

    Zhifeng Ma, Junyang Yu, Longge Wang, Yuxi Zhao, Xin He, Yingqi Wang & Yalin Song

  2. Henan Province Intelligent Data Processing Research Engineering Research Center, Kaifeng, 475004, China

    Zhifeng Ma, Junyang Yu, Longge Wang, Yuxi Zhao, Xin He, Yingqi Wang & Yalin Song

  3. College of Science, Zhongyuan University of Technology, Zhengzhou, 450007, China

    Huazhu Chen

Authors
  1. Zhifeng Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Junyang Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Longge Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Huazhu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yuxi Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xin He
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yingqi Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Yalin Song
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Longge Wang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ma, Z., Yu, J., Wang, L. et al. Multi-view clustering based on view-attention driven. Int. J. Mach. Learn. & Cyber. 14, 2621–2631 (2023). https://doi.org/10.1007/s13042-023-01787-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-023-01787-9

Keywords

Search

Navigation