Skip to main content

Multi-view Clustering Based on Collaborative Reconstruction

  • Conference paper
  • First Online:
Advanced Intelligent Computing Technology and Applications (ICIC 2024)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14875))

Included in the following conference series:

  • 481 Accesses

Abstract

Multi-view clustering is an important method to mine effective information from multi-view data in unsupervised learning environment. Due to the complex relationship between different data views, high-performance learning algorithms for multi-view data should not only consider the consistency and complementarity between different views simultaneously but also reduce the impact of adverse private information of single view. In this paper, we propose a novel multi-view clustering network, called Multi-view Clustering based on Collaborative Reconstruction (MCCR), to address these issues. This method captures consistency and complementarity information from different views in a fusion-free manner. Specifically, each view is pre-trained with an AutoEncoder to extract low-dimensional features from the original space. Subsequently, a main view is selected, whose latent representation features are imported into the decoders of each view for collaborative reconstruction. This strategy guides each autoencoder to focus on not only the extraction of private information, but also the consistent information of multiple views. At the same time, the encoder of the main view can also obtain the complementary information of other views after back-propagation. Finally, a self-expression layer without bias is used to learn the affinity matrix for the latent representation, and the clustering result is obtained by applying spectral clustering to the learned affinity matrix. Extensive experiments on public data sets have verified the advantage of proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Xu, R., Wunsch, D.: Survey of clustering algorithms. IEEE Trans. Neural Netw. 16(3), 645–678 (2005)

    Article  Google Scholar 

  2. Zhang, P., Yang, Y., Peng, B., He, M.: Multi-view clustering algorithm based on variable weight and MKL. In: International Joint Conference on Rough Sets. pp. 599–610. Springer (2017). https://doi.org/10.1007/978-3-319-60837-2_48

  3. Wang, S.,et al.: Multi-view clustering via late fusion alignment maximization. In: IJCAI, pp. 3778–3784 (2019)

    Google Scholar 

  4. Zhou, S., et al.: Multiple kernel clustering with neighbor-kernel subspace segmentation. IEEE Trans. Neuralnetworks Learn. Syst. 31(4), 1351–1362 (2019)

    Article  MathSciNet  Google Scholar 

  5. Liu, J., Wang, C., Gao, J., Han, J.: Multi-view clustering via joint nonnegative matrix factorization. In: Proceedings of the 2013 SIAM International Conference on Data Mining, pp. 252–260. SIAM (2013)

    Google Scholar 

  6. Chen, M.S., Huang, L., Wang, C.D., Huang, D.: Multi-view clustering in latent embedding space. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 3513–3520 (2020)

    Google Scholar 

  7. Liang, N., Yang, Z., Li, Z., Sun, W., Xie, S.: Multi-view clustering by non-negative matrix factorization with co-orthogonal constraints. Knowl. Based Syst. 194, 105582 (2020)

    Article  Google Scholar 

  8. Abavisani, M., Patel, V.M.: Multimodal sparse and low-rank subspace clustering. Inf. Fusion 39, 168–177 (2018)

    Article  Google Scholar 

  9. Luo, S., Zhang, C., Zhang, W., Cao, X.: Consistent and specific multi-view subspace clustering. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32. (2018)

    Google Scholar 

  10. Brbi´c, M., Kopriva, I.: Multi-view low-rank sparse subspace clustering. PatternRecogn. 73, 247–258 (2018)

    Google Scholar 

  11. Andrew, G., Arora, R., Bilmes, J., Livescu, K.: Deep canonical correlation analysis. In: International Conference on Machine Learning, pp. 1247−1255. PMLR (2013)

    Google Scholar 

  12. Wang, W., Arora, R., Livescu, K., Bilmes, J.: On deep multi-view representation learning. In: International Conference on Machine Learning, pp. 1083−1092. PMLR (2015)

    Google Scholar 

  13. Abavisani, M., Patel, V.M.: Deep multimodal subspace clustering networks. IEEE J. Sel. Top. Sign. Process. 12(6), 1601–1614 (2018)

    Article  Google Scholar 

  14. Wang, Q., Cheng, J., Gao, Q., Zhao, G., Jiao, L.: Deep multi-view subspace clustering with unified and discriminative learning. IEEE Trans. Multimedia 23, 3483–3493 (2020)

    Article  Google Scholar 

  15. Wang, Q., Tao, Z., Gao, Q., Jiao, L.: Multi-view subspace clustering via structured multi-pathway network. IEEE Trans. Neural Netw. Learn. Syst. 35(5), 7244−7250 (2022)

    Google Scholar 

  16. Xu, J., Tang, H., Ren, Y., Peng, L., Zhu, X., He, L.: Multi-level feature learning for contrastive multi-view clustering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 16051−16060 (2022)

    Google Scholar 

  17. Ke, G., Chao, G., Wang, X., Xu, C., Zhu, Y., Yu, Y.: A clustering-guided contrastive fusion for multi-view representation learning. IEEE Trans. Circ. Syst. Video Technol. (2023)

    Google Scholar 

  18. Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., Ma, Y.: Robust recovery of subspace structures by low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 171–184 (2012)

    Article  Google Scholar 

  19. Hartigan, J.A., Wong, M.A.: Algorithm as 136: a k-means clustering algorithm. J. Roy. Stat. Soc. Ser.c (appl. Stat.) 28(1), 100–108 (1979)

    Google Scholar 

  20. Cai, J., Fan, J., Guo, W., Wang, S., Zhang, Y., Zhang, Z.: Efficient deep embedded subspace clustering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1–10 (2022)

    Google Scholar 

  21. Ke, G., Hong, Z., Zeng, Z., Liu, Z., Sun, Y., Xie, Y.: Conan: contrastive fusion networks for multi-view clustering. In: 2021 IEEE International Conference on Big Data (Big Data), pp. 653–660. IEEE (2021)

    Google Scholar 

  22. Trosten, D.J., Lokse, S., Jenssen, R., Kampffmeyer, M.: Reconsidering representation alignment for multi-view clustering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1255–1265 (2021)

    Google Scholar 

  23. Geng, Y., Han, Z., Zhang, C., Hu, Q.: Uncertainty-aware multi-view representation learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 7545–7553 (2021)

    Google Scholar 

  24. Yang, X.,et al.: Dealmvc: Dual contrastive calibration for multi-view clustering. In: Proceedings of the 31st ACM International Conference on Multimedia, pp. 337–346 (2023)

    Google Scholar 

  25. Yan, W., Zhang, Y., Lv, C., Tang, C., Yue, G., Liao, L., Lin, W.: Gcfagg: Global and cross-view feature aggregation for multi-view clustering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 19863–19872 (2023)

    Google Scholar 

  26. Xu, J., et al.: Self-supervised discriminative feature learning for deep multi-view clustering. IEEE Trans. Knowl. Data Eng. 35(7), 7470−7482 (2022)

    Google Scholar 

  27. Jiang, Y.G., Ye, G., Chang, S.F., Ellis, D., Loui, A.C.: Consumer video understanding: a benchmark database and an evaluation of human and machine performance. In: Proceedings of the 1st ACM International Conference on Multimedia Retrieval

    Google Scholar 

  28. Al-Sharoa, E.M., Al-Wardat, M.A.: Multi-view robust tensor-based subspace clustering. IEEE Access 10, 134292–134306 (2022)

    Article  Google Scholar 

  29. Zheng, Q., Zhu, J., Ma, Y., Li, Z., Tian, Z.: Multi-view subspace clustering networks with local and global graph information. Neurocomputing 449, 15–23 (2021)

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by the National Natural Science Foundation of China (Grant 61806131) and Guangdong Provincial Key Laboratory (Grant2023 B1212060076).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hong Jia .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhou, K., Jia, H. (2024). Multi-view Clustering Based on Collaborative Reconstruction. In: Huang, DS., Zhang, X., Zhang, Q. (eds) Advanced Intelligent Computing Technology and Applications. ICIC 2024. Lecture Notes in Computer Science(), vol 14875. Springer, Singapore. https://doi.org/10.1007/978-981-97-5663-6_27

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-5663-6_27

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-5662-9

  • Online ISBN: 978-981-97-5663-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics