Abstract
Multi-view clustering is an important method to mine effective information from multi-view data in unsupervised learning environment. Due to the complex relationship between different data views, high-performance learning algorithms for multi-view data should not only consider the consistency and complementarity between different views simultaneously but also reduce the impact of adverse private information of single view. In this paper, we propose a novel multi-view clustering network, called Multi-view Clustering based on Collaborative Reconstruction (MCCR), to address these issues. This method captures consistency and complementarity information from different views in a fusion-free manner. Specifically, each view is pre-trained with an AutoEncoder to extract low-dimensional features from the original space. Subsequently, a main view is selected, whose latent representation features are imported into the decoders of each view for collaborative reconstruction. This strategy guides each autoencoder to focus on not only the extraction of private information, but also the consistent information of multiple views. At the same time, the encoder of the main view can also obtain the complementary information of other views after back-propagation. Finally, a self-expression layer without bias is used to learn the affinity matrix for the latent representation, and the clustering result is obtained by applying spectral clustering to the learned affinity matrix. Extensive experiments on public data sets have verified the advantage of proposed method.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Xu, R., Wunsch, D.: Survey of clustering algorithms. IEEE Trans. Neural Netw. 16(3), 645–678 (2005)
Zhang, P., Yang, Y., Peng, B., He, M.: Multi-view clustering algorithm based on variable weight and MKL. In: International Joint Conference on Rough Sets. pp. 599–610. Springer (2017). https://doi.org/10.1007/978-3-319-60837-2_48
Wang, S.,et al.: Multi-view clustering via late fusion alignment maximization. In: IJCAI, pp. 3778–3784 (2019)
Zhou, S., et al.: Multiple kernel clustering with neighbor-kernel subspace segmentation. IEEE Trans. Neuralnetworks Learn. Syst. 31(4), 1351–1362 (2019)
Liu, J., Wang, C., Gao, J., Han, J.: Multi-view clustering via joint nonnegative matrix factorization. In: Proceedings of the 2013 SIAM International Conference on Data Mining, pp. 252–260. SIAM (2013)
Chen, M.S., Huang, L., Wang, C.D., Huang, D.: Multi-view clustering in latent embedding space. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 3513–3520 (2020)
Liang, N., Yang, Z., Li, Z., Sun, W., Xie, S.: Multi-view clustering by non-negative matrix factorization with co-orthogonal constraints. Knowl. Based Syst. 194, 105582 (2020)
Abavisani, M., Patel, V.M.: Multimodal sparse and low-rank subspace clustering. Inf. Fusion 39, 168–177 (2018)
Luo, S., Zhang, C., Zhang, W., Cao, X.: Consistent and specific multi-view subspace clustering. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32. (2018)
Brbi´c, M., Kopriva, I.: Multi-view low-rank sparse subspace clustering. PatternRecogn. 73, 247–258 (2018)
Andrew, G., Arora, R., Bilmes, J., Livescu, K.: Deep canonical correlation analysis. In: International Conference on Machine Learning, pp. 1247−1255. PMLR (2013)
Wang, W., Arora, R., Livescu, K., Bilmes, J.: On deep multi-view representation learning. In: International Conference on Machine Learning, pp. 1083−1092. PMLR (2015)
Abavisani, M., Patel, V.M.: Deep multimodal subspace clustering networks. IEEE J. Sel. Top. Sign. Process. 12(6), 1601–1614 (2018)
Wang, Q., Cheng, J., Gao, Q., Zhao, G., Jiao, L.: Deep multi-view subspace clustering with unified and discriminative learning. IEEE Trans. Multimedia 23, 3483–3493 (2020)
Wang, Q., Tao, Z., Gao, Q., Jiao, L.: Multi-view subspace clustering via structured multi-pathway network. IEEE Trans. Neural Netw. Learn. Syst. 35(5), 7244−7250 (2022)
Xu, J., Tang, H., Ren, Y., Peng, L., Zhu, X., He, L.: Multi-level feature learning for contrastive multi-view clustering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 16051−16060 (2022)
Ke, G., Chao, G., Wang, X., Xu, C., Zhu, Y., Yu, Y.: A clustering-guided contrastive fusion for multi-view representation learning. IEEE Trans. Circ. Syst. Video Technol. (2023)
Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., Ma, Y.: Robust recovery of subspace structures by low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 171–184 (2012)
Hartigan, J.A., Wong, M.A.: Algorithm as 136: a k-means clustering algorithm. J. Roy. Stat. Soc. Ser.c (appl. Stat.) 28(1), 100–108 (1979)
Cai, J., Fan, J., Guo, W., Wang, S., Zhang, Y., Zhang, Z.: Efficient deep embedded subspace clustering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1–10 (2022)
Ke, G., Hong, Z., Zeng, Z., Liu, Z., Sun, Y., Xie, Y.: Conan: contrastive fusion networks for multi-view clustering. In: 2021 IEEE International Conference on Big Data (Big Data), pp. 653–660. IEEE (2021)
Trosten, D.J., Lokse, S., Jenssen, R., Kampffmeyer, M.: Reconsidering representation alignment for multi-view clustering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1255–1265 (2021)
Geng, Y., Han, Z., Zhang, C., Hu, Q.: Uncertainty-aware multi-view representation learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 7545–7553 (2021)
Yang, X.,et al.: Dealmvc: Dual contrastive calibration for multi-view clustering. In: Proceedings of the 31st ACM International Conference on Multimedia, pp. 337–346 (2023)
Yan, W., Zhang, Y., Lv, C., Tang, C., Yue, G., Liao, L., Lin, W.: Gcfagg: Global and cross-view feature aggregation for multi-view clustering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 19863–19872 (2023)
Xu, J., et al.: Self-supervised discriminative feature learning for deep multi-view clustering. IEEE Trans. Knowl. Data Eng. 35(7), 7470−7482 (2022)
Jiang, Y.G., Ye, G., Chang, S.F., Ellis, D., Loui, A.C.: Consumer video understanding: a benchmark database and an evaluation of human and machine performance. In: Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Al-Sharoa, E.M., Al-Wardat, M.A.: Multi-view robust tensor-based subspace clustering. IEEE Access 10, 134292–134306 (2022)
Zheng, Q., Zhu, J., Ma, Y., Li, Z., Tian, Z.: Multi-view subspace clustering networks with local and global graph information. Neurocomputing 449, 15–23 (2021)
Acknowledgments
This work was supported by the National Natural Science Foundation of China (Grant 61806131) and Guangdong Provincial Key Laboratory (Grant2023 B1212060076).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhou, K., Jia, H. (2024). Multi-view Clustering Based on Collaborative Reconstruction. In: Huang, DS., Zhang, X., Zhang, Q. (eds) Advanced Intelligent Computing Technology and Applications. ICIC 2024. Lecture Notes in Computer Science(), vol 14875. Springer, Singapore. https://doi.org/10.1007/978-981-97-5663-6_27
Download citation
DOI: https://doi.org/10.1007/978-981-97-5663-6_27
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-5662-9
Online ISBN: 978-981-97-5663-6
eBook Packages: Computer ScienceComputer Science (R0)