Abstract
Multi-view subspace clustering has emerged as a crucial tool to solve the multi-view clustering problem. However, many of the existing methods merely focus on the consistency issue when learning the multi-view representations, failing to capture the latent inconsistency across different views (which can be caused by the view-specificity or diversity). To tackle this issue, we therefore develop a Consistency- and Inconsistency-aware Multi-view Subspace Clustering for robust clustering. In the proposed method, we decompose the multi-view representations into a view-consistent representation and a set of view-inconsistent representations, through which the multi-view consistency as well as multi-view inconsistency can be well explored. Meanwhile, our method aims to suppress the redundancy and determine the importance of different views by introducing a novel view weighting strategy. Then a unified objective function is constructed, upon which an efficient optimization algorithm based on ADMM is further performed. Additionally, we design a new way to compute the affinity matrix from both consistent and inconsistent perspectives, which makes sure that the learned affinity matrix comprehensively fit the inherent properties of multi-view data. Experimental results on multiple multi-view data sets confirm the superiority of our method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J., et al.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends® Mach. Learn. 3(1), 1–122 (2011)
Cao, X., Zhang, C., Fu, H., Liu, S., Zhang, H.: Diversity-induced multi-view subspace clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–594 (2015)
Chen, M., Huang, L., Wang, C., Huang, D.: Multi-view clustering in latent embedding space. In: Thirty-Fourth AAAI Conference on Artificial Intelligence, pp. 3513–3520 (2020)
Huang, D., Wang, C.D., Wu, J., Lai, J.H., Kwoh, C.K.: Ultra-scalable spectral clustering and ensemble clustering. IEEE Trans. Knowl. Data Eng. (2019)
Huang, L., Wang, C.D., Chao, H.Y., Philip, S.Y.: Mvstream: multiview data stream clustering. IEEE Trans. Neural Networks Learn. Syst. (2019)
Huang, S., Kang, Z., Tsang, I.W., Xu, Z.: Auto-weighted multi-view clustering via kernelized graph learning. Pattern Recogn. 88, 174–184 (2019)
Liang, W., et al.: Multi-view spectral clustering with high-order optimal neighborhood laplacian matrix. IEEE Trans. Knowl. Data Eng. (2020)
Liang, Y., Huang, D., Wang., C.D.: Consistency meets inconsistency: a unified graph learning framework for multi-view clustering. In: Proceedings of the IEEE International Conference on Data Mining (2019)
Liang, Y., Huang, D., Wang, C.D., Yu, P.S.: Multi-view graph learning by joint modeling of consistency and inconsistency. arXiv preprint arXiv:2008.10208 (2020)
Lin, K.-Y., Huang, L., Wang, C.-D., Chao, H.-Y.: Multi-view proximity learning for clustering. In: Pei, J., Manolopoulos, Y., Sadiq, S., Li, J. (eds.) DASFAA 2018. LNCS, vol. 10828, pp. 407–423. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91458-9_25
Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., Ma, Y.: Robust recovery of subspace structures by low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 171–184 (2012)
Lu, C.-Y., Min, H., Zhao, Z.-Q., Zhu, L., Huang, D.-S., Yan, S.: Robust and efficient subspace segmentation via least squares regression. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7578, pp. 347–360. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33786-4_26
Luo, S., Zhang, C., Zhang, W., Cao, X.: Consistent and specific multi-view subspace clustering. In: Thirty-Second AAAI Conference on Artificial Intelligence, pp. 3730–3737 (2018)
Nie, F., Cai, G., Li, X.: Multi-view clustering and semi-supervised classification with adaptive neighbours. In: Thirsty-First AAAI Conference on Artificial Intelligence, pp. 2408–2414 (2017)
Nie, F., Li, J., Li, X.: Self-weighted multiview clustering with multiple graphs. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, pp. 2564–2570 (2017)
Tang, C., et al.: Learning a joint affinity graph for multiview subspace clustering. IEEE Trans. Multimedia 21(7), 1724–1736 (2019)
Wang, C.D., Lai, J.H., Philip, S.Y.: Multi-view clustering based on belief propagation. IEEE Trans. Knowl. Data Eng. 28(4), 1007–1021 (2015)
Wang, H., Yang, Y., Liu, B.: GMC: graph-based multi-view clustering. IEEE Trans. Knowl. Data Eng. 32, 1116–1129 (2020)
Wei, S., Wang, J., Yu, G., Domeniconi, C., Zhang, X.: Multi-view multiple clusterings using deep matrix factorization. In: AAAI, pp. 6348–6355 (2020)
Xia, R., Pan, Y., Du, L., Yin, J.: Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Twenty-Eighth AAAI Conference on Artificial Intelligence, pp. 2149–2155 (2014)
Zhan, K., Niu, C., Chen, C., Nie, F., Zhang, C., Yang, Y.: Graph structure fusion for multiview clustering. IEEE Trans. Knowl. Data Eng. (2018)
Zhan, K., Zhang, C., Guan, J., Wang, J.: Graph learning for multiview clustering. IEEE Trans. Cybern. 99, 1–9 (2017)
Zhang, C., et al.: Generalized latent multi-view subspace clustering. IEEE Trans. Pattern Anal. Mach. Intell. (2018)
Zhang, C., Fu, H., Hu, Q., Zhu, P., Cao, X.: Flexible multi-view dimensionality co-reduction. IEEE Trans. Image Process. 26(2), 648–659 (2016)
Zhang, C., Hu, Q., Fu, H., Zhu, P., Cao, X.: Latent multi-view subspace clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4279–4287 (2017)
Zhou, T., Zhang, C., Peng, X., Bhaskar, H., Yang, J.: Dual shared-specific multiview subspace clustering. IEEE transactions on cybernetics (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, GY., Chen, XW., Zhou, YR., Wang, CD., Huang, D. (2021). Consistency- and Inconsistency-Aware Multi-view Subspace Clustering. In: Jensen, C.S., et al. Database Systems for Advanced Applications. DASFAA 2021. Lecture Notes in Computer Science(), vol 12682. Springer, Cham. https://doi.org/10.1007/978-3-030-73197-7_20
Download citation
DOI: https://doi.org/10.1007/978-3-030-73197-7_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-73196-0
Online ISBN: 978-3-030-73197-7
eBook Packages: Computer ScienceComputer Science (R0)