skip to main content
10.1145/3581783.3612545acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Localized and Balanced Efficient Incomplete Multi-view Clustering

Published: 27 October 2023 Publication History

Abstract

In recent years, many incomplete multi-view clustering methods have been proposed to address the challenging unsupervised clustering issue on the multi-view data with missing views. However, most of the existing works are inapplicable to large-scale clustering task and their clustering results are unstable since these methods have high computational complexities and their results are produced by kmeans rather than their designed learning models. In this paper, we propose a new one-step incomplete multi-view clustering model, called Localized and Balanced Incomplete Multi-view Clustering (LBIMVC), to address these issues. Specifically, LBIMVC develops a new graph regularized incomplete multi-matrix-factorization model to obtain the unique clustering result by learning a consensus probability representation, where each element of the consensus representation can directly reflect the probability of the corresponding sample to the class. In addition, the proposed graph regularized model integrates geometric preserving and consensus representation learning into one term without introducing any extra constraint terms and parameters to explore the structure of data. Moreover, to avoid that samples are over divided into a few clusters, a balanced constraint is introduced to the model. Experimental results on four databases demonstrate that our method not only obtains competitive clustering performance, but also performs faster than some state-of-the-art methods.

Supplemental Material

MP4 File
A presentation video about our paper "Localized and Balanced Efficient Incomplete Multi-view Clustering".

References

[1]
Arthur Asuncion and David Newman. 2007. UCI machine learning repository.
[2]
Swati K Choudhary and Ameya K Naik. 2021. Multimodal biometric-based authentication with secured templates. International Journal of Image and Graphics, Vol. 21, 02 (2021), 2150018.
[3]
Li Fei-Fei, Rob Fergus, and Pietro Perona. 2004. Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. In IEEE Conference on Computer Vision and Pattern Recognition Workshop. IEEE, 178--178.
[4]
Derek Greene and Pádraig Cunningham. 2006. Practical solutions to the problem of diagonal dominance in kernel document clustering. In International Conference on Machine Learning. 377--384.
[5]
Menglei Hu and Songcan Chen. 2018. Doubly aligned incomplete multi-view clustering. In International Joint Conference on Artificial Intelligence. 2262--2268.
[6]
Menglei Hu and Songcan Chen. 2019. One-pass incomplete multi-view clustering. In AAAI Conference on Artificial Intelligence, Vol. 33. 3838--3845.
[7]
Abhishek Kumar, Piyush Rai, and Hal Daume. 2011. Co-regularized multi-view spectral clustering. In Advances in Neural Information Processing Systems. 1413--1421.
[8]
Yeqing Li, Feiping Nie, Heng Huang, and Junzhou Huang. 2015. Large-scale multi-view spectral clustering via bipartite graph. In AAAI Conference on Artificial Intelligence. 2750--2756.
[9]
Zhenglai Li, Chang Tang, Xiao Zheng, Xinwang Liu, Wei Zhang, and En Zhu. 2022. High-order correlation preserved incomplete multi-view subspace clustering. IEEE Transactions on Image Processing, Vol. 31 (2022), 2067--2080.
[10]
Hanyang Liu, Junwei Han, Feiping Nie, and Xuelong Li. 2017. Balanced clustering with least square regression. In AAAI Conference on Artificial Intelligence. 2231--2237.
[11]
Jialu Liu, Chi Wang, Jing Gao, and Jiawei Han. 2013. Multi-view clustering via joint nonnegative matrix factorization. In SIAM International Conference on Data Mining. SIAM, 252--260.
[12]
Xinwang Liu, Xinzhong Zhu, Miaomiao Li, Lei Wang, En Zhu, Tongliang Liu, Marius Kloft, Dinggang Shen, Jianping Yin, and Wen Gao. 2019. Multiple kernel k k-means with incomplete kernels. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 42, 5 (2019), 1191--1204.
[13]
Feiping Nie, Xiaoqian Wang, Michael I Jordan, and Heng Huang. 2016. The Constrained Laplacian Rank algorithm for graph-based clustering. In AAAI Conference on Artificial Intelligence. 1969--1976.
[14]
Nishant Rai, Sumit Negi, Santanu Chaudhury, and Om Deshmukh. 2016. Partial multi-view clustering using graph regularized NMF. In International Conference on Pattern Recognition. IEEE, 2192--2197.
[15]
Weixiang Shao, Lifang He, Chun-ta Lu, and S Yu Philip. 2016. Online multi-view clustering with incomplete views. In IEEE International Conference on Big Data. IEEE, 1012--1017.
[16]
Weixiang Shao, Lifang He, and S Yu Philip. 2015. Multiple incomplete views clustering via weighted nonnegative matrix factorization with l_{2, 1} regularization. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 318--334.
[17]
Hao Wang, Linlin Zong, Bing Liu, Yan Yang, and Wei Zhou. 2019. Spectral Perturbation Meets Incomplete Multi-view Data. In International Joint Conference on Artificial Intelligence. 3677--3683.
[18]
Siwei Wang, Xinwang Liu, Li Liu, Wenxuan Tu, Xinzhong Zhu, Jiyuan Liu, Sihang Zhou, and En Zhu. 2022. Highly-efficient incomplete large-scale multi-view clustering with consensus bipartite graph. In IEEE/CVF conference on computer vision and pattern recognition. 9776--9785.
[19]
Jie Wen, Ke Yan, Zheng Zhang, Yong Xu, Junqian Wang, Lunke Fei, and Bob Zhang. 2020a. Adaptive graph completion based incomplete multi-view clustering. IEEE Transactions on Multimedia, Vol. 23 (2020), 2493--2504.
[20]
Jie Wen, Zheng Zhang, Lunke Fei, Bob Zhang, Yong Xu, Zhao Zhang, and Jinxing Li. 2022. A survey on incomplete multiview clustering. IEEE Transactions on Systems, Man, and Cybernetics: Systems (2022).
[21]
Jie Wen, Zheng Zhang, Yong Xu, Bob Zhang, Lunke Fei, and Hong Liu. 2019. Unified embedding alignment with missing views inferring for incomplete multi-view clustering. In AAAI Conference on Artificial Intelligence, Vol. 33. 5393--5400.
[22]
Jie Wen, Zheng Zhang, Yong Xu, Bob Zhang, Lunke Fei, and Guo-Sen Xie. 2020b. CDIMC-net: Cognitive Deep Incomplete Multi-view Clustering Network. In International Joint Conference on Artificial Intelligence. 3230--3236.
[23]
Jie Wen, Zheng Zhang, Zhao Zhang, Lunke Fei, and Meng Wang. 2020c. Generalized incomplete multiview clustering with flexible locality structure diffusion. IEEE Transactions on Cybernetics, Vol. 51, 1 (2020), 101--114.
[24]
Dongxue Xia, Yan Yang, Shuhong Yang, and Tianrui Li. 2023. Incomplete multi-view clustering via kernelized graph learning. Information Sciences (2023).
[25]
Nan Xu, Yanqing Guo, Xin Zheng, Qianyu Wang, and Xiangyang Luo. 2018. Partial multi-view subspace clustering. In ACM International Conference on Multimedia. 1794--1801.
[26]
Zhe Xue, Junping Du, Dawei Du, Wenqi Ren, and Siwei Lyu. 2019. Deep correlated predictive subspace learning for incomplete multi-view semi-supervised classification. In International Joint Conference on Artificial Intelligence. 4026--4032.
[27]
Xiaoqiang Yan, Shizhe Hu, Yiqiao Mao, Yangdong Ye, and Hui Yu. 2021. Deep multi-view learning methods: A review. Neurocomputing, Vol. 448 (2021), 106--129.
[28]
Junfeng Yang and Xiaoming Yuan. 2013. Linearized augmented Lagrangian and alternating direction methods for nuclear norm minimization. Mathematics of computation, Vol. 82, 281 (2013), 301--329.
[29]
Mouxing Yang, Yunfan Li, Peng Hu, Jinfeng Bai, Jiancheng Lv, and Xi Peng. 2022. Robust multi-view clustering with incomplete information. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, 1 (2022), 1055--1069.
[30]
Yan Yang and Hao Wang. 2018. Multi-view clustering: A survey. Big Data Mining and Analytics, Vol. 1, 2 (2018), 83--107.
[31]
Xiaobo Zhang, Yan Yang, Tianrui Li, Yiling Zhang, Hao Wang, and Hamido Fujita. 2021. CMC: A consensus multi-view clustering model for predicting Alzheimer's disease progression. Computer Methods and Programs in Biomedicine, Vol. 199 (2021), 105895.
[32]
Zheng Zhang, Li Liu, Fumin Shen, Heng Tao Shen, and Ling Shao. 2018. Binary multi-view clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 41, 7 (2018), 1774--1782.
[33]
Handong Zhao, Hongfu Liu, and Yun Fu. 2016. Incomplete multi-modal visual data grouping. In International Joint Conference on Artificial Intelligence. 2392--2398.
[34]
Xiaofeng Zhu, Shichao Zhang, Yonghua Zhu, Wei Zheng, and Yang Yang. 2020. Self-weighted multi-view fuzzy clustering. ACM transactions on knowledge discovery from data (TKDD), Vol. 14, 4 (2020), 1--17.
[35]
Yonghua Zhu, Xiaofeng Zhu, and Wei Zheng. 2018. Robust multi-view learning via half-quadratic minimization. In International Joint Conference on Artificial Intelligence. 3278--3284.
[36]
Hui Zou, Trevor Hastie, and Robert Tibshirani. 2006. Sparse principal component analysis. Journal of computational and graphical statistics, Vol. 15, 2 (2006), 265--286.

Cited By

View all
  • (2025)UNAGI: Unified neighbor-aware graph neural network for multi-view clusteringNeural Networks10.1016/j.neunet.2025.107193185(107193)Online publication date: May-2025
  • (2024)Contrastive and view-interaction structure learning for multi-view clusteringProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/559(5055-5063)Online publication date: 3-Aug-2024
  • (2024)Hubness-Enabled Clustering and Recovery for Large-Scale Incomplete Multi-View DataACM Transactions on Knowledge Discovery from Data10.1145/369468919:1(1-23)Online publication date: 4-Sep-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '23: Proceedings of the 31st ACM International Conference on Multimedia
October 2023
9913 pages
ISBN:9798400701085
DOI:10.1145/3581783
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. fast clustering
  2. graph regularization
  3. incomplete multi-view clustering
  4. structured consensus representation

Qualifiers

  • Research-article

Funding Sources

  • Chinese Association for Artificial Intelligence (CAAI)-Huawei MindSpore Open Fund
  • Shenzhen Science and Technology Program

Conference

MM '23
Sponsor:
MM '23: The 31st ACM International Conference on Multimedia
October 29 - November 3, 2023
Ottawa ON, Canada

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)178
  • Downloads (Last 6 weeks)18
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)UNAGI: Unified neighbor-aware graph neural network for multi-view clusteringNeural Networks10.1016/j.neunet.2025.107193185(107193)Online publication date: May-2025
  • (2024)Contrastive and view-interaction structure learning for multi-view clusteringProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/559(5055-5063)Online publication date: 3-Aug-2024
  • (2024)Hubness-Enabled Clustering and Recovery for Large-Scale Incomplete Multi-View DataACM Transactions on Knowledge Discovery from Data10.1145/369468919:1(1-23)Online publication date: 4-Sep-2024
  • (2024)Enhanced Tensorial Self-representation Subspace Learning for Incomplete Multi-view ClusteringProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681573(719-728)Online publication date: 28-Oct-2024
  • (2024)CoMO-NAS: Core-Structures-Guided Multi-Objective Neural Architecture Search for Multi-Modal ClassificationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681351(9126-9135)Online publication date: 28-Oct-2024
  • (2024)Adaptive Neighbor Guided View Reconstruction for Incomplete Multiview Clustering2024 IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA)10.1109/ISPA63168.2024.00317(2252-2253)Online publication date: 30-Oct-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media