skip to main content
10.1145/3581783.3612483acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Distribution Consistency based Fast Anchor Imputation for Incomplete Multi-view Clustering

Published: 27 October 2023 Publication History

Abstract

In practical scenarios, partial missing of multi-view data is very common, such as register information missing from social network analysis, which results in incomplete multi-view clustering (IMVC). How to fill missing data fast and efficiently plays a vital role in improving IMVC, carrying a significant challenge. Existing IMVC methods always use all observed data to fill in missing data, resulting in high complexity and poor imputation quality due to a lack of guidance from consistent distribution. To break the existing limitations, we propose a novel Distribution Consistency based Fast Anchor Imputation for Incomplete Multi-view Clustering (DCFAI-IMVC) method. Specifically, to eliminate the interference of redundant and fraudulent features in the original space, incomplete data are first projected into a consensus latent space, where we dynamically learn a small number of anchors to achieve fast and good imputation. Then, we employ global distribution information of the observed embedding representations to further ensure the consistent distribution between the learned anchors and the observed embedding representations. Ultimately, a tensor low-rank constraint is imposed on bipartite graphs to investigate the high-order correlations hidden in data. DCFAI-IMVC enjoys linear complexity in terms of sample number, which gives it great potential to handle large-scale IMVC tasks. By performing extensive experiments, our effectiveness, superiority, and efficiency are all validated on multiple public datasets with recent advances.

Supplemental Material

MP4 File
In practical scenarios, partial missing of multi-view data is very common, such as register information missing from social network analysis, which results in incomplete multi-view clustering (IMVC). Existing IMVC methods always use all observed data to fill in missing data, resulting in high complexity and poor imputation quality due to a lack of guidance from consistent distribution. To break the existing limitations, we propose a novel Distribution Consistency based Fast Anchor Imputation for Incomplete Multi-view Clustering (DCFAI-IMVC) method.

References

[1]
Mansheng Chen, Tuo Liu, Chang-Dong Wang, Dong Huang, and Jian-Huang Lai. 2022a. Adaptively-weighted Integral Space for Fast Multiview Clustering. In The 30th ACM International Conference on Multimedia. 3774--3782.
[2]
Man-Sheng Chen, Chang-Dong Wang, Dong Huang, Jian-Huang Lai, and Philip S Yu. 2022c. Efficient Orthogonal Multi-view Subspace Clustering. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 127--135.
[3]
Man-Sheng Chen, Chang-Dong Wang, and Jian-Huang Lai. 2022b. Low-rank Tensor Based Proximity Learning for Multi-view Clustering. IEEE Transactions on Knowledge and Data Engineering (2022).
[4]
Zhe Chen, Xiao-Jun Wu, Tianyang Xu, and Josef Kittler. 2023 c. Fast Self-guided Multi-view Subspace Clustering. IEEE Transactions on Image Processing (2023).
[5]
Zhaoliang Chen, Zhihao Wu, Zhenghong Lin, Shiping Wang, Claudia Plant, and Wenzhong Guo. 2023 a. AGNN: Alternating Graph-Regularized Neural Networks to Alleviate Over-Smoothing. IEEE Transactions on Neural Networks and Learning Systems (2023), 1--13. https://doi.org/10.1109/TNNLS.2023.3271623
[6]
Zhaoliang Chen, Zhihao Wu, Shiping Wang, and Wenzhong Guo. 2023 b. Dual Low-Rank Graph Autoencoder for Semantic and Topological Networks. In Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, Vol. 37. 4191--4198.
[7]
Shijie Deng, Jie Wen, Chengliang Liu, Ke Yan, Gehui Xu, and Yong Xu. 2023. Projective Incomplete Multi-View Clustering. IEEE Transactions on Neural Networks and Learning Systems (2023).
[8]
Zhiqiang Fu, Yao Zhao, Dongxia Chang, Yiming Wang, and Jie Wen. 2022. Latent Low-Rank Representation With Weighted Distance Penalty for Clustering. IEEE Transactions on Cybernetics (2022).
[9]
Jun Guo and Jiahui Ye. 2019. Anchors bring ease: An embarrassingly simple approach to partial multi-view clustering. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 118--125.
[10]
Wenjue He, Zheng Zhang, Yongyong Chen, and Jie Wen. 2023. Structured anchor-inferred graph learning for universal incomplete multi-view clustering. World Wide Web, Vol. 26, 1 (2023), 375--399.
[11]
Menglei Hu and Songcan Chen. 2019. Doubly aligned incomplete multi-view clustering. Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-19 (2019), 2262--2268.
[12]
Zhao Kang, Wangtao Zhou, Zhitong Zhao, Junming Shao, Meng Han, and Zenglin Xu. 2020. Large-scale multi-view subspace clustering in linear time. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 4412--4419.
[13]
Liang Li, Siwei Wang, Xinwang Liu, En Zhu, Li Shen, Kenli Li, and Keqin Li. 2022b. Local Sample-Weighted Multiple Kernel Clustering With Consensus Discriminative Graph. IEEE Transactions on Neural Networks and Learning Systems (2022), 1--14.
[14]
Liang Li, Junpu Zhang, Siwei Wang, Xinwang Liu, Kenli Li, and Keqin Li. 2023 d. Multi-View Bipartite Graph Clustering With Coupled Noisy Feature Filter. IEEE Transactions on Knowledge and Data Engineering (2023), 1--13.
[15]
Xingfeng Li, Zhenwen Ren, Quansen Sun, and Zhi Xu. 2023 a. Auto-weighted tensor schatten p-norm for robust multi-view graph clustering. Pattern Recognition, Vol. 134 (2023), 109083.
[16]
Xingfeng Li, Yinghui Sun, Quansen Sun, and Zhenwen Ren. 2023 b. Consensus Cluster Center Guided Latent Multi-Kernel Clustering. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 33, 6 (2023), 2864--2876. https://doi.org/10.1109/TCSVT.2022.3229356
[17]
Xingfeng Li, Yinghui Sun, Quansen Sun, Zhenwen Ren, and Yuan Sun. 2023 c. Cross-view Graph Matching guided Anchor Alignment for incomplete multi-view clustering. Information Fusion (2023), 101941.
[18]
Zhenglai Li, Chang Tang, Xiao Zheng, Xinwang Liu, Wei Zhang, and En Zhu. 2022a. High-order correlation preserved incomplete multi-view subspace clustering. IEEE Transactions on Image Processing, Vol. 31 (2022), 2067--2080.
[19]
Jiyuan Liu, Xinwang Liu, Yi Zhang, Pei Zhang, Wenxuan Tu, Siwei Wang, Sihang Zhou, Weixuan Liang, Siqi Wang, and Yuexiang Yang. 2021b. Self-representation Subspace Clustering for Incomplete Multi-view Data. In Proceedings of the 29th ACM International Conference on Multimedia. 2726--2734.
[20]
Xinwang Liu, Miaomiao Li, Chang Tang, Jingyuan Xia, Jian Xiong, Li Liu, Marius Kloft, and En Zhu. 2020. Efficient and effective regularized incomplete multi-view clustering. IEEE transactions on pattern analysis and machine intelligence, Vol. 43, 8 (2020), 2634--2646.
[21]
Xinwang Liu, Li Liu, Qing Liao, Siwei Wang, Yi Zhang, Wenxuan Tu, Chang Tang, Jiyuan Liu, and En Zhu. 2021a. One pass late fusion multi-view clustering. In International Conference on Machine Learning. PMLR, 6850--6859.
[22]
Xinwang Liu, Xinzhong Zhu, Miaomiao Li, Lei Wang, En Zhu, Tongliang Liu, Marius Kloft, Dinggang Shen, Jianping Yin, and Wen Gao. 2019. Multiple kernel k k-means with incomplete kernels. IEEE transactions on pattern analysis and machine intelligence, Vol. 42, 5 (2019), 1191--1204.
[23]
Feiping Nie, Jing Li, Xuelong Li, et al. 2017a. Self-weighted Multiview Clustering with Multiple Graphs. In IJCAI. 2564--2570.
[24]
Feiping Nie, Xiaoqian Wang, Cheng Deng, and Heng Huang. 2017b. Learning a structured optimal bipartite graph for co-clustering. In Advances in Neural Information Processing Systems. 4129--4138.
[25]
Zhenwen Ren, Quansen Sun, and Dong Wei. 2021. Multiple kernel clustering with kernel k-means coupled graph tensor learning. In Proceedings of the AAAI conference on artificial intelligence, Vol. 35. 9411--9418.
[26]
Zhenwen Ren, Simon X Yang, Quansen Sun, and Tao Wang. 2020. Consensus affinity graph learning for multiple kernel clustering. IEEE Transactions on Cybernetics, Vol. 51, 6 (2020), 3273--3284.
[27]
Weixiang Shao, Lifang He, and Philip S Yu. 2015. Multiple incomplete views clustering via weighted nonnegative matrix factorization with L2,1 regularization. In Joint European conference on machine learning and knowledge discovery in databases. Springer, 318--334.
[28]
Yuan Sun, Dezhong Peng, Haixiao Huang, and Zhenwen Ren. 2022. Feature and semantic views consensus hashing for image set classification. In Proceedings of the 30th ACM International conference on multimedia. 2097--2105.
[29]
Yuan Sun, Zhenwen Ren, Peng Hu, Dezhong Peng, and Xu Wang. 2023 a. Hierarchical Consensus Hashing for Cross-Modal Retrieval. IEEE Transactions on Multimedia (2023), 1--14. https://doi.org/10.1109/TMM.2023.3272169
[30]
Yuan Sun, Xu Wang, Dezhong Peng, Zhenwen Ren, and Xiaobo Shen. 2023 b. Hierarchical hashing learning for image set classification. IEEE Transactions on Image Processing, Vol. 32 (2023), 1732--1744.
[31]
Siwei Wang, Xinwang Liu, Li Liu, Wenxuan Tu, Xinzhong Zhu, Jiyuan Liu, Sihang Zhou, and En Zhu. 2022b. Highly-efficient incomplete large-scale multi-view clustering with consensus bipartite graph. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 9776--9785.
[32]
Siwei Wang, Xinwang Liu, Suyuan Liu, Jiaqi Jin, Wenxuan Tu, Xinzhong Zhu, and En Zhu. 2022a. Align then fusion: Generalized large-scale multi-view clustering with anchor matching correspondences. arXiv preprint arXiv:2205.15075 (2022).
[33]
Jie Wen, Huijie Sun, Lunke Fei, Jinxing Li, Zheng Zhang, and Bob Zhang. 2021a. Consensus guided incomplete multi-view spectral clustering. Neural Networks, Vol. 133 (2021), 207--219.
[34]
Jie Wen, Yong Xu, and Hong Liu. 2020a. Incomplete Multiview Spectral Clustering With Adaptive Graph Learning. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 50, 4 (2020), 1418--1429.
[35]
Jie Wen, Zheng Zhang, Lunke Fei, Bob Zhang, Yong Xu, Zhao Zhang, and Jinxing Li. 2022. A Survey on Incomplete Multiview Clustering. IEEE Transactions on Systems, Man, and Cybernetics: Systems (2022).
[36]
Jie Wen, Zheng Zhang, Yong Xu, Bob Zhang, Lunke Fei, and Hong Liu. 2019. Unified embedding alignment with missing views inferring for incomplete multi-view clustering. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 5393--5400.
[37]
Jie Wen, Zheng Zhang, Zhao Zhang, Lunke Fei, and Meng Wang. 2020b. Generalized incomplete multiview clustering with flexible locality structure diffusion. IEEE transactions on cybernetics, Vol. 51, 1 (2020), 101--114.
[38]
Jie Wen, Zheng Zhang, Zhao Zhang, Lei Zhu, Lunke Fei, Bob Zhang, and Yong Xu. 2021b. Unified tensor framework for incomplete multi-view clustering and missing-view inferring. In Proc. of the 35th AAAI Conference on Artificial Intelligence, Online: AAAI Press. 10273--10281.
[39]
Wei Xia, Quanxue Gao, Qianqian Wang, Xinbo Gao, Chris Ding, and Dacheng Tao. 2022. Tensorized bipartite graph learning for multi-view clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence (2022).
[40]
Yuan Xie, Dacheng Tao, Wensheng Zhang, Yan Liu, Lei Zhang, and Yanyun Qu. 2018. On unifying multi-view self-representations for clustering by tensor multi-rank minimization. International Journal of Computer Vision, Vol. 126, 11 (2018), 1157--1179.
[41]
Weiqing Yan, Jindong Xu, Jinglei Liu, Guanghui Yue, and Chang Tang. 2022. Bipartite graph-based discriminative feature learning for multi-view clustering. In Proceedings of the 30th ACM International Conference on Multimedia. 3403--3411.
[42]
Mouxing Yang, Yunfan Li, Peng Hu, Jinfeng Bai, Jiancheng Lv, and Xi Peng. 2022a. Robust multi-view clustering with incomplete information. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, 1 (2022), 1055--1069.
[43]
Xihong Yang, Yue Liu, Sihang Zhou, Xinwang Liu, and En Zhu. 2022b. Mixed Graph Contrastive Network for Semi-Supervised Node Classification. arXiv preprint arXiv:2206.02796 (2022).
[44]
Xihong Yang, Yue Liu, Sihang Zhou, Siwei Wang, Xinwang Liu, and En Zhu. 2022c. Contrastive Deep Graph Clustering with Learnable Augmentation. arXiv preprint arXiv:2212.03559 (2022).
[45]
Xihong Yang, Yue Liu, Sihang Zhou, Siwei Wang, Wenxuan Tu, Qun Zheng, Xinwang Liu, Liming Fang, and En Zhu. 2023. Cluster-guided Contrastive Graph Clustering Network. In Proceedings of the AAAI conference on artificial intelligence, Vol. 37. 10834--10842.
[46]
Junpu Zhang, Liang Li, Siwei Wang, Jiyuan Liu, Yue Liu, Xinwang Liu, and En Zhu. 2022. Multiple Kernel Clustering with Dual Noise Minimization. In Proceedings of the 30th ACM International Conference on Multimedia. 3440--3450.

Cited By

View all
  • (2024)Reliable Attribute-missing Multi-view Clustering with Instance-level and feature-level Cooperative ImputationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680997(1456-1466)Online publication date: 28-Oct-2024
  • (2024)Confidence Graph Learning for Incomplete Multi-View ClusteringProceedings of the International Conference on Computer Vision and Deep Learning10.1145/3653804.3654722(1-5)Online publication date: 19-Jan-2024

Index Terms

  1. Distribution Consistency based Fast Anchor Imputation for Incomplete Multi-view Clustering

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '23: Proceedings of the 31st ACM International Conference on Multimedia
    October 2023
    9913 pages
    ISBN:9798400701085
    DOI:10.1145/3581783
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 October 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. anchor learning
    2. distribution consistency
    3. incomplete multi-view clustering
    4. missing data imputation

    Qualifiers

    • Research-article

    Funding Sources

    • Grant from Guangxi Key Laboratory of Machine Vision and Intelligent Control
    • Postgraduate Research & Practice Innovation Program of Jiangsu Province
    • National Natural Science Foundation of China
    • Open Research Fund of Anhui Province Key Laboratory of Machine Vision Inspection
    • Base Strengthening Program of National Defense Science and Technology

    Conference

    MM '23
    Sponsor:
    MM '23: The 31st ACM International Conference on Multimedia
    October 29 - November 3, 2023
    Ottawa ON, Canada

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)122
    • Downloads (Last 6 weeks)9
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Reliable Attribute-missing Multi-view Clustering with Instance-level and feature-level Cooperative ImputationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680997(1456-1466)Online publication date: 28-Oct-2024
    • (2024)Confidence Graph Learning for Incomplete Multi-View ClusteringProceedings of the International Conference on Computer Vision and Deep Learning10.1145/3653804.3654722(1-5)Online publication date: 19-Jan-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media