skip to main content
10.1145/3503161.3548144acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Bipartite Graph-based Discriminative Feature Learning for Multi-View Clustering

Published: 10 October 2022 Publication History

Abstract

Multi-view clustering is an important technique in machine learning research. Existing methods have improved in clustering performance, most of them learn graph structure depending on all samples, which are high complexity. Bipartite graph-based multi-view clustering can obtain clustering result by establishing the relationship between the sample points and small anchor points, which improve the efficiency of clustering. Most bipartite graph-based clustering methods only focus on topological graph structure learning depending on sample nodes, ignore the influence of node features. In this paper, we propose bipartite graph-based discriminative feature learning for multi-view clustering, which combines bipartite graph learning and discriminative feature learning to a unified framework. Specifically, the bipartite graph learning is proposed via multi-view subspace representation with manifold regularization terms. Meanwhile, our feature learning utilizes data pseudo-labels obtained by fused bipartite graph to seek projection direction, which make the same label be closer and make data points with different labels be far away from each other. At last, the proposed manifold regularization terms establish the relationship between constructed bipartite graph and new data representation. By leveraging the interactions between structure learning and discriminative feature learning, we are able to select more informative features and capture more accurate structure of data for clustering. Extensive experimental results on different scale datasets demonstrate our method achieves better or comparable clustering performance than the results of state-of-the-art methods.

Supplementary Material

MP4 File (MM22-fp1661.mp4)
Presentation video

References

[1]
Séverine Affeldt, Lazhar Labiod, and Mohamed Nadif. 2020. Spectral clustering via ensemble deep autoencoder learning (SC-EDAE). Pattern Recognition 108 (2020), 107522.
[2]
Steffen Bickel and Tobias Scheffer. 2004. Multi-view clustering. In ICDM, Vol. 4. 19--26.
[3]
Maria Brbi´c and Ivica Kopriva. 2018. Multi-view low-rank sparse subspace clustering. Pattern Recognition 73 (2018), 247--258.
[4]
Deng Cai, Xiaofei He, and Jiawei Han. 2007. SRDA: An efficient algorithm for large-scale discriminant analysis. IEEE transactions on knowledge and data engineering 20, 1 (2007), 1--12.
[5]
Xiaochun Cao, Changqing Zhang, Huazhu Fu, Si Liu, and Hua Zhang. 2015. Diversity-induced multi-view subspace clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE, 586--594.
[6]
Kamalika Chaudhuri, Sham M Kakade, Karen Livescu, and Karthik Sridharan. 2009. Multi-view clustering via canonical correlation analysis. In Proceedings of international conference on machine learning. 129--136.
[7]
Yongyong Chen, Xiaolin Xiao, and Yicong Zhou. 2020. Multi-view subspace clustering via simultaneously learning the representation tensor and affinity matrix. Pattern Recognition 106 (2020), 107441.
[8]
Xiao Dong, Lei Zhu, Xuemeng Song, Jingjing Li, and Zhiyong Cheng. 2019. Adaptive Collaborative Similarity Learning for Unsupervised Multi-view Feature Selection. In Proceedings of International Joint Conference on Artificial Intelligence. IEEE, 2064--2070.
[9]
Ruidong Fan, Tingjin Luo, Wenzhang Zhuge, Sheng Qiang, and Chenping Hou. 2020. Multi-view subspace learning via bidirectional sparsity. Pattern Recognition 108 (2020), 107524.
[10]
Menahem Friedman and Abraham Kandel. 1999. Introduction to pattern recognition: statistical, structural, neural and fuzzy logic approaches. Vol. 32. World Scientific Publishing Company.
[11]
Hongchang Gao, Feiping Nie, Xuelong Li, and Heng Huang. 2016. Multi-view Subspace Clustering. In 2015 IEEE International Conference on Computer Vision (ICCV).
[12]
Xiaofei He, Deng Cai, and Partha Niyogi. 2005. Laplacian score for feature selection. Advances in neural information processing systems, 18 (2005).
[13]
Zhao Kang, Zhiping Lin, Xiaofeng Zhu, and Wenbo Xu. 2021. Structured Graph Learning for Scalable Subspace Clustering: From Single View to Multiview. IEEE Transactions on Cybernetics (2021).
[14]
Zhao Kang, Xinjia Zhao, Chong Peng, Hongyuan Zhu, Joey Tianyi Zhou, Xi Peng, Wenyu Chen, and Zenglin Xu. 2020. Partition level multiview subspace clustering. Neural Networks 122 (2020), 279--288.
[15]
Zhao Kang, Wangtao Zhou, Zhitong Zhao, Junming Shao, Meng Han, and Zenglin Xu. 2020. Large-scale multi-view subspace clustering in linear time. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 4412--4419.
[16]
Svetlana Lazebnik, Cordelia Schmid, and Jean Ponce. 2006. Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. In Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on.
[17]
Chun-Guang Li and Rene Vidal. 2015. Structured sparse subspace clustering: A unified optimization framework. In Proceedings of the IEEE conference on computer vision and pattern recognition. 277--286.
[18]
Lusi Li and Haibo He. 2020. Bipartite graph based multi-view clustering. IEEE Transactions on Knowledge and Data Engineering (2020).
[19]
Ruihuang Li, Changqing Zhang, Qinghua Hu, Pengfei Zhu, and Zheng Wang. 2019. Flexible Multi-View Representation Learning for Subspace Clustering. In Proceedings of International Joint Conference on Artificial Intelligence. 2916--2922.
[20]
Xuelong Li, Han Zhang, Rong Wang, and Feiping Nie. 2020. Multi-view clustering: A scalable and parameter-free bipartite graph fusion method. IEEE Transactions on Pattern Analysis and Machine Intelligence (2020).
[21]
Yeqing Li, Feiping Nie, Heng Huang, and Junzhou Huang. 2015. Large-scale multi-view spectral clustering via bipartite graph. In Twenty-Ninth AAAI Conference on Artificial Intelligence.
[22]
Yingming Li, Ming Yang, and Zhongfei Zhang. 2018. A survey of multi-view representation learning. IEEE transactions on knowledge and data engineering 31, 10 (2018), 1863--1883.
[23]
Zhenglai Li, Chang Tang, Xinwang Liu, Xiao Zheng, Guanghui Yue, Wei Zhang, and En Zhu. 2021. Consensus Graph Learning for Multi-view Clustering. IEEE Transactions on Multimedia (2021).
[24]
Youwei Liang, Dong Huang, and Chang-Dong Wang. 2019. Consistency meets inconsistency: A unified graph learning framework for multi-view clustering. In 2019 IEEE International Conference on Data Mining (ICDM). IEEE, IEEE, 1204--1209.
[25]
Tyng-Luh Liu. 2017. Guided co-training for large-scale multi-view spectral clustering. arXiv preprint arXiv:1707.09866 (2017).
[26]
Yong Liu. 2021. Refined Learning Bounds for Kernel and Approximate k-Means. Advances in neural information processing systems (2021).
[27]
Shirui Luo, Changqing Zhang, Wei Zhang, and Xiaochun Cao. 2018. Consistent and specific multi-view subspace clustering. In Thirty-second AAAI conference on artificial intelligence.
[28]
Yanying Mei, Zhenwen Ren, Bin Wu, Yanhua Shao, and Tao Yang. 2021. Robust graph-based multi-view clustering in latent embedding space. International Journal of Machine Learning and Cybernetics (2021), 1--12.
[29]
Feiping Nie, Heng Huang, Xiao Cai, and Chris Ding. 2010. Efficient and robust feature selection via joint l2, 1-norms minimization. Advances in neural information processing systems 23 (2010).
[30]
Aditya Prakash, Kashyap Chitta, and Andreas Geiger. 2021. Multi-Modal Fusion Transformer for End-to-End Autonomous Driving. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE, 7077--7087.
[31]
Weixiang Shao, Lifang He, Chun-Ta Lu, Xiaokai Wei, and S Yu Philip. 2016. Online unsupervised multi-view feature selection. In Proceedings of IEEE international conference on data mining (ICDM). IEEE, 1203--1208.
[32]
Xiaomeng Si, Qiyue Yin, Xiaojie Zhao, and Li Yao. 2022. Consistent and diverse multi-View subspace clustering with structure constraint. Pattern Recognition 121 (2022), 108196.
[33]
Mengjing Sun, Pei Zhang, Siwei Wang, Sihang Zhou, Wenxuan Tu, Xinwang Liu, En Zhu, and Changjian Wang. 2021. Scalable Multi-view Subspace Clustering with Unified Anchors. In Proceedings of ACM International Conference on Multimedia. ACM, 3528--3536.
[34]
Shiliang Sun. 2013. A survey of multi-view machine learning. Neural computing and applications 23, 7 (2013), 2031--2038.
[35]
Chang Tang, Jiajia Chen, Xinwang Liu, Miaomiao Li, Pichao Wang, Minhui Wang, and Peng Lu. 2018. Consensus learning guided multi-view unsupervised feature selection. Knowledge-Based Systems 160 (2018), 49--60.
[36]
Chang Tang, Xiao Zheng, Xinwang Liu, Wei Zhang, Jing Zhang, Jian Xiong, and Lizhe Wang. 2021. Cross-view locality preserved diversity and consensus learning for multi-view unsupervised feature selection. IEEE Transactions on Knowledge and Data Engineering. (2021).
[37]
Chang Tang, Xinzhong Zhu, Xinwang Liu, Miaomiao Li, Pichao Wang, Changqing Zhang, and Lizhe Wang. 2018. Learning a joint affinity graph for multiview subspace clustering. IEEE Transactions on Multimedia 21, 7 (2018), 1724--1736.
[38]
Hao Wang, Yan Yang, and Bing Liu. 2019. GMC: Graph-based multi-view clustering. IEEE Transactions on Knowledge and Data Engineering 32, 6 (2019), 1116--1129.
[39]
Meng Wang, Weijie Fu, Shijie Hao, Dacheng Tao, and Xindong Wu. 2016. Scalable semi-supervised learning by efficient anchor graph regularization. IEEE Transactions on Knowledge and Data Engineering 28, 7 (2016), 1864--1877.
[40]
Rong Wang, Feiping Nie, Zhen Wang, Haojie Hu, and Xuelong Li. 2019. Parameter-free weighted multi-view projected clustering with structured graph learning. IEEE Transactions on Knowledge and Data Engineering 32, 10 (2019), 2014--2025.
[41]
Xiaobo Wang, Zhen Lei, Xiaojie Guo, Changqing Zhang, Hailin Shi, and Stan Z Li. 2019. Multi-view subspace clustering with intactness-aware similarity. Pattern Recognition 88 (2019), 50--63.
[42]
Yiming Wang, Dongxia Chang, Zhiqiang Fu, and Yao Zhao. 2021. Consistent Multiple Graph Embedding for Multi-View Clustering. arXiv preprint arXiv:2105.04880 (2021).
[43]
Yang Wang, Lin Wu, Xuemin Lin, and Junbin Gao. 2018. Multiview spectral clustering via structured low-rank matrix factorization. IEEE transactions on neural networks and learning systems 29, 10 (2018), 4833--4843.
[44]
Rongkai Xia, Yan Pan, Lei Du, and Jian Yin. 2014. Robust Multi-View Spectral Clustering via Low-Rank and Sparse Decomposition. In AAAI. 2149--2155.
[45]
Yan Yang and Hao Wang. 2018. Multi-view clustering: A survey. Big Data Mining and Analytics 1, 2 (2018), 83--107.
[46]
Zhiyong Yang, Qianqian Xu, Weigang Zhang, Xiaochun Cao, and Qingming Huang. 2019. Split multiplicative multi-view subspace clustering. IEEE Transactions on Image Processing 28, 10 (2019), 5147--5160.
[47]
Wan Yuan, Sun Shengzi, and Cheng Zeng. 2021. Adaptive Similarity Embedding for Unsupervised Multi-View Feature Selection. IEEE Transactions on Knowledge and Data Engineering 33, 10 (oct 2021), 3338--3350.
[48]
Kun Zhan, Chaoxi Niu, Changlu Chen, Feiping Nie, Changqing Zhang, and Yi Yang. 2018. Graph structure fusion for multiview clustering. IEEE Transactions on Knowledge and Data Engineering 31, 10 (2018), 1984--1993.
[49]
Kun Zhan, Changqing Zhang, Junpeng Guan, and Junsheng Wang. 2017. Graph learning for multiview clustering. IEEE transactions on cybernetics 48, 10 (2017), 2887--2895.
[50]
Changqing Zhang, Huazhu Fu, Qinghua Hu, Xiaochun Cao, Yuan Xie, Dacheng Tao, and Dong Xu. 2018. Generalized latent multi-view subspace clustering. IEEE transactions on pattern analysis and machine intelligence 42, 1 (2018), 86--99.
[51]
Guangyu Zhang, Yuren Zhou, Changdong Wang, Dong Huang, and Xiaoyu He. 2021. Joint representation learning for multi-view subspace clustering. Expert Systems with Applications 166 (2021), 113913.
[52]
Rui Zhang, Feiping Nie, Xuelong Li, and Xian Wei. 2019. Feature selection with multi-view data: A survey. Information Fusion 50 (2019), 158--167.
[53]
Qinghai Zheng, Jihua Zhu, Yuanyuan Ma, Zhongyu Li, and Zhiqiang Tian. 2021. Multi-view subspace clustering networks with local and global graph information. Neurocomputing 449 (2021), 15--23.
[54]
Wencheng Zhu, Jiwen Lu, and Jie Zhou. 2019. Structured general and specific multi-view subspace clustering. Pattern Recognition 93 (2019), 392--403.

Cited By

View all
  • (2025)Clustering dynamic networks by discriminating roles of vertices and capturing temporality with subsequent feature projectionKnowledge-Based Systems10.1016/j.knosys.2024.112660305:COnline publication date: 18-Feb-2025
  • (2024)Scalable Multi-view Unsupervised Feature Selection with Structure Learning and FusionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681223(5479-5488)Online publication date: 28-Oct-2024
  • (2024)Fast Continual Multi-View Clustering With Incomplete ViewsIEEE Transactions on Image Processing10.1109/TIP.2024.338897433(2995-3008)Online publication date: 19-Apr-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '22: Proceedings of the 30th ACM International Conference on Multimedia
October 2022
7537 pages
ISBN:9781450392037
DOI:10.1145/3503161
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. feature selection
  2. multi-view clustering
  3. subspace clustering

Qualifiers

  • Research-article

Funding Sources

  • Natural Science Foundation of Shan- dong Province
  • Guangdong Basic and Applied Basic Research Foundation
  • Natural Science Foundation of China

Conference

MM '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)96
  • Downloads (Last 6 weeks)9
Reflects downloads up to 08 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Clustering dynamic networks by discriminating roles of vertices and capturing temporality with subsequent feature projectionKnowledge-Based Systems10.1016/j.knosys.2024.112660305:COnline publication date: 18-Feb-2025
  • (2024)Scalable Multi-view Unsupervised Feature Selection with Structure Learning and FusionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681223(5479-5488)Online publication date: 28-Oct-2024
  • (2024)Fast Continual Multi-View Clustering With Incomplete ViewsIEEE Transactions on Image Processing10.1109/TIP.2024.338897433(2995-3008)Online publication date: 19-Apr-2024
  • (2024)Diversity-Induced Bipartite Graph Fusion for Multiview Graph ClusteringIEEE Transactions on Emerging Topics in Computational Intelligence10.1109/TETCI.2024.33693168:3(2592-2601)Online publication date: Jun-2024
  • (2024)Differentiated Anchor Quantity Assisted Incomplete Multiview Clustering Without Number-TuningIEEE Transactions on Cybernetics10.1109/TCYB.2024.344319854:11(7024-7037)Online publication date: Nov-2024
  • (2024)Prior Indicator Guided Anchor Learning for Multi-View Subspace ClusteringIEEE Transactions on Consumer Electronics10.1109/TCE.2023.331901870:1(144-154)Online publication date: 1-Feb-2024
  • (2024)Learn from View Correlation: An Anchor Enhancement Strategy for Multi-View Clustering2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.02471(26151-26161)Online publication date: 16-Jun-2024
  • (2024)Multi-view Stable Feature Selection with Adaptive Optimization of View WeightsKnowledge-Based Systems10.1016/j.knosys.2024.111970299:COnline publication date: 5-Sep-2024
  • (2024)Discrete correntropy-based multi-view anchor-graph clusteringInformation Fusion10.1016/j.inffus.2023.102097103:COnline publication date: 1-Mar-2024
  • (2024)Efficient Discriminative Feature Selection with Grouping Relative ComparisonPattern Recognition and Computer Vision10.1007/978-981-97-8795-1_6(81-96)Online publication date: 18-Oct-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media