skip to main content
10.1145/3503161.3548248acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Learning Smooth Representation for Multi-view Subspace Clustering

Published: 10 October 2022 Publication History

Abstract

Multi-view subspace clustering aims to exploit data correlation consensus among multiple views, which essentially can be treated as graph-based approach. However, existing methods usually suffer from suboptimal solution as the raw data might not be separable into subspaces. In this paper, we propose to achieve a smooth representation for each view and thus facilitate the downstream clustering task. It is based on a assumption that a graph signal is smooth if nearby nodes on the graph have similar features representations. Specifically, our mode is able to retain the graph geometric features by applying a low-pass filter to extract the smooth representations of multiple views. Besides, our method achieves the smooth representation learning as well as multi-view clustering interactively in a unified framework, hence it is an end-to-end single-stage learning problem. Substantial experiments on benchmark multi-view datasets are performed to validate the effectiveness of the proposed method, compared to the state-of-the-arts over the clustering performance.

Supplementary Material

MP4 File (MM22-fp2059.mp4)
In this paper, we propose to achieve a smooth representation for each view and further facilitate the end-to-end clustering task. Our mode is able to retain the graph geometric features by applying a low-pass filter to extract the smooth representations of multiple views. Considering that the raw real-world data might not be separable into subspaces, we incorporate the smooth representation learning into multi-view subspace clustering to boost the clustering performance. The complementary and compatible information among multiple smooth representations are further fused in partition space by pursuing a consensus indicator matrix. As a result, the proposed method is able to achieve the subtasks including smooth representation learning, affinity graphs construction, and the indicator matrix coalescing interactively in a unified framework. Substantial experiments have revealed the effectiveness of the proposed model.

References

[1]
James C Bezdek and Richard J Hathaway. 2003. Convergence of alternating optimization. Neural, Parallel & Scientific Computations 11, 4 (2003), 351--368.
[2]
Steffen Bickel and Tobias Scheffer. 2004. Multi-view clustering. In ICDM, Vol. 4. Citeseer, 19--26.
[3]
Xiaochun Cao, Changqing Zhang, Huazhu Fu, Si Liu, and Hua Zhang. 2015. Diversity-induced multi-view subspace clustering. In Proceedings of the 28th IEEE Conference on Computer Vision and Pattern Recognition. 586--594.
[4]
Jonathan Chang and David Blei. 2009. Relational topic models for document networks. In Artificial intelligence and statistics. PMLR, 81--88.
[5]
Man-Sheng Chen, Ling Huang, Chang-Dong Wang, and Dong Huang. 2020. Multi-view clustering in latent embedding space. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 3513--3520.
[6]
Peng Chen, Liang Liu, Zhengrui Ma, and Zhao Kang. 2021. Smoothed Multiview Subspace Clustering. In International Conference on Neural Computing for Advanced Applications. Springer, 128--140.
[7]
Fan RK Chung and Fan Chung Graham. 1997. Spectral graph theory. Number 92. American Mathematical Soc.
[8]
Ehsan Elhamifar and René Vidal. 2009. Sparse subspace clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2790--2797.
[9]
Hongchang Gao, Feiping Nie, Xuelong Li, and Heng Huang. 2015. Multi-view subspace clustering. In Proceedings of IEEE International Conference on Computer Vision. 4238--4246.
[10]
Derek Greene and Pádraig Cunningham. 2009. A matrix factorization approach for integrating multiple data views. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 423--438.
[11]
Ting Guo, Shirui Pan, Xingquan Zhu, and Chengqi Zhang. 2018. CFOND: consensus factorization for co-clustering networked data. IEEE Transactions on Knowledge and Data Engineering 31, 4 (2018), 706--719.
[12]
Jin Huang, Feiping Nie, and Heng Huang. 2013. Spectral rotation versus kmeans in spectral clustering. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 27. 431--437.
[13]
Shudong Huang, Zhao Kang, IvorWTsang, and Zenglin Xu. 2019. Auto-weighted multi-view clustering via kernelized graph learning. Pattern Recognition 88 (2019), 174--184.
[14]
Shudong Huang, Ivor Tsang, Zenglin Xu, and Jian Cheng Lv. 2021. Measuring Diversity in Graph Learning: A Unified Framework for Structured Multi-view Clustering. IEEE Transactions on Knowledge and Data Engineering (2021).
[15]
Shudong Huang, IvorWTsang, Zenglin Xu, Jiancheng Lv, and Quanhui Liu. 2021. CDD: Multi-view Subspace Clustering via Cross-view Diversity Detection. In Proceedings of the 29th ACM International Conference on Multimedia. 2308--2316.
[16]
Shudong Huang, HongjunWang, Tao Li, Tianrui Li, and Zenglin Xu. 2018. Robust graph regularized nonnegative matrix factorization for clustering. Data Mining and Knowledge Discovery 32, 2 (2018), 483--503.
[17]
Shudong Huang, Zenglin Xu, IvorW. Tsang, and Zhao Kang. 2020. Auto-weighted multi-view co-clustering with bipartite graphs. Information Sciences 512 (2020).
[18]
Mark J Huiskes and Michael S Lew. 2008. The mir flickr retrieval evaluation. In Proceedings of the 1st ACM International Conference on Multimedia Information Retrieval. 39--43.
[19]
Anil K Jain. 2010. Data clustering: 50 years beyond K-means. Pattern recognition letters 31, 8 (2010), 651--666.
[20]
Zhao Kang, Zipeng Guo, Shudong Huang, SiyingWang,Wenyu Chen, Yuanzhang Su, and Zenglin Xu. 2019. Multiple partitions aligned clustering. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2701--2707.
[21]
Zhao Kang,Wangtao Zhou, Zhitong Zhao, Junming Shao, Meng Han, and Zenglin Xu. 2020. Large-Scale multi-viewsubspace clustering in linear time. In Proceedings of 34th AAAI Conference on Artificial Intelligence. 4412--4419.
[22]
Abhishek Kumar and Hal Daumé. 2011. A co-training approach for multi-view spectral clustering. In Proceedings of IEEE International Conference on Machine Learning. 393--400.
[23]
Abhishek Kumar, Piyush Rai, and Hal Daume. 2012. Co-regularized multi-view spectral clustering. In Advances in Neural Information Processing Systems. 1413-- 1421.
[24]
Guangcan Liu, Zhao Zhang, Qingshan Liu, and Hongkai Xiong. 2019. Robust subspace clustering with compressed data. IEEE Transactions on Image Processing 28, 10 (2019), 5161--5170.
[25]
Andrew Y Ng, Michael I Jordan, and Yair Weiss. 2002. On spectral clustering: Analysis and an algorithm. In Advances in Neural Information Processing Systems. 849--856.
[26]
Feiping Nie, Guohao Cai, and Xuelong Li. 2017. Multi-View Clustering and Semi-Supervised Classification with Adaptive Neighbours. In Proceedings of 31st AAAI Conference on Artificial Intelligence. 2408--2414.
[27]
Feiping Nie, Jing Li, and Xuelong Li. 2016. Parameter-free auto-weighted multiple graph learning: A framework for multiview clustering and semi-supervised classification. In Proceedings of the 25th International Joint Conference on Artificial Intelligence. 1881--1887.
[28]
Feiping Nie, Lai Tian, and Xuelong Li. 2018. Multiview clustering via adaptively weighted procrustes. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2022--2030.
[29]
Feiping Nie, Xiaoqian Wang, and Heng Huang. 2014. Clustering and projected clustering with adaptive neighbors. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 977--986.
[30]
Shirui Pan, Ruiqi Hu, Guodong Long, Jing Jiang, Lina Yao, and Chengqi Zhang. 2018. Adversarially regularized graph autoencoder for graph embedding. arXiv preprint arXiv:1802.04407 (2018).
[31]
Satu Elisa Schaeffer. 2007. Graph clustering. Computer science review 1, 1 (2007), 27--64.
[32]
Peter H Schönemann. 1966. A generalized solution of the orthogonal procrustes problem. Psychometrika 31, 1 (1966), 1--10.
[33]
David I Shuman, Sunil K Narang, Pascal Frossard, Antonio Ortega, and Pierre Vandergheynst. 2013. The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains. IEEE signal processing magazine 30, 3 (2013), 83--98.
[34]
Gabriel Taubin. 1995. A signal processing approach to fair surface design. In Proceedings of the 22nd annual conference on Computer graphics and interactive techniques. 351--358.
[35]
Qianqian Wang, Zhengming Ding, Zhiqiang Tao, Quanxue Gao, and Yun Fu. 2021. Generative partial multi-view clustering with adaptive fusion and cycle consistency. IEEE Transactions on Image Processing 30 (2021), 1771--1783.
[36]
SiweiWang, Xinwang Liu, En Zhu, Chang Tang, Jiyuan Liu, Jingtao Hu, Jingyuan Xia, and Jianping Yin. 2019. Multi-view Clustering via Late Fusion Alignment Maximization. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. 3778--3784.
[37]
SiweiWang, Xinwang Liu, Xinzhong Zhu, Pei Zhang, Yi Zhang, Feng Gao, and En Zhu. 2022. Fast Parameter-Free Multi-View Subspace Clustering With Consensus Anchor Guidance. IEEE Trans. Image Process. 31 (2022), 556--568.
[38]
Zaiwen Wen and Wotao Yin. 2013. A feasible method for optimization with orthogonality constraints. Mathematical Programming 142, 1--2 (2013), 397--434.
[39]
Zhiqiang Xu, Yiping Ke, Yi Wang, Hong Cheng, and James Cheng. 2012. A model-based approach to attributed graph clustering. In Proceedings of the 2012 ACM SIGMOD international conference on management of data. 505--516.
[40]
Ming Yin, Shengli Xie, Zongze Wu, Yun Zhang, and Junbin Gao. 2018. Subspace clustering via learning an adaptive low-rank graph. IEEE Transactions on Image Processing 27, 8 (2018), 3716--3728.
[41]
Kun Zhan, Feiping Nie, Jing Wang, and Yi Yang. 2019. Multiview Consensus Graph Clustering. IEEE Transactions on Image Processing 28, 3 (2019), 1261--1270.
[42]
Kun Zhan, Changqing Zhang, Junpeng Guan, and Junsheng Wang. 2018. Graph Learning for Multiview Clustering. IEEE Transactions on Cybernetics (2018), 2887--28959.
[43]
Changqing Zhang, Qinghua Hu, Huazhu Fu, Pengfei Zhu, and Xiaochun Cao. 2017. Latent Multi-view Subspace Clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4333--4341.
[44]
Xiaotong Zhang, Han Liu, Qimai Li, and Xiao-Ming Wu. 2019. Attributed graph clustering via adaptive graph convolution. In Proceedings of the 28th International Conference on International Joint Conferences on Artificial Intelligence. 1--7.
[45]
Linlin Zong, Xianchao Zhang, Xinyue Liu, and Hong Yu. 2018. Weighted multiview spectral clustering based on spectral perturbation. In Proceedings of 32nd AAAI Conference on Artificial Intelligence. 4621--4628.

Cited By

View all
  • (2025)Low-rank multi-view subspace clustering via adaptive weightIntelligent Data Analysis: An International Journal10.1177/1088467X251314322Online publication date: 16-Feb-2025
  • (2025)UNAGI: Unified neighbor-aware graph neural network for multi-view clusteringNeural Networks10.1016/j.neunet.2025.107193185(107193)Online publication date: May-2025
  • (2024)Scalable Multi-view Unsupervised Feature Selection with Structure Learning and FusionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681223(5479-5488)Online publication date: 28-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '22: Proceedings of the 30th ACM International Conference on Multimedia
October 2022
7537 pages
ISBN:9781450392037
DOI:10.1145/3503161
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. clustering
  2. graph filtering
  3. multi-view learning
  4. subspace learning

Qualifiers

  • Research-article

Funding Sources

  • National Science Foundation of China

Conference

MM '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)107
  • Downloads (Last 6 weeks)6
Reflects downloads up to 28 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Low-rank multi-view subspace clustering via adaptive weightIntelligent Data Analysis: An International Journal10.1177/1088467X251314322Online publication date: 16-Feb-2025
  • (2025)UNAGI: Unified neighbor-aware graph neural network for multi-view clusteringNeural Networks10.1016/j.neunet.2025.107193185(107193)Online publication date: May-2025
  • (2024)Scalable Multi-view Unsupervised Feature Selection with Structure Learning and FusionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681223(5479-5488)Online publication date: 28-Oct-2024
  • (2024)Multi-view Subspace Clustering via An Adaptive Consensus Graph FilterProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3658009(776-784)Online publication date: 30-May-2024
  • (2024)Euclidean Distance is Not Your Swiss Army KnifeIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.342451136:12(8179-8191)Online publication date: Dec-2024
  • (2024)Symmetric Multi-View Subspace Clustering With Automatic Neighbor DiscoveryIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.339314834:9(8766-8778)Online publication date: Sep-2024
  • (2024)Tensor-Based Adaptive Consensus Graph Learning for Multi-View ClusteringIEEE Transactions on Consumer Electronics10.1109/TCE.2024.337639770:2(4767-4784)Online publication date: May-2024
  • (2024)Higher Order Multiple Graph Filtering for Structured Graph LearningICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10446826(7095-7099)Online publication date: 14-Apr-2024
  • (2024)Incomplete multi-view clustering via confidence graph completion based tensor decompositionExpert Systems with Applications10.1016/j.eswa.2024.125151(125151)Online publication date: Aug-2024
  • (2023)MVCIR-net: Multi-view Clustering Information Reinforcement NetworkProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3613833(3609-3618)Online publication date: 26-Oct-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media