skip to main content
10.1145/3301326.3301391acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicnccConference Proceedingsconference-collections
research-article

Deep Multi-view Sparse Subspace Clustering

Published: 14 December 2018 Publication History

Abstract

Most multi-view subspace clustering algorithms construct the affinity matrix with shallow features extracted from each view separately. The integration of multi-view features are left for extended spectral clustering algorithm. The lack of deep feature extraction and interaction across different views prevents the effective exploration of information complementary for multi-view datasets. To address this problem, this paper proposes a novel deep multi-view sparse subspace clustering (DMVSSC) model which consists of convolutional auto-encoders (CAEs) and CCA-based self-expressive module. The proposed model can not only extract deep features of each view data with few parameters but also integrate multi-view features based on CCA. Furthermore, a two-stage joint optimization strategy is proposed for tuning the whole model. Experiments on four benchmark data sets show that our proposed model significantly outperforms the state-of-the-art multi-view subspace clustering algorithms.

References

[1]
Zhao, J., Xie, X., Xu, X., and Sun, S. 2017. Multi-view learning overview. Inf. Fusion. 38, C (November 2017), 43--54.
[2]
Cao, X., Zhang, C., Fu, H., Liu, S. and Zhang H. 2015. Diversity-induced Multi-view Subspace Clustering. In IEEE Conference on Computer Vision and Pattern Recognition (Boston, MA, USA, June, 8--10, 2015), 586--594.
[3]
Luo, S., Zhang, C., Zhang, W., and Cao, X. 2018. Consistent and Specific Multi-View Subspace Clustering. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (New Orleans, Louisiana, USA, February 2--7, 2018). AAAI Press, 3730--3737.
[4]
Gao, H., Nie, F., Li, X., and Huang, H. 2015. Multi-view Subspace Clustering. In IEEE International Conference on Computer Vision (Santiago, Chile, December 13--16, 2015). IEEE. 4238--4246.
[5]
Peng. X., Xiao. S., Feng, J., Yau, W.Y., and Yi, Z. 2016 Deep subspace clustering with sparsity prior. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligenc (New York, New York, USA, July 09--15, 2016). AAAI Press. 1925--1931.
[6]
Ji, P., Zhang, T., Li, H., Salzmann, M., and Reid, I. D. 2017. Deep Subspace Clustering Networks. In Thirty-first Conference on Neural Information Processing Systems (Long Beach Convention Center, Long Beach, USA, December 04--09, 2017). Neural Information Processing Systems Foundation, Inc. 23--32.
[7]
Elhamifar, E. and Vidal, R. 013. Sparse Subspace Clustering: Algorithm, Theory, and Applications. IEEE Trans. Pattern Anal. Mach. Intell. 35, 11(Nov. 2013), 2765--2781.
[8]
Wang, Y., Wu, L., Lin, X., and Gao, J. 2018. Multiview Spectral Clustering via Structured Low-Rank Matrix Factorization. IEEE Trans Neural Netw Learn Syst. 29, 10(Oct. 2018). 4833--4843.
[9]
Wei X., Shen H., Kleinsteuber, M. 2016. Trace Quotient Meets Sparsity: A Method for Learning Low Dimensional Image Representations. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Las Vegas, NV, USA, June 26-July 1, 2016). IEEE. 5268--5277.
[10]
Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., and Manzagol, P.A. 2010. Stacked Denoising Auto-encoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion. J. Mach. Learn. Res., 11, Dec, 3371--3408.
[11]
Nair, V., and Hinton, G. E. 2010. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th International Conference on International Conference on Machine Learning (Haifa, Israel, June 21--24, 2010). Omnipress, USA 807--814.
[12]
F. F.Li., Fergus, R., and Perona, P. 2007. Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. Comput Vis Image Underst., 106, 1(April, 2007). 59--70.
[13]
Winn, J. and Jojic, N. 2005. Locus: Learning object classes with unsupervised segmentation. In IEEE International Conference on Computer Vision (Beijing, China, October 17--20, 2005). IEEE. 756--763.
[14]
Leibe, B., and Schiele, B. 2003. Analyzing appearance and contour based methods for object categorization. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Oregon, USA, June 25--27, 2013). IEEE, II-409.
[15]
Wu, J., and Rehg, J. M. 2011. Centrist: A visual descriptor for scene categorization. IEEE Trans. Pattern Anal. Mach. Intell., 33, 8(December, 2011). 1489--1501.
[16]
Yu, H., Li, M., Zhang, H., and Feng, J. 2002. Color texture moments for content-based image retrieval. In Proceedings. International Conference on Image Processing (Rochester, NY, USA, September 22--25, 2002). IEEE. 929--932.
[17]
Dalal, N., and Triggs, B. 2005. Histograms of oriented gradients for human detection. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Boston, Massachusetts, USA, June 8--10, 2005). IEEE, 886--893.
[18]
Wei, X., Li, Y., Shen, H., Xiang W., and Murphey, Y.L. 2017. Joint learning sparsifying linear transformation for low-resolution image synthesis and recognition. Pattern Recognition, 24, 7(July, 2002), 971--987.
[19]
Lowe, D. G. 2004. Distinctive Image Features from Scale-Invariant Keypoints. Int. J. Comput. Vision, 60, 2(November, 2004), 91--110.
[20]
Chaudhuri, K., Kakade, Livescu, S. M., K., and Sridharan, K. 2009. Multi-view clustering via canonical correlation analysis. In Proceedings of the 26th Annual International Conference on Machine Learning (Montreal, Quebec, Canada, June 14--18, 2009). ACM New York, NY, USA, 129--136.
[21]
M. Brbić, and I. Kopriva. 2018. Multi-view low-rank sparse subspace clustering. Pattern Recognit. 73, (January, 2018).

Cited By

View all
  • (2025)CSMDC: Exploring consistently context semantics for multi-view document clusteringExpert Systems with Applications10.1016/j.eswa.2024.125386261(125386)Online publication date: Feb-2025
  • (2024)Separable Consistency and Diversity Feature Learning for Multi-View ClusteringIEEE Signal Processing Letters10.1109/LSP.2024.340860631(1595-1599)Online publication date: 2024
  • (2024)Geometric-inspired graph-based Incomplete Multi-view ClusteringPattern Recognition10.1016/j.patcog.2023.110082147(110082)Online publication date: Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICNCC '18: Proceedings of the 2018 VII International Conference on Network, Communication and Computing
December 2018
372 pages
ISBN:9781450365536
DOI:10.1145/3301326
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 December 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Multi-view clustering
  2. canonical correlation analysis
  3. deep convolutional auto-encoder
  4. sparse subspace clustering

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • CAS Pioneer Hundred Talents Program (Type C)
  • National Science Found for Young Scholars

Conference

ICNCC 2018

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)18
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)CSMDC: Exploring consistently context semantics for multi-view document clusteringExpert Systems with Applications10.1016/j.eswa.2024.125386261(125386)Online publication date: Feb-2025
  • (2024)Separable Consistency and Diversity Feature Learning for Multi-View ClusteringIEEE Signal Processing Letters10.1109/LSP.2024.340860631(1595-1599)Online publication date: 2024
  • (2024)Geometric-inspired graph-based Incomplete Multi-view ClusteringPattern Recognition10.1016/j.patcog.2023.110082147(110082)Online publication date: Mar-2024
  • (2024)Diverse embeddings learning for multi-view clusteringPattern Analysis and Applications10.1007/s10044-024-01364-y28:1Online publication date: 6-Dec-2024
  • (2023)Deep Multi-View Clustering Based on Reconstructed Self-Expressive MatrixApplied Sciences10.3390/app1315879113:15(8791)Online publication date: 29-Jul-2023
  • (2023)Architecture Alternative Deep Multi-View ClusteringIEEE Signal Processing Letters10.1109/LSP.2023.332765230(1547-1551)Online publication date: 2023
  • (2023)On the Effects of Self-supervision and Contrastive Alignment in Deep Multi-view Clustering2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.02296(23976-23985)Online publication date: Jun-2023
  • (2023)Self-supervised deep subspace clustering with entropy-normCluster Computing10.1007/s10586-023-04033-727:2(1611-1623)Online publication date: 1-Jun-2023
  • (2022)Deep Multiview Clustering via Iteratively Self-Supervised Universal and Specific Space LearningIEEE Transactions on Cybernetics10.1109/TCYB.2021.308615352:11(11734-11746)Online publication date: Nov-2022
  • (2022)Multi-view Document Clustering with Joint Contrastive LearningNatural Language Processing and Chinese Computing10.1007/978-3-031-17120-8_55(706-719)Online publication date: 24-Sep-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media