Cited By
View all- Lan SDu SFang ZCai ZHuang WWang S(2025)Optimization-oriented Multi-view Representation Learning in Implicit Bi-topological SpacesInformation Sciences10.1016/j.ins.2025.121945(121945)Online publication date: Feb-2025
Multi-View Clustering Based on Deep Non-negative Tensor Factorization
Pages 1130 - 1138
Abstract
Multi-view clustering (MVC) methods based on non-negative matrix factorization (NMF) have gained popularity owing to their ability to provide interpretable clustering results. However, these NMF-based MVC methods generally process each view independently and thus ignore the potential relationship between views. Besides, they are limited in the ability to capture nonlinear data structures. To overcome these weaknesses and inspired by deep learning, we propose a multi-view clustering method based on deep non-negative tensor factorization (MVC-DNTF). With deep tensor factorization, our method can well exploit the spatial structure of the original data and is capable of extracting more deep and nonlinear features embedded in different views. To further extract the complementary information of different views, we adopt the weighted tensor Schatten p-norm regularization term. An optimization algorithm is developed to effectively solve the MVC-DNTF objective. Extensive experiments are performed to demonstrate the effectiveness and superiority of our method.
References
[1]
Steffen Bickel and Tobias Scheffer. 2004. Multi-view clustering. In ICDM, Vol. 4. Citeseer, 19--26.
[2]
Ivica Kopriva. 2018. Multi-view low-rank sparse subspace clustering. Pattern Recognition, Vol. 73 (2018), 247--258.
[3]
Deng Cai, Xiaofei He, Jiawei Han, and Thomas S Huang. 2010. Graph regularized nonnegative matrix factorization for data representation. IEEE transactions on pattern analysis and machine intelligence, Vol. 33, 8 (2010), 1548--1560.
[4]
Deng Cai, Xiaofei He, Xiaoyun Wu, and Jiawei Han. 2008. Non-negative Matrix Factorization on Manifold. In 2008 Eighth IEEE International Conference on Data Mining. 63--72. https://doi.org/10.1109/ICDM.2008.57
[5]
Xiaochun Cao, Changqing Zhang, Huazhu Fu, Si Liu, and Hua Zhang. 2015. Diversity-induced multi-view subspace clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition. 586--594.
[6]
Man-Sheng Chen, Ling Huang, Chang-Dong Wang, Dong Huang, and Jian-Huang Lai. 2021. Relaxed multi-view clustering in latent embedding space. Information Fusion, Vol. 68 (2021), 8--21.
[7]
Andrzej Cichocki, Rafal Zdunek, et al. 2006. Multilayer nonnegative matrix factorisation. ELECTRONICS LETTERS-IEE, Vol. 42, 16 (2006), 947.
[8]
Chris Ding, Xiaofeng He, and Horst D Simon. 2005. On the equivalence of nonnegative matrix factorization and spectral clustering. In Proceedings of the 2005 SIAM international conference on data mining. SIAM, 606--610.
[9]
Chris Ding, Tao Li, Wei Peng, and Haesun Park. 2006. Orthogonal nonnegative matrix t-factorizations for clustering. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining. 126--135.
[10]
Chris HQ Ding, Tao Li, and Michael I Jordan. 2008. Convex and semi-nonnegative matrix factorizations. IEEE transactions on pattern analysis and machine intelligence, Vol. 32, 1 (2008), 45--55.
[11]
Marco F Duarte and Yu Hen Hu. 2004. Vehicle classification in distributed sensor networks. J. Parallel and Distrib. Comput., Vol. 64, 7 (2004), 826--838.
[12]
Robert Duin. [n.,d.]. Multiple Features. UCI Machine Learning Repository.
[13]
Si-Guo Fang, Dong Huang, Xiao-Sha Cai, Chang-Dong Wang, Chaobo He, and Yong Tang. 2023. Efficient multi-view clustering via unified and discrete bipartite graph learning. IEEE Transactions on Neural Networks and Learning Systems (2023).
[14]
Li Fei-Fei, Rob Fergus, and Pietro Perona. 2004. Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. In 2004 conference on computer vision and pattern recognition workshop. IEEE, 178--178.
[15]
Lele Fu, Pengfei Lin, Athanasios V Vasilakos, and Shiping Wang. 2020. An overview of recent multi-view clustering. Neurocomputing, Vol. 402 (2020), 148--161.
[16]
Quanxue Gao, Pu Zhang, Wei Xia, Deyan Xie, Xinbo Gao, and Dacheng Tao. 2020. Enhanced tensor RPCA and its application. IEEE transactions on pattern analysis and machine intelligence, Vol. 43, 6 (2020), 2133--2140.
[17]
Quanxue Gao, Pu Zhang, Wei Xia, Deyan Xie, Xinbo Gao, and Dacheng Tao. 2021. Enhanced Tensor RPCA and its Application. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 43, 6 (2021), 2133--2140. https://doi.org/10.1109/TPAMI.2020.3017672
[18]
Derek Greene and Pádraig Cunningham. 2006. Practical solutions to the problem of diagonal dominance in kernel document clustering. In Proceedings of the 23rd international conference on Machine learning. 377--384.
[19]
Dong Huang, Chang-Dong Wang, and Jian-Huang Lai. 2023. Fast multi-view clustering via ensembles: Towards scalability, superiority, and simplicity. IEEE Transactions on Knowledge and Data Engineering (2023).
[20]
Yu Jiang, Jing Liu, Zechao Li, Peng Li, and Hanqing Lu. 2013. Co-regularized PLSA for multi-view clustering. In Computer Vision--ACCV 2012: 11th Asian Conference on Computer Vision, Daejeon, Korea, November 5--9, 2012, Revised Selected Papers, Part II 11. Springer, 202--213.
[21]
Misha E Kilmer and Carla D Martin. 2011. Factorization strategies for third-order tensors. Linear Algebra Appl., Vol. 435, 3 (2011), 641--658.
[22]
Abhishek Kumar and Hal Daumé. 2011. A co-training approach for multi-view spectral clustering. In Proceedings of the 28th international conference on machine learning (ICML-11). 393--400.
[23]
Daniel D Lee and H Sebastian Seung. 1999. Learning the parts of objects by non-negative matrix factorization. nature, Vol. 401, 6755 (1999), 788--791.
[24]
Jing Li, Quanxue Gao, Qianqian Wang, Ming Yang, and Wei Xia. 2024. Orthogonal non-negative tensor factorization based multi-view clustering. Advances in Neural Information Processing Systems, Vol. 36 (2024).
[25]
Jianqiang Li, Guoxu Zhou, Yuning Qiu, Yanjiao Wang, Yu Zhang, and Shengli Xie. 2020. Deep graph regularized non-negative matrix factorization for multi-view clustering. Neurocomputing, Vol. 390 (2020), 108--116.
[26]
Ruihuang Li, Changqing Zhang, Huazhu Fu, Xi Peng, Tianyi Zhou, and Qinghua Hu. 2019. Reciprocal multi-layer subspace learning for multi-view clustering. In Proceedings of the IEEE/CVF international conference on computer vision. 8172--8180.
[27]
Xingfeng Li, Zhenwen Ren, Quansen Sun, and Zhi Xu. 2023. Auto-weighted tensor schatten p-norm for robust multi-view graph clustering. Pattern Recognition, Vol. 134 (2023), 109083.
[28]
Yun Liu, Feiping Nie, Jigang Wu, and Lihui Chen. 2013. Efficient semi-supervised feature selection with noise insensitive trace ratio criterion. Neurocomputing, Vol. 105 (2013), 12--18.
[29]
Weihua Ou, Shujian Yu, Gai Li, Jian Lu, Kesheng Zhang, and Gang Xie. 2016. Multi-view non-negative matrix factorization by patch alignment framework with view consistency. Neurocomputing, Vol. 204 (2016), 116--124.
[30]
Erlin Pan and Zhao Kang. 2021. Multi-view contrastive graph clustering. Advances in neural information processing systems, Vol. 34 (2021), 2148--2159.
[31]
Zhenwen Ren, Mithun Mukherjee, Mehdi Bennis, and Jaime Lloret. 2020. Multikernel clustering via non-negative matrix factorization tailored graph tensor over distributed networks. IEEE Journal on Selected Areas in Communications, Vol. 39, 7 (2020), 1946--1956.
[32]
Terry Sejnowski and R. Gorman. [n.,d.]. Connectionist Bench (Sonar, Mines vs. Rocks). UCI Machine Learning Repository.
[33]
Nathan Silberman, Derek Hoiem, Pushmeet Kohli, and Rob Fergus. 2012. Indoor segmentation and support inference from rgbd images. In Computer Vision--ECCV 2012: 12th European Conference on Computer Vision, Florence, Italy, October 7--13, 2012, Proceedings, Part V 12. Springer, 746--760.
[34]
Grigorios Tzortzis and Aristidis Likas. 2012. Kernel-based weighted multi-view clustering. In 2012 IEEE 12th international conference on data mining. IEEE, 675--684.
[35]
Boyue Wang, Yongli Hu, Junbin Gao, Yanfeng Sun, Fujiao Ju, and Baocai Yin. 2020. Learning adaptive neighborhood graph on Grassmann manifolds for video/image-set subspace clustering. IEEE Transactions on Multimedia, Vol. 23 (2020), 216--227.
[36]
Hao Wang, Yan Yang, and Bing Liu. 2019. GMC: Graph-based multi-view clustering. IEEE Transactions on Knowledge and Data Engineering, Vol. 32, 6 (2019), 1116--1129.
[37]
Jing Wang, Feng Tian, Hongchuan Yu, Chang Hong Liu, Kun Zhan, and Xiao Wang. 2017. Diverse non-negative matrix factorization for multiview data representation. IEEE transactions on cybernetics, Vol. 48, 9 (2017), 2620--2632.
[38]
Yu-Xiong Wang and Yu-Jin Zhang. 2012. Nonnegative matrix factorization: A comprehensive review. IEEE Transactions on knowledge and data engineering, Vol. 25, 6 (2012), 1336--1353.
[39]
Xiaokai Wei, Bokai Cao, and S Yu Philip. 2017. Multi-view unsupervised feature selection by cross-diffused matrix alignment. In 2017 International Joint Conference on Neural Networks (IJCNN). IEEE, 494--501.
[40]
Ben Yang, Xuetao Zhang, Feiping Nie, Fei Wang, Weizhong Yu, and Rong Wang. 2020. Fast multi-view clustering via nonnegative and orthogonal factorization. IEEE Transactions on Image Processing, Vol. 30 (2020), 2575--2586.
[41]
Yan Yang and Hao Wang. 2018. Multi-view clustering: A survey. Big Data Mining and Analytics, Vol. 1, 2 (2018), 83--107.
[42]
Chen Zhang, Siwei Wang, Jiyuan Liu, Sihang Zhou, Pei Zhang, Xinwang Liu, En Zhu, and Changwang Zhang. 2021. Multi-view clustering via deep matrix factorization and partition alignment. In Proceedings of the 29th ACM international conference on multimedia. 4156--4164.
[43]
Handong Zhao, Zhengming Ding, and Yun Fu. 2017. Multi-view clustering via deep matrix factorization. In Proceedings of the AAAI conference on artificial intelligence, Vol. 31.
[44]
Yujiao Zhao, Yu Yun, Xiangdong Zhang, Qin Li, and Quanxue Gao. 2022. Multi-view spectral clustering with adaptive graph learning and tensor schatten p-norm. Neurocomputing, Vol. 468 (2022), 257--264.
[45]
Xiao Zheng, Chang Tang, Xinwang Liu, and En Zhu. 2023. Multi-view clustering via matrix factorization assisted k-means. Neurocomputing, Vol. 534 (2023), 45--54.
[46]
Linlin Zong, Xianchao Zhang, and Xinyue Liu. 2018. Multi-view clustering on unmapped data via constrained non-negative matrix factorization. Neural Networks, Vol. 108 (2018), 155--171.
Index Terms
- Multi-View Clustering Based on Deep Non-negative Tensor Factorization
Recommendations
Multi-view Clustering via Deep Matrix Factorization and Partition Alignment
MM '21: Proceedings of the 29th ACM International Conference on MultimediaMulti-view clustering (MVC) has been extensively studied to collect multiple source information in recent years. One typical type of MVC methods is based on matrix factorization to effectively perform dimension reduction and clustering. However, the ...
Semi-supervised Multi-view Clustering Based on Non-negative Matrix Factorization and Low-Rank Tensor Representation
AbstractMulti-view clustering methods aim to integrate the complementary information of different views to obtain accurate clustering results. However, the traditional multi-view clustering method is unsupervised which does not combine the label ...
Enhanced tensor low-rank representation learning for multi-view clustering
AbstractMulti-view subspace clustering (MSC), assuming the multi-view data are generated from a latent subspace, has attracted considerable attention in multi-view clustering. To recover the underlying subspace structure, a successful approach ...
Highlights- Capturing intrinsic high-order correlations underlying multi-view data.
- ...
Comments
Information & Contributors
Information
Published In
October 2024
11719 pages
ISBN:9798400706868
DOI:10.1145/3664647
- General Chairs:
- Jianfei Cai,
- Mohan Kankanhalli,
- Balakrishnan Prabhakaran,
- Susanne Boll,
- Program Chairs:
- Ramanathan Subramanian,
- Liang Zheng,
- Vivek K. Singh,
- Pablo Cesar,
- Lexing Xie,
- Dong Xu
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 28 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- the Fundamental Research Funds for the Central Universities
- the National Key Research and Development Project of China
- the National Natural Science Foundation of China
- Anhui Provincial Key Laboratory of Multimodal Cognitive Computation
- Initiative Postdocs Supporting Program
- Fundamental Research Funds for the Central Universities
- the Natural Science Basic Research Program of Shaanxi Province
- the Science and technology project of Xi?an
Conference
MM '24
Sponsor:
MM '24: The 32nd ACM International Conference on Multimedia
October 28 - November 1, 2024
Melbourne VIC, Australia
Acceptance Rates
MM '24 Paper Acceptance Rate 1,150 of 4,385 submissions, 26%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 175Total Downloads
- Downloads (Last 12 months)175
- Downloads (Last 6 weeks)68
Reflects downloads up to 28 Feb 2025
Other Metrics
Citations
Cited By
View all- Lan SDu SFang ZCai ZHuang WWang S(2025)Optimization-oriented Multi-view Representation Learning in Implicit Bi-topological SpacesInformation Sciences10.1016/j.ins.2025.121945(121945)Online publication date: Feb-2025
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in