Abstract
Multi-view clustering (MVC), which aims to explore the underlying structure of data by leveraging heterogeneous information of different views, has brought along a growth of attention. Multi-view clustering algorithms based on different theories have been proposed and extended in various applications. However, existing of most MVC algorithms are shallow models. They learn structure information of multi-view data by mapping multi-view data to low-dimensional representation space directly, which ignore the Non-linear structure information hidden in each view. This weakens the performance of multi-view clustering to a certain extent. In this paper, we propose a multi-view clustering algorithm based on multiple Auto-Encoder, named MVC-MAE, to cluster multi-view data. MVC-MAE algorithm adopts Auto-Encoder to capture the non-linear structure information of each view in a layer-wise manner. To exploit the consistent and complementary information contained in different views, we also incorporate the local invariance within each view and consistent and complementary information between any two views. Besides, we integrate the representation learning and clustering into a unified step, which jointly optimizes these two steps. Extensive experiments on three real-world datasets demonstrate a superior performance of our algorithm compared with 13 baseline algorithms in terms of two evaluation metrics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wang, H., Yang, Y., Liu, B., Fujita, H.: A study of graph-based system for multi-view clustering. Knowl.-Based Syst. 163, 1009–1019 (2019)
Huang, S., Kang, Z., Tsang, I.W., Xu, Z.: Auto-weighted multi-view clustering via kernelized graph learning. Pattern Recogn. 88, 174–184 (2019)
Cao, X., Zhang, C., Fu, H., Liu, S., Zhang, H.: Diversity-induced multi-view subspace clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–594. IEEE-CS (2015)
Liu, J., Wang, C., Gao, J., Han, J.: Multi-view clustering via joint nonnegative matrix factorization. In: Proceedings of the 13th SIAM International Conference on Data Mining, pp. 252–260. SIAM (2013)
Wang, Z., Kong, X., Fu, H., Li, M., Zhang, Y.: Feature extraction via multi-view non-negative matrix factorization with local graph regularization. In: 2015 IEEE International Conference on Image Processing, pp. 3500–3504. IEEE (2015)
Andrew, G., Arora, R., Bilmes, J., Livescu, K.: Deep canonical correlation analysis. In: Proceedings of the 30th International Conference on Machine Learning, pp. 1247–1255. MIT Press (2013)
Chaudhuri, K., Kakade, S.M., Livescu, K., Sridharan, K.: Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 129–136. ACM (2009)
Xie, J., Girshick, R., Farhadi, A.: Unsupervised deep embedding for clustering analysis. In: Proceedings of the 33nd International Conference on Machine Learning, pp. 478–487. MIT Press (2016)
Zhao, H., Ding, Z., Fu, Y.: Multi-view clustering via deep matrix factorization. In: Proceedings of the 31th AAAI Conference on Artificial Intelligence, pp. 2921–2927. AAAI Press (2017)
Yang, Y., Wang, H.: Multi-view clustering: a survey. Big Data Min. Anal. 1(2), 83–107 (2018)
Luo, S., Zhang, C., Zhang, W., Cao, X.: Consistent and specific multi-view subspace clustering. In: Proceedings of the 32th AAAI Conference on Artificial Intelligence, pp. 3730–3737. AAAI Press (2018)
Xu, C., Guan, Z., Zhao, W., Niu, Y., Wang, Q., Wang, Z.: Deep multi-view concept learning. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence, pp. 2898–2904. AAAI Press (2018)
Guan, Z., Zhang, L., Peng, J., Fan, J.: Multi-view concept learning for data representation. IEEE Trans. Knowl. Data Eng. 27(11), 3016–3028 (2015)
Kumar, A., Rai, P., Daume, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp. 1413–1421. AAAI Press (2011)
Houthuys, L., Langone, R., Suykens, J.A.: Multi-view kernel spectral clustering. Inf. Fusion 44, 46–56 (2018)
Nie, F., Li, J., Li, X., et al.: Parameter-free auto-weighted multiple graph learning: a framework for multiview clustering and semi-supervised classification. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence, pp. 1881–1887. AAAI Press (2016)
Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)
Wang, D., Cui, P., Zhu, W.: Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1225–1234. MIT Press (2016)
Salakhutdinov, R., Hinton, G.: Semantic hashing. Int. J. Approximate Reasoning 50(7), 969–978 (2009)
Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Transa. Pattern Anal. Mach. Intell. 33(8), 1548–1560 (2010)
Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix fac-torization. Nature 401(6755), 788–791 (1999)
Hinton, G.E., Osindero, S., Teh, Y.W.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)
Xia, R., Pan, Y., Du, L., Yin, J.: Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp. 2149–2155. AAAI Press (2014)
Zhan, K., Shi, J., Wang, J., Wang, H., Xie, Y.: Adaptive structure concept factor ization for multiview clustering. Neural Comput. 30(4), 1080–1103 (2018)
Zhan, K., Zhang, C., Guan, J., Wang, J.: Graph learning for multiview clustering. IEEE Trans. Cybern. 48(10), 2887–2895 (2017)
Nie, F., Li, J., Li, X., et al.: Self-weighted multiview clustering with multiple graphs. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp. 2564–2570. AAAI Press (2017)
Maas, A.L., Hannun, A.Y., Ng, A.Y.: Rectifier nonlinearities improve neural net-work acoustic models. In: Proceedings of the 30th International Conference on Machine Learning, vol. 30, p. 3. MIT Press (2013)
Acknowledgments
This work was supported by the National Natural Science Foundation of China (61762090, 61262069, 61966036, and 61662086), The Natural Science Foundation of Yunnan Province (2016FA026), the Project of Innovative Research Team of Yunnan Province (2018HC019), and Program for Innovation Research Team (in Science and Technology) in University of Yunnan Province (IRTSTYN), the Education Department Foundation of Yunnan Province (2019J0005, 2019Y0006), Yunnan University’s Research Innovation Fund for Graduate Students, and the National Social Science Foundation of China (18XZZ005).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Du, G., Zhou, L., Yang, Y., Lü, K., Wang, L. (2020). Multi-view Clustering via Multiple Auto-Encoder. In: Wang, X., Zhang, R., Lee, YK., Sun, L., Moon, YS. (eds) Web and Big Data. APWeb-WAIM 2020. Lecture Notes in Computer Science(), vol 12317. Springer, Cham. https://doi.org/10.1007/978-3-030-60259-8_45
Download citation
DOI: https://doi.org/10.1007/978-3-030-60259-8_45
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60258-1
Online ISBN: 978-3-030-60259-8
eBook Packages: Computer ScienceComputer Science (R0)