Abstract
With the development of data science, more and more data are presented in the form of multi-view. Compared with single-view feature learning, multi-view feature learning is more effective, and it has been successfully applied in many fields. Clustering is a core technology of computer science. Thus, many researchers start to study multi-view clustering. Recently, combining with multi-view feature learning techniques, some multi-view clustering methods have been presented. These methods mainly focus on the multiple features fusion, while most of them ignore the correlations among multiple views. Therefore, it cannot make full use of the advantages of multiple view features. In this paper, we propose a novel approach, named multi-view clustering via neighbor domain correlation learning (MCNDCL) approach. Specifically, MCNDCL learns a discriminant common space for multiple view features. Under the learned common space, the correlations of the consistent neighbor domain are maximized, and the correlations of specific neighbor domain are minimized at the same time. Extensive experimental results on four typical benchmarks, i.e., UCI Digits, Caltech7, BBCSport and CCV, validate the high effectiveness of our proposed approach.
Similar content being viewed by others
References
Sato Y, Izui K, Yamada T, Nishiwaki S (2019) Data mining based on clustering and association rule analysis for knowledge discovery in multiobjective topology optimization. Expert Syst Appl 119:247–261
Li X, Wang Y, Song J, Liu Y, Zhang X, Zhou K, Li C (2020) A low cost and un-cancelled laplace noise based differential privacy algorithm for spatial decompositions. World Wide Web 23(1):549–572
Zhang J, Liu Y, Zhou K, Li G, Xiao Z, Cheng B, Xing J, Wang Y, Cheng T, Liu L, Ran M, Li Z (2019) An end-to-end automatic cloud database tuning system using deep reinforcement learning. In: Boncz PA, Manegold S, Ailamaki A, Deshpande A, Kraska T (eds) Proceedings of the international conference on management of data, SIGMOD, Amsterdam, The Netherlands, 2019, ACM, 2019, pp 415–432
Liu Y, Wang Y, Zhou K, Yang Y, Liu Y (2020) Semantic-aware data quality assessment for image big data. Future Gener Comput Syst 102:53–65
Tan TY, Zhang L, Lim CP (2020) Adaptive melanoma diagnosis using evolving clustering, ensemble and deep neural networks. Knowl-Based Syst 187:1–26
Hu S, Yan X, Ye Y (2020) Dynamic auto-weighted multi-view co-clustering. Pattern Recogn 99:1–12
Zhou K, Sun S, Wang H, Huang P, He X, Lan R, Li W, Liu W, Yang T (2019) Improving cache performance for large-scale photo stores via heuristic prefetching scheme. IEEE Trans Parallel Distrib Syst 30(9):2033–2045
Netto SMB, Diniz JOB, Silva AC, de Paiva AC, Nunes RA, Gattass M (2019) Modified quality threshold clustering for temporal analysis and classification of lung lesions. IEEE Trans Image Process 28(4):1813–1823
Wang Q, Yin H, Wang W, Huang Z, Guo G, Nguyen QVH (2019) Multi-hop path queries over knowledge graphs with neural memory networks. In: DASFAA, pp 777–794
Ng AY, Jordan MI, Weiss Y (2001) On spectral clustering: Analysis and an algorithm. In: Advances in Neural Information Processing Systems 14 [Neural Information Processing Systems: Natural and Synthetic, NIPS, December 3-8, 2001, Vancouver, British Columbia, Canada], 2001, pp 849–856
Li X, Yin H, Zhou K, Zhou X (2019) Semi-supervised clustering with deep metric learning and graph embedding. World Wide Web, pp 1–18
Ahmad A, Khan SS (2019) Survey of state-of-the-art mixed data clustering algorithms. IEEE Access 7:31883–31902
Liu Q, Zhang R, Hu R, Wang G, Wang Z, Zhao Z (2019) An improved path-based clustering algorithm. Knowl-Based Syst 163:69–81
He Z, Ho C (2019) An improved clustering algorithm based on finite gaussian mixture model. Multimedia Tools Appl 78(17):24285–24299
Li X, Yin H, Zhou K, Zhou X (2020) Semi-supervised clustering with deep metric learning and graph embedding. World Wide Web 23(2):781–798
Wang Y, Wu L, Lin X, Gao J (2018) Multiview spectral clustering via structured low-rank matrix factorization. IEEE Trans Neural Netw Learn Syst 29(10):4833–4843
Yin M, Gao J, Xie S, Guo Y (2019) Multiview subspace clustering via tensorial t-product representation. IEEE Trans Neural Netw Learn Syst 30(3):851–864
Gao J, Han J, Liu J, Wang C (2013) Multi-view clustering via joint nonnegative matrix factorization. In: Proceedings of the 13th siam international conference on data mining, 2013. Austin, Texas, USA, pp 252–260
Wang B, Mezlini AM, Demir F, Fiume M, Tu Z, Brudno M, Haibe-Kains B, Goldenberg A (2014) Similarity network fusion for aggregating data types on a genomic scale. Nat Methods 11(3):333
Liu X, Dou Y, Yin J, Wang L, Zhu E (2016) Multiple kernel k-means clustering with matrix-induced regularization. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, 2016, Phoenix, Arizona, USA, pp 1888–1894
Zhang C, Fu H, Liu S, Liu G, Cao X (2015) Low-rank tensor constrained multiview subspace clustering. In: 2015 IEEE international conference on computer vision, ICCV, Santiago, Chile, 2015, pp 1582–1590
Kumar A, Rai P, III HD (2011) Co-regularized multi-view spectral clustering. In: Advances in neural information processing systems, 25th annual conference on neural information processing systems. Proceedings of a meeting held 12-14 December 2011, Granada, Spain, vol 24, pp 1413–1421
Xia R, Pan Y, Du L, Yin J (2014) Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, 2014, Québec City, Québec, Canada, pp 2149–2155
Li Y, Nie F, Huang H, Huang J (2015) Large-scale multi-view spectral clustering via bipartite graph, In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence, 2015, Austin, Texas, USA, pp 2750–2756
von Luxburg U (2007) A tutorial on spectral clustering. Stat Comput 17(4):395–416
Kumar A, III HD (2011) A co-training approach for multi-view spectral clustering. In: Proceedings of the 28th international conference on machine learning, ICML, Bellevue, Washington, USA, 2011, pp 393–400
Zhou D, Burges CJC (2007) Spectral clustering and transductive learning with multiple views. In: Machine learning, proceedings of the twenty-fourth international conference (ICML), Corvallis, Oregon, USA, 2007, pp 1159–1166
Long B, Yu PS, Zhang ZM (2008) A general model for multiple view unsupervised learning. In: Proceedings of the SIAM international conference on data mining, SDM, 2008, Atlanta, Georgia, USA, pp 822–833
Tsivtsivadze E, Borgdorff H, van de Wijgert J, Schuren FHJ, Verhelst R, Heskes T (2013) Neighborhood co-regularized multi-view spectral clustering of microbiome data. In: Partially supervised learning–second IAPR international workshop, PSL, Nanjing, China, 2013 Revised Selected Papers, pp 80–90
Cai X, Nie F, Huang H, Kamangar F (2011) Heterogeneous image feature integration via multi-modal spectral clustering. In: The 24th IEEE conference on computer vision and pattern recognition, CVPR, Colorado Springs, CO, USA, 2011, pp 1977–1984
Elhamifar E, Vidal R (2013) Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35(11):2765–2781
Agrawal R, Gehrke J, Gunopulos D, Raghavan P (1998) Automatic subspace clustering of high dimensional data for data mining applications. In: SIGMOD, Proceedings ACM SIGMOD international conference on management of data, 1998, Seattle, Washington, USA, pp 94–105
Li S, Jiang Y, Zhou Z (2014) Partial multi-view clustering. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, 2014, Québec City, Québec, Canada, pp 1968–1974
Zhao H, Liu H, Fu Y (2016) Incomplete multi-modal visual data grouping. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, IJCAI, New York, NY, USA (2016), pp 2392–2398
Yin Q, Wu S, Wang L (2015) Incomplete multi-view clustering via subspace learning. In: Proceedings of the 24th ACM international conference on information and knowledge management, CIKM, Melbourne, VIC, Australia, 2015, pp 383–392
Chao G, Sun S, Bi J A survey on multi-view clustering, CoRR abs/1712.06246
Lee DD, Seung HS (2000) Algorithms for non-negative matrix factorization. In: Advances in neural information processing systems 13, Papers from neural information processing systems (NIPS), Denver, CO, USA, pp 556–562
Lazar C, Doncescu A (2009) Non negative matrix factorization clustering capabilities; application on multivariate image segmentation. In: 2009 international conference on complex, intelligent and software intensive systems, CISIS, Fukuoka, Japan, 2009, pp 924–929
Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401:788–791
Brunet J-P, Tamayo P, Golub TR, Mesirov JP (2004) Metagenes and molecular pattern discovery using matrix factorization. Proc Nat Acad Sci 101(12):4164–4169
Akata Z, Thurau C, Bauckhage C (2011) Non-negative matrix factorization in multimodality data for segmentation and label prediction. In: Wendel A, Sternig S, Godec M (eds) 16th computer vision winter workshop. Mitterberg, Austria
Chen X, Chen S, Xue H (2011) Large correlation analysis. Appl Math Comput 217(22):9041–9052
Rai N, Negi S, Chaudhury S, Deshmukh O (2016) Partial multi-view clustering using graph regularized NMF. In: 23rd international conference on pattern recognition, ICPR, Cancún, Mexico, 2016, pp 2192–2197
Li F, Fergus R, Perona P (2007) Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. Comput Vis Image Underst 106(1):59–70
Jiang Y, Ye G, Chang S, Ellis DPW, Loui AC (2011) Consumer video understanding: a benchmark database and an evaluation of human and machine performance. In: Proceedings of the 1st international conference on multimedia retrieval, ICMR, Trento, Italy, 2011, ACM, pp 1–8
Hu Z, Nie F, Chang W, Hao S, Wang R, Li X (2020) Multi-view spectral clustering via sparse graph learning. Neurocomputing 384:1–10
Kang Z, Shi G, Huang S, Chen W, Pu X, Zhou JT, Xu Z (2020) Multi-graph fusion for multi-view spectral clustering. Knowl Based Syst 189:1–9
Yuan T, Deng W, Hu J, An Z, Tang Y (2019) Unsupervised adaptive hashing based on feature clustering. Neurocomputing 323:373–382
Sui XL, Xu L, Qian X, Liu T (2018) Convex clustering with metric learning. Pattern Recogn 81:575–584
Yang B, Fu X, Sidiropoulos ND, Hong M (2017) Towards k-means-friendly spaces: simultaneous deep learning and clustering. In: Proceedings of the 34th international conference on machine learning, ICML, Sydney, NSW, Australia, 2017, pp 3861–3870
de Amorim RC, Hennig C (2015) Recovering the number of clusters in data sets with noise features using feature rescaling factors. Inf Sci 324:126–145
Acknowledgements
The authors would like to thank the editor, the associate editor and anonymous reviewers for their constructive comments in helping improve our work. This work is supported by the National Natural Science Foundation of China No. 61902135, the Innovation Group Project of the National Natural Science Foundation of China No. 61821003, and the Scientific Research Projects of Hunan Education Department under Grant No. 14C0304.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Appendix
Proof
\(\square\)
Rights and permissions
About this article
Cite this article
Li, X., Zhou, K., Li, C. et al. Multi-view clustering via neighbor domain correlation learning. Neural Comput & Applic 33, 3403–3415 (2021). https://doi.org/10.1007/s00521-020-05185-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-020-05185-y