Skip to main content
Log in

Multi-view clustering via neighbor domain correlation learning

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

With the development of data science, more and more data are presented in the form of multi-view. Compared with single-view feature learning, multi-view feature learning is more effective, and it has been successfully applied in many fields. Clustering is a core technology of computer science. Thus, many researchers start to study multi-view clustering. Recently, combining with multi-view feature learning techniques, some multi-view clustering methods have been presented. These methods mainly focus on the multiple features fusion, while most of them ignore the correlations among multiple views. Therefore, it cannot make full use of the advantages of multiple view features. In this paper, we propose a novel approach, named multi-view clustering via neighbor domain correlation learning (MCNDCL) approach. Specifically, MCNDCL learns a discriminant common space for multiple view features. Under the learned common space, the correlations of the consistent neighbor domain are maximized, and the correlations of specific neighbor domain are minimized at the same time. Extensive experimental results on four typical benchmarks, i.e., UCI Digits, Caltech7, BBCSport and CCV, validate the high effectiveness of our proposed approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. http://mlg.ucd.ie/datasets.

References

  1. Sato Y, Izui K, Yamada T, Nishiwaki S (2019) Data mining based on clustering and association rule analysis for knowledge discovery in multiobjective topology optimization. Expert Syst Appl 119:247–261

    Article  Google Scholar 

  2. Li X, Wang Y, Song J, Liu Y, Zhang X, Zhou K, Li C (2020) A low cost and un-cancelled laplace noise based differential privacy algorithm for spatial decompositions. World Wide Web 23(1):549–572

    Article  Google Scholar 

  3. Zhang J, Liu Y, Zhou K, Li G, Xiao Z, Cheng B, Xing J, Wang Y, Cheng T, Liu L, Ran M, Li Z (2019) An end-to-end automatic cloud database tuning system using deep reinforcement learning. In: Boncz PA, Manegold S, Ailamaki A, Deshpande A, Kraska T (eds) Proceedings of the international conference on management of data, SIGMOD, Amsterdam, The Netherlands, 2019, ACM, 2019, pp 415–432

  4. Liu Y, Wang Y, Zhou K, Yang Y, Liu Y (2020) Semantic-aware data quality assessment for image big data. Future Gener Comput Syst 102:53–65

    Article  Google Scholar 

  5. Tan TY, Zhang L, Lim CP (2020) Adaptive melanoma diagnosis using evolving clustering, ensemble and deep neural networks. Knowl-Based Syst 187:1–26

    Article  Google Scholar 

  6. Hu S, Yan X, Ye Y (2020) Dynamic auto-weighted multi-view co-clustering. Pattern Recogn 99:1–12

    Article  Google Scholar 

  7. Zhou K, Sun S, Wang H, Huang P, He X, Lan R, Li W, Liu W, Yang T (2019) Improving cache performance for large-scale photo stores via heuristic prefetching scheme. IEEE Trans Parallel Distrib Syst 30(9):2033–2045

    Article  Google Scholar 

  8. Netto SMB, Diniz JOB, Silva AC, de Paiva AC, Nunes RA, Gattass M (2019) Modified quality threshold clustering for temporal analysis and classification of lung lesions. IEEE Trans Image Process 28(4):1813–1823

    Article  MathSciNet  Google Scholar 

  9. Wang Q, Yin H, Wang W, Huang Z, Guo G, Nguyen QVH (2019) Multi-hop path queries over knowledge graphs with neural memory networks. In: DASFAA, pp 777–794

  10. Ng AY, Jordan MI, Weiss Y (2001) On spectral clustering: Analysis and an algorithm. In: Advances in Neural Information Processing Systems 14 [Neural Information Processing Systems: Natural and Synthetic, NIPS, December 3-8, 2001, Vancouver, British Columbia, Canada], 2001, pp 849–856

  11. Li X, Yin H, Zhou K, Zhou X (2019) Semi-supervised clustering with deep metric learning and graph embedding. World Wide Web, pp 1–18

  12. Ahmad A, Khan SS (2019) Survey of state-of-the-art mixed data clustering algorithms. IEEE Access 7:31883–31902

    Article  Google Scholar 

  13. Liu Q, Zhang R, Hu R, Wang G, Wang Z, Zhao Z (2019) An improved path-based clustering algorithm. Knowl-Based Syst 163:69–81

    Article  Google Scholar 

  14. He Z, Ho C (2019) An improved clustering algorithm based on finite gaussian mixture model. Multimedia Tools Appl 78(17):24285–24299

    Article  Google Scholar 

  15. Li X, Yin H, Zhou K, Zhou X (2020) Semi-supervised clustering with deep metric learning and graph embedding. World Wide Web 23(2):781–798

    Article  Google Scholar 

  16. Wang Y, Wu L, Lin X, Gao J (2018) Multiview spectral clustering via structured low-rank matrix factorization. IEEE Trans Neural Netw Learn Syst 29(10):4833–4843

    Article  Google Scholar 

  17. Yin M, Gao J, Xie S, Guo Y (2019) Multiview subspace clustering via tensorial t-product representation. IEEE Trans Neural Netw Learn Syst 30(3):851–864

    Article  MathSciNet  Google Scholar 

  18. Gao J, Han J, Liu J, Wang C (2013) Multi-view clustering via joint nonnegative matrix factorization. In: Proceedings of the 13th siam international conference on data mining, 2013. Austin, Texas, USA, pp 252–260

  19. Wang B, Mezlini AM, Demir F, Fiume M, Tu Z, Brudno M, Haibe-Kains B, Goldenberg A (2014) Similarity network fusion for aggregating data types on a genomic scale. Nat Methods 11(3):333

    Article  Google Scholar 

  20. Liu X, Dou Y, Yin J, Wang L, Zhu E (2016) Multiple kernel k-means clustering with matrix-induced regularization. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, 2016, Phoenix, Arizona, USA, pp 1888–1894

  21. Zhang C, Fu H, Liu S, Liu G, Cao X (2015) Low-rank tensor constrained multiview subspace clustering. In: 2015 IEEE international conference on computer vision, ICCV, Santiago, Chile, 2015, pp 1582–1590

  22. Kumar A, Rai P, III HD (2011) Co-regularized multi-view spectral clustering. In: Advances in neural information processing systems, 25th annual conference on neural information processing systems. Proceedings of a meeting held 12-14 December 2011, Granada, Spain, vol 24, pp 1413–1421

  23. Xia R, Pan Y, Du L, Yin J (2014) Robust multi-view spectral clustering via low-rank and sparse decomposition. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, 2014, Québec City, Québec, Canada, pp 2149–2155

  24. Li Y, Nie F, Huang H, Huang J (2015) Large-scale multi-view spectral clustering via bipartite graph, In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence, 2015, Austin, Texas, USA, pp 2750–2756

  25. von Luxburg U (2007) A tutorial on spectral clustering. Stat Comput 17(4):395–416

    Article  MathSciNet  Google Scholar 

  26. Kumar A, III HD (2011) A co-training approach for multi-view spectral clustering. In: Proceedings of the 28th international conference on machine learning, ICML, Bellevue, Washington, USA, 2011, pp 393–400

  27. Zhou D, Burges CJC (2007) Spectral clustering and transductive learning with multiple views. In: Machine learning, proceedings of the twenty-fourth international conference (ICML), Corvallis, Oregon, USA, 2007, pp 1159–1166

  28. Long B, Yu PS, Zhang ZM (2008) A general model for multiple view unsupervised learning. In: Proceedings of the SIAM international conference on data mining, SDM, 2008, Atlanta, Georgia, USA, pp 822–833

  29. Tsivtsivadze E, Borgdorff H, van de Wijgert J, Schuren FHJ, Verhelst R, Heskes T (2013) Neighborhood co-regularized multi-view spectral clustering of microbiome data. In: Partially supervised learning–second IAPR international workshop, PSL, Nanjing, China, 2013 Revised Selected Papers, pp 80–90

  30. Cai X, Nie F, Huang H, Kamangar F (2011) Heterogeneous image feature integration via multi-modal spectral clustering. In: The 24th IEEE conference on computer vision and pattern recognition, CVPR, Colorado Springs, CO, USA, 2011, pp 1977–1984

  31. Elhamifar E, Vidal R (2013) Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35(11):2765–2781

    Article  Google Scholar 

  32. Agrawal R, Gehrke J, Gunopulos D, Raghavan P (1998) Automatic subspace clustering of high dimensional data for data mining applications. In: SIGMOD, Proceedings ACM SIGMOD international conference on management of data, 1998, Seattle, Washington, USA, pp 94–105

  33. Li S, Jiang Y, Zhou Z (2014) Partial multi-view clustering. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, 2014, Québec City, Québec, Canada, pp 1968–1974

  34. Zhao H, Liu H, Fu Y (2016) Incomplete multi-modal visual data grouping. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, IJCAI, New York, NY, USA (2016), pp 2392–2398

  35. Yin Q, Wu S, Wang L (2015) Incomplete multi-view clustering via subspace learning. In: Proceedings of the 24th ACM international conference on information and knowledge management, CIKM, Melbourne, VIC, Australia, 2015, pp 383–392

  36. Chao G, Sun S, Bi J A survey on multi-view clustering, CoRR abs/1712.06246

  37. Lee DD, Seung HS (2000) Algorithms for non-negative matrix factorization. In: Advances in neural information processing systems 13, Papers from neural information processing systems (NIPS), Denver, CO, USA, pp 556–562

  38. Lazar C, Doncescu A (2009) Non negative matrix factorization clustering capabilities; application on multivariate image segmentation. In: 2009 international conference on complex, intelligent and software intensive systems, CISIS, Fukuoka, Japan, 2009, pp 924–929

  39. Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401:788–791

    Article  Google Scholar 

  40. Brunet J-P, Tamayo P, Golub TR, Mesirov JP (2004) Metagenes and molecular pattern discovery using matrix factorization. Proc Nat Acad Sci 101(12):4164–4169

    Article  Google Scholar 

  41. Akata Z, Thurau C, Bauckhage C (2011) Non-negative matrix factorization in multimodality data for segmentation and label prediction. In: Wendel A, Sternig S, Godec M (eds) 16th computer vision winter workshop. Mitterberg, Austria

  42. Chen X, Chen S, Xue H (2011) Large correlation analysis. Appl Math Comput 217(22):9041–9052

    MathSciNet  MATH  Google Scholar 

  43. Rai N, Negi S, Chaudhury S, Deshmukh O (2016) Partial multi-view clustering using graph regularized NMF. In: 23rd international conference on pattern recognition, ICPR, Cancún, Mexico, 2016, pp 2192–2197

  44. Li F, Fergus R, Perona P (2007) Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. Comput Vis Image Underst 106(1):59–70

    Article  Google Scholar 

  45. Jiang Y, Ye G, Chang S, Ellis DPW, Loui AC (2011) Consumer video understanding: a benchmark database and an evaluation of human and machine performance. In: Proceedings of the 1st international conference on multimedia retrieval, ICMR, Trento, Italy, 2011, ACM, pp 1–8

  46. Hu Z, Nie F, Chang W, Hao S, Wang R, Li X (2020) Multi-view spectral clustering via sparse graph learning. Neurocomputing 384:1–10

    Article  Google Scholar 

  47. Kang Z, Shi G, Huang S, Chen W, Pu X, Zhou JT, Xu Z (2020) Multi-graph fusion for multi-view spectral clustering. Knowl Based Syst 189:1–9

    Article  Google Scholar 

  48. Yuan T, Deng W, Hu J, An Z, Tang Y (2019) Unsupervised adaptive hashing based on feature clustering. Neurocomputing 323:373–382

    Article  Google Scholar 

  49. Sui XL, Xu L, Qian X, Liu T (2018) Convex clustering with metric learning. Pattern Recogn 81:575–584

    Article  Google Scholar 

  50. Yang B, Fu X, Sidiropoulos ND, Hong M (2017) Towards k-means-friendly spaces: simultaneous deep learning and clustering. In: Proceedings of the 34th international conference on machine learning, ICML, Sydney, NSW, Australia, 2017, pp 3861–3870

  51. de Amorim RC, Hennig C (2015) Recovering the number of clusters in data sets with noise features using feature rescaling factors. Inf Sci 324:126–145

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the editor, the associate editor and anonymous reviewers for their constructive comments in helping improve our work. This work is supported by the National Natural Science Foundation of China No. 61902135, the Innovation Group Project of the National Natural Science Foundation of China No. 61821003, and the Scientific Research Projects of Hunan Education Department under Grant No. 14C0304.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chunhua Li.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Proof

$$\begin{aligned} \begin{aligned} S^T=&\left( \frac{1}{N}\sum _{i=1}^{N}\frac{1}{|P_i|}\sum _{m=1}^{M}\sum _{n=1}^{M}\sum _{s=1}^{|P_i|}\sum _{t=1}^{|P_i|}(p^m_s)(p^n_t)^T\right) ^T\\&-\left( \frac{\lambda }{N}\sum _{i=1}^{N}\frac{1}{|Q_i|}\sum _{m=1}^{M}\sum _{n=1}^{M}\sum _{s=1}^{|Q_i|}\sum _{t=1}^{|Q_i|}(q^m_s)(q^n_t)^T\right) ^T\\ =&\frac{1}{N}\sum _{i=1}^{N}\frac{1}{|P_i|}\sum _{n=1}^{M}\sum _{m=1}^{M}\sum _{t=1}^{|P_i|}\sum _{s=1}^{|P_i|}(p^n_t)(p^m_s)^T\\&-\frac{\lambda }{N}\sum _{i=1}^{N}\frac{1}{|Q_i|}\sum _{n=1}^{M}\sum _{m=1}^{M}\sum _{t=1}^{|Q_i|}\sum _{s=1}^{|Q_i|}(q^n_t)(q^m_s)^T\\&=S \end{aligned}, \end{aligned}$$

\(\square\)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, X., Zhou, K., Li, C. et al. Multi-view clustering via neighbor domain correlation learning. Neural Comput & Applic 33, 3403–3415 (2021). https://doi.org/10.1007/s00521-020-05185-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-05185-y

Keywords

Navigation