Skip to main content

Hierarchical Ensemble for Multi-view Clustering

  • Conference paper
  • First Online:
Artificial Neural Networks and Machine Learning – ICANN 2021 (ICANN 2021)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12893))

Included in the following conference series:

  • 2640 Accesses

Abstract

Multi-view clustering is a challenging task due to the distinct feature distributions among different views. To permit complementarity while exploiting consistency among views, some multi-layer models have been developed. These models usually enforce consistent representation on the top layer for clustering purpose while allowing the other layers to represent various attributes of the multi-view data. However, a single consistent layer is often insufficient especially for complicated real-world tasks. In addition, the existing models often represent different views using the same number of layers without taking the various levels of complexity of different views into account. Furthermore, different views are often considered to be equal in the clustering process, which does not necessarily hold in many applications. To address these issues, in this paper, we present a hierarchical ensemble framework for multi-view clustering (HEMVC). It is superior to the existing methods in three facets. Firstly, HEMVC allows for different views to share more than one consistent layers and implement ensemble clustering on all shared layers. Secondly, it facilitates an adaptive clustering scheme by automatically quantifying the contribution of each layer and each view in the ensemble learning process. Thirdly, it represents different views using different numbers of layers to compensate various complexities of different views. To realize HEMVC, a two-stage algorithm has been derived and implemented. The experimental results on five benchmark datasets illustrate its performance by comparing with the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    To unify the number of the top shared layers in different views, the layer is numbered from top to bottom, which is opposite with Deep Semi-NMF [17]. It does not affect the rigorousness.

References

  1. Benton, A., Khayrallah, H.: Deep generalized canonical correlation analysis. arXiv preprint arXiv:1702.02519 (2017)

  2. Chao, G., Sun, S.: A survey on multi-view clustering. arXiv preprint arXiv:1712.06246 (2017)

  3. Zhou, Y., Cristea, A.I., Shi, L.: Connecting targets to tweets: semantic attention-based model for target-specific stance detection. In: Bouguettaya, A., et al. (eds.) WISE 2017, Part I. LNCS, vol. 10569, pp. 18–32. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68783-4_2

    Chapter  Google Scholar 

  4. Chen, M.S., Huang, L.: Multi-view clustering in latent embedding space. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 3513–3520 (2020)

    Google Scholar 

  5. Cheng, M., Jing, L., Ng, M.K.: Tensor-based low-dimensional representation learning for multi-view clustering. IEEE Trans. Image Process. 28(5), 2399–2414 (2019)

    Article  MathSciNet  Google Scholar 

  6. Ding, C.H., Li, T.: Convex and semi-nonnegative matrix factorizations. IEEE Trans. Pattern Anal. Mach. Intell. 32(1), 45–55 (2010)

    Article  Google Scholar 

  7. Gao, H., Nie, F.: Multi-view subspace clustering. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4238–4246 (2015)

    Google Scholar 

  8. Gönen, M., Alpaydın, E.: Multiple kernel learning algorithms. J. Mach. Learn. Res. 12, 2211–2268 (2011)

    MathSciNet  MATH  Google Scholar 

  9. Huang, D., Lai, J.H.: Robust ensemble clustering using probability trajectories. IEEE Trans. Knowl. Data Eng. 28(5), 1312–1326 (2016)

    Article  MathSciNet  Google Scholar 

  10. Huang, D., Wang, C.D.: Locally weighted ensemble clustering. IEEE Trans. Cybern. 48(5), 1460–1473 (2018)

    Article  Google Scholar 

  11. Jing, P., Su, Y.: Learning robust affinity graph representation for multi-view clustering. Inf. Sci. 544, 155–167 (2021)

    Article  MathSciNet  Google Scholar 

  12. Liu, J., Wang, C., Gao, J., Han, J.: Multi-view clustering via joint nonnegative matrix factorization. In: Proceedings of the SIAM International Conference on Data Mining, pp. 252–260 (2013)

    Google Scholar 

  13. Ng, M.K., Wu, Q.: A fast Markov chain based algorithm for MIML learning. Neurocomputing 216, 763–777 (2016)

    Article  Google Scholar 

  14. Nie, F., Cai, G.: Auto-weighted multi-view learning for image clustering and semi-supervised classification. IEEE Trans. Image Process. 27(3), 1501–1511 (2018)

    Article  MathSciNet  Google Scholar 

  15. Sun, S.: A survey of multi-view machine learning. Neural Comput. Appl. 23(7–8), 2031–2038 (2013)

    Article  Google Scholar 

  16. Tao, Z., Liu, H.: From ensemble clustering to multi-view clustering. In: Proceedings of the International Joint Conference on Artificial Intelligence, pp. 2843–2849 (2017)

    Google Scholar 

  17. Trigeorgis, G., Bousmalis, K.: A deep matrix factorization method for learning attribute representations. IEEE Trans. Pattern Anal. Mach. Intell. 39(3), 417–429 (2017)

    Article  Google Scholar 

  18. Wang, W., Arora, R.: On deep multi-view representation learning: objectives and optimization. arXiv preprint arXiv:1602.01024 (2016)

  19. Wang, X., Zhang, T.: Multiview clustering based on non-negative matrix factorization and pairwise measurements. IEEE Trans. Cybern. 49(9), 3333–3346 (2019)

    Article  Google Scholar 

  20. Wang, X., Guo, X.: Exclusivity-consistency regularized multi-view subspace clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 923–931 (2017)

    Google Scholar 

  21. Wang, Y., Wu, L.: Multi-view spectral clustering via structured low-rank matrix factorization. arXiv preprint arXiv:1709.01212 (2017)

  22. Wen, J., Xu, Y., Liu, H.: Incomplete multiview spectral clustering with adaptive graph learning. IEEE Trans. Cybern. 50(4), 1418–1429 (2020)

    Article  Google Scholar 

  23. Yin, M., Gao, J.: Low-rank multi-view clustering in third-order tensor space. arXiv preprint arXiv:1608.08336 (2016)

  24. Zhan, K., Zhang, C.: Graph learning for multiview clustering. IEEE Trans. Cybern. 8(99), 1–9 (2017)

    Google Scholar 

  25. Zhang, C., Fu, H.: Low-rank tensor constrained multiview subspace clustering. In: IEEE International Conference on Computer Vision, pp. 1582–1590 (2015)

    Google Scholar 

  26. Zhang, C., Fu, H.: Generalized latent multi-view subspace clustering. IEEE Trans. Pattern Anal. Mach. Intell. 42(1), 86–99 (2020)

    Article  MathSciNet  Google Scholar 

  27. Zhang, Y., Yang, Y.: A multitask multiview clustering algorithm in heterogeneous situations based on LLE and LE. Knowl.-Based Syst. 163, 776–786 (2019)

    Article  Google Scholar 

  28. Zhao, H.: Multi-view clustering via deep matrix factorization. In: Proceedings of the Association for Advancement of Artificial Intelligence, pp. 2921–2927 (2017)

    Google Scholar 

Download references

Acknowledgements

This work was supported in part by Beijing Natural Science Foundation under Grant Z180006.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Liu Yang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gao, F., Yang, L. (2021). Hierarchical Ensemble for Multi-view Clustering. In: Farkaš, I., Masulli, P., Otte, S., Wermter, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2021. ICANN 2021. Lecture Notes in Computer Science(), vol 12893. Springer, Cham. https://doi.org/10.1007/978-3-030-86365-4_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-86365-4_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-86364-7

  • Online ISBN: 978-3-030-86365-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics