Skip to main content

Multiview Similarity Learning for Robust Visual Clustering

  • Conference paper
  • First Online:
Computer Vision – ACCV 2020 Workshops (ACCV 2020)

Abstract

Multiview similarity learning aims to measure the neighbor relationship between each pair of samples, which has been widely used in data mining and presents encouraging performance on lots of applications. Nevertheless, the recent existing multiview similarity learning methods have two main drawbacks. On one hand, the comprehensive consensus similarity is learned based on previous fixed graphs learned from all views separately, which ignores the latent cues hidden in graphs from different views. On the other hand, when the data are contaminated with noise or outlier, the performance of existing methods will decline greatly because the original true data distribution is destroyed. To address the two problems, a Robust Multiview Similarity Learning (RMvSL) method is proposed in this paper. The contributions of RMvSL includes three aspects. Firstly, the recent low-rank representation shows some advantage in removing noise and outliers, which motivates us to introduce the data representation via low-rank constraint in order to generate clean reconstructed data for robust graph learning in each view. Secondly, a multiview scheme is established to learn the consensus similarity by dynamically learned graphs from all views. Meanwhile, the consensus similarity can be used to propagate the latent relationship information from other views to learn each view graph in turn. Finally, the above two processes are put into a unified objective function to optimize the data reconstruction, view graphs learning and consensus similarity graph learning alternatingly, which can help to obtain overall optimal solutions. Experimental results on several visual data clustering demonstrates that RMvSL outperforms the most existing methods on similarity learning and presents great robustness on noisy data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Cheng, B., Yang, J., Yan, S., Fu, Y., Huang, T.S.: Learning with l1-graph for image analysis. IEEE Trans. Image Process. 19, 858–66 (2010)

    Article  MathSciNet  Google Scholar 

  2. Fang, X., Xu, Y., Li, X., Lai, Z., Wong, W.K.: Robust semi-supervised subspace clustering via non-negative low-rank representation. IEEE Trans. Syst. 46, 1828–1838 (2016)

    Google Scholar 

  3. Nie, F., Wang, X., Huang, H.: Clustering and projected clustering with adaptive neighbors. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 977–986 (2014)

    Google Scholar 

  4. Kang, Z., Pan, H., Hoi, S.C.H., Xu, Z.: Robust graph learning from noisy data. IEEE Trans. Cybern. 50, 1833–1843 (2019)

    Google Scholar 

  5. Liu, M., Luo, Y., Tao, D., Xu, C., Wen, Y.: Low-rank multi-view learning in matrix completion for multi-label image classification. In: National Conference on Artificial Intelligence, pp. 2778–2784 (2015)

    Google Scholar 

  6. Wang, Q., Dou, Y., Liu, X., Lv, Q., Li, S.: Multi-view clustering with extreme learning machine. Neurocomputing 214, 483–494 (2016)

    Article  Google Scholar 

  7. Zhang, C., Hu, Q., Fu, H., Zhu, P., Cao, X.: Latent multi-view subspace clustering. In: Computer Vision and Pattern Recognition, pp. 4333–4341 (2017)

    Google Scholar 

  8. Li, B., et al.: Multi-view multi-instance learning based on joint sparse representation and multi-view dictionary learning. IEEE Trans. Pattern Anal. Mach. Intell. 39, 2554–2560 (2017)

    Article  Google Scholar 

  9. Jing, X., Wu, F., Dong, X., Shan, S., Chen, S.: Semi-supervised multi-view correlation feature learning with application to webpage classification. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, pp. 1374–1381 (2017)

    Google Scholar 

  10. Wu, J., Lin, Z., Zha, H.: Essential tensor learning for multi-view spectral clustering. IEEE Trans. Image Process. 28, 5910–5922 (2019)

    Article  MathSciNet  Google Scholar 

  11. Xing, J., Niu, Z., Huang, J., Hu, W., Zhou, X., Yan, S.: Towards robust and accurate multi-view and partially-occluded face alignment. IEEE Trans. Pattern Anal. Mach. Intell. 40, 987–1001 (2018)

    Article  Google Scholar 

  12. Nie, F., Li, J., Li, X.: Parameter-free auto-weighted multiple graph learning: a framework for multiview clustering and semi-supervised classification. In: International Joint Conference on Artificial Intelligence, pp. 1881–1887 (2016)

    Google Scholar 

  13. Nie, F., Li, J., Li, X.: Self-weighted multiview clustering with multiple graphs. In: International Joint Conference on Artificial Intelligence, pp. 2564–2570 (2017)

    Google Scholar 

  14. Zhan, K., Shi, J., Wang, J., Wang, H., Xie, Y.: Adaptive structure concept factorization for multiview clustering. Neural Comput. 30, 1080–1103 (2018)

    Article  MathSciNet  Google Scholar 

  15. Zhan, K., Nie, F., Wang, J., Yang, Y.: Multiview consensus graph clustering. IEEE Trans. Image Process. 28, 1261–1270 (2019)

    Article  MathSciNet  Google Scholar 

  16. Kang, Z., et al.: Multi-graph fusion for multi-view spectral clustering. Knowl. Based Syst. 189, 102–105 (2020)

    Article  Google Scholar 

  17. Zhang, L., Zhang, Q., Du, B., You, J., Tao, D.: Adaptive manifold regularized matrix factorization for data clustering. In: International Joint Conference on Artificial Intelligence, pp. 3399–3405 (2017)

    Google Scholar 

  18. Du, L., Shen, Y.: Unsupervised feature selection with adaptive structure learning. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 209–218 (2015)

    Google Scholar 

  19. Cai, S., Kang, Z., Yang, M., Xiong, X., Peng, C., Xiao, M.: Image denoising via improved dictionary learning with global structure and local similarity preservations. Symmetry 10, 167 (2018)

    Article  Google Scholar 

  20. Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., Ma, Y.: Robust recovery of subspace structures by low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35, 171–184 (2013)

    Article  Google Scholar 

  21. Bartels, R.H., Stewart, G.W.: Solution of the matrix equation ax + xb = c [f4]. Commun. ACM 15, 820–826 (1972)

    Article  Google Scholar 

  22. Candes, E.J., Li, X., Ma, Y., Wright, J.: Robust principal component analysis. J. ACM 58, 11 (2011)

    Article  MathSciNet  Google Scholar 

  23. Duchi, J.C., Shalevshwartz, S., Singer, Y., Chandra, T.D.: Efficient projections onto the l1-ball for learning in high dimensions. In: International Conference on Machine Learning, pp. 272–279 (2008)

    Google Scholar 

  24. Wang, H., Yang, Y., Liu, B.: GMC: graph-based multi-view clustering. IEEE Trans. Knowl. Data Eng. 32, 1116–1129 (2019)

    Google Scholar 

  25. Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24, 971–987 (2002)

    Article  Google Scholar 

  26. Lades, M., et al.: Distortion invariant object recognition in the dynamic link architecture. IEEE Trans. Comput. 42, 300–311 (1993)

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under Grant 62071157, University Nursing Program for Young Scholars with Creative Talents in Heilongjiang Province under Grant UNPYSCT-2018203, Natural Science Foundation of Heilongjiang Province under Grant YQ2019F011, Fundamental Research Foundation for University of Heilongjiang Province under Grant LGYC2018JQ013, and Postdoctoral Foundation of Heilongjiang Province under Grant LBH-Q19112.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ao Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, A., Chen, J., Chen, D., Sun, G. (2021). Multiview Similarity Learning for Robust Visual Clustering. In: Sato, I., Han, B. (eds) Computer Vision – ACCV 2020 Workshops. ACCV 2020. Lecture Notes in Computer Science(), vol 12628. Springer, Cham. https://doi.org/10.1007/978-3-030-69756-3_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-69756-3_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-69755-6

  • Online ISBN: 978-3-030-69756-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics