Skip to main content

Advertisement

Springer Nature Link
Log in

Semi-supervised heterogeneous graph contrastive learning with label-guided

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Heterogeneous Graph Neural Networks represent a powerful approach to understand and utilize the intricate structures and semantics within complex graphs. When it comes to semi-supervised learning on graphs, the challenge lies in effectively leveraging labeled data to generalize predictions to unlabeled nodes. Traditional methods often fall short in fully utilizing labeled information, limiting their performance to the number of available labels. To overcome these limitations, in this paper, we propose a Semi-Supervised Heterogeneous Graph Contrastive Learning with Label-Guided (SSGCL-LG) model. SSGCL-LG tackles this challenge by fully integrating label information into the learning process through contrastive learning. Specifically, it constructs a label graph that incorporates both node and label representations, enhancing the supervised signal. Moreover, we propose a novel strategy for selecting positive and negative samples based on labels and meta-paths, effectively pulling positive samples closer together in the embedding space. To optimize node representations, SSGCL-LG combines contrastive loss with semi-supervised loss, enabling the model to learn from both labeled and unlabeled data. Extensive experiments on real-world datasets validate the effectiveness of our framework, demonstrating its superiority over existing methods. The code for this work is publicly available in the https://github.com/sun281210/SSGCL-LG.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Availability of Supporting Data

The datasets used in the experiments are publicly available in the online repository.

Notes

  1. https://dl.acm.org/

  2. http://www.imdb.com/

  3. https://github.com/cynricfu/MAGNN

References

  1. Wang Q, Zhu C, Zhang Y, Zhong H, Zhong J, Sheng VS (2022) Short text topic learning using heterogeneous information network. IEEE Trans Knowl Data Eng 35(5):5269–5281

    Google Scholar 

  2. Wang X, Bo D, Shi C, Fan S, Ye Y, Philip SY (2022) A survey on heterogeneous graph embedding: methods, techniques, applications and sources. IEEE Transactions on Big Data. 9(2):415–436

    Article  Google Scholar 

  3. Han M, Zhang H, Li W, Yin Y (2023) Semantic-guided graph neural network for heterogeneous graph embedding. Expert Syst Appl 232:120810

    Article  Google Scholar 

  4. Salamat A, Luo X, Jafari A (2021) Heterographrec: a heterogeneous graph-based neural networks for social recommendations. Knowl-Based Syst 217:106817

    Article  Google Scholar 

  5. Huang M (2021) Research on graph network recommendation algorithm based on random walk and convolutional neural network. In: 2021 International Conference on High Performance Big Data and Intelligent Systems (HPBD &IS), pp 57–64 . IEEE

  6. Louis A, Van Dijck G, Spanakis G (2023) Finding the law: enhancing statutory article retrieval via graph neural networks. arXiv:2301.12847

  7. Qi R, Zhang Z, Wu J, Dou L, Xu L, Cheng Y (2024) A new method for handling heterogeneous data in bioinformatics. Comput Biol Med 170:107937

    Article  Google Scholar 

  8. Zhao J, Wang X, Shi C, Liu Z, Ye Y (2020) Network schema preserving heterogeneous information network embedding. In: International Joint Conference on Artificial Intelligence (IJCAI)

  9. Yao K, Wang X, Li W, Zhu H, Jiang Y, Li Y, Tian T, Yang Z, Liu Q, Liu Q (2023) Semi-supervised heterogeneous graph contrastive learning for drug-target interaction prediction. Comput Biol Med 163:107199

    Article  Google Scholar 

  10. Liu X, Zhang F, Hou Z, Mian L, Wang Z, Zhang J, Tang J (2021) Self-supervised learning: Generative or contrastive. IEEE Trans Knowl Data Eng 35(1):857–876

    Google Scholar 

  11. Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks. Int conf learn represent

  12. Hamilton W, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. Adv neural inf process syst 30

  13. Veličković P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y (2017) Graph attention networks. arXiv:1710.10903

  14. Liao Z, Zhang X, Su W, Zhan K (2022) View-consistent heterogeneous network on graphs with few labeled nodes. IEEE Trans Cyber

  15. You Y, Chen T, Sui Y, Chen T, Wang Z, Shen Y (2020) Graph contrastive learning with augmentations. Adv Neural Inf Process Syst 33:5812–5823

    Google Scholar 

  16. Zhao X, Wu J, Zhao X, Yin M (2023) Multi-view contrastive heterogeneous graph attention network for lncrna-disease association prediction. Brief Bioinform 24(1):548

    Article  Google Scholar 

  17. Zhang Q, Zhao Z, Zhou H, Li X, Li C (2023) Self-supervised contrastive learning on heterogeneous graphs with mutual constraints of structure and feature. Inf Sci 640:119026

    Article  Google Scholar 

  18. Xue W, He Z, Cui W, Li L, Yang Z, Lu S (2023) Unidirectional reflectionless propagation of near-infrared light in heterogeneous metamaterials. Physica E 147:115593

    Article  Google Scholar 

  19. Wang X, Zhu M, Bo D, Cui P, Shi C, Pei J (2020) Am-gcn: adaptive multi-channel graph convolutional networks. In: Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1243–1253

  20. Wang X, Ji H, Shi C, Wang B, Ye Y, Cui P, Yu PS (2019) Heterogeneous graph attention network. In: The world wide web conference, pp 2022–2032

  21. Fu X, Zhang J, Meng Z, King I (2020) Magnn: metapath aggregated graph neural network for heterogeneous graph embedding. In: Proceedings of the web conference 2020, pp 2331–2341

  22. Zhang C, Song D, Huang C, Swami A, Chawla NV (2019) Heterogeneous graph neural network. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 793–803

  23. Hu Z, Dong Y, Wang K, Sun Y (2020) Heterogeneous graph transformer. In: Proceedings of the Web conference 2020, pp 2704–2710

  24. Zhao J, Wang X, Shi C, Hu B, Song G, Ye Y (2021) Heterogeneous graph structure learning for graph neural networks. In: Proceedings of the AAAI conference on artificial intelligence, vol 35, pp 4697–4705

  25. Yang Y, Guan Z, Li J, Zhao W, Cui J, Wang Q (2021) Interpretable and efficient heterogeneous graph convolutional network. IEEE Trans Knowl Data Eng 35(2):1637–1650

    Google Scholar 

  26. Zhang M, Wang X, Zhu M, Shi C, Zhang Z, Zhou J (2022) Robust heterogeneous graph neural networks against adversarial attacks. In: Proceedings of the AAAI conference on artificial intelligence, vol 36, pp 4363–4370

  27. Ji H, Wang X, Shi C, Wang B, Philip SY (2021) Heterogeneous graph propagation network. IEEE Trans Knowl Data Eng 35(1):521–532

    Google Scholar 

  28. Liu Z, Wang C, Han C, Guo T (2023) Learning graph representation by aggregating subgraphs via mutual information maximization. Neurocomputing 548:126392

  29. Fang U, Li J, Akhtar N, Li M, Jia Y (2023) Gomic: multi-view image clustering via self-supervised contrastive heterogeneous graph co-learning. World Wide Web. 26(4):1667–1683

    Article  Google Scholar 

  30. Ren Y, Liu B, Huang C, Dai P, Bo L, Zhang J (2019) Heterogeneous deep graph infomax. Workshop of deep learning on graphs: methodologies and applications co-located with the thirty-fourth AAAI conference on artificial intelligence

  31. Park C, Kim D, Han J, Yu H (2020) Unsupervised attributed multiplex network embedding. In: Proceedings of the AAAI conference on artificial intelligence, vol 34, pp 5371–5378

  32. Wang X, Liu N, Han H, Shi C (2021) Self-supervised heterogeneous graph neural network with co-contrastive learning. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, pp 1726–1736

Download references

Acknowledgements

This work is supported by National Key R&D Program of China (Grant No. 2022ZD0119501); the Natural Science Foundation of Shandong Province (Grant No. ZR2022MF268, ZR2021QG038); the Social Science Planning and Research Project of Shandong Province (Grant No.22CFXJ07), the ‘Qunxing Plan’ project of educational and teaching research of Shandong University of Science and Technology (Grant No. QX2020Z12), the Undergraduate Teaching Reform Research Rroject of Shandong Province (Grant No. M2023277).

Author information

Authors and Affiliations

  1. College of of Electronic and Information Engineering, Shandong University of Science and Technology, Qingdao, 266590, Shandong, China

    Chao Li, Guoyi Sun & Xin Li

  2. College of Humanities and Law, Shandong University of Science and Technology, Qingdao, 266590, Shandong, China

    Juan Shan

Authors
  1. Chao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guoyi Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Juan Shan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Chao Li, Guoyi Sun, Juan Shan wrote the main manuscript text; Guoyi Sun and Xin Li prepared the result of our experiments; All authors reviewed the manuscript.

Corresponding author

Correspondence to Juan Shan.

Ethics declarations

Competing Interests

The authors declare that there is no competing interests.

Ethical Approval

Not applicable.

Consent to Participate

There is the consent of all authors.

Human and Animal Ethics

Not applicable.

Consent for publication

There is the consent of all authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, C., Sun, G., Li, X. et al. Semi-supervised heterogeneous graph contrastive learning with label-guided. Appl Intell 54, 10055–10071 (2024). https://doi.org/10.1007/s10489-024-05703-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-024-05703-8

Keywords

Search

Navigation