Loading [a11y]/accessibility-menu.js
Boosting Graph Contrastive Learning via Adaptive Sampling | IEEE Journals & Magazine | IEEE Xplore

Boosting Graph Contrastive Learning via Adaptive Sampling


Abstract:

Contrastive learning (CL) is a prominent technique for self-supervised representation learning, which aims to contrast semantically similar (i.e., positive) and dissimila...Show More

Abstract:

Contrastive learning (CL) is a prominent technique for self-supervised representation learning, which aims to contrast semantically similar (i.e., positive) and dissimilar (i.e., negative) pairs of examples under different augmented views. Recently, CL has provided unprecedented potential for learning expressive graph representations without external supervision. In graph CL, the negative nodes are typically uniformly sampled from augmented views to formulate the contrastive objective. However, this uniform negative sampling strategy limits the expressive power of contrastive models. To be specific, not all the negative nodes can provide sufficiently meaningful knowledge for effective contrastive representation learning. In addition, the negative nodes that are semantically similar to the anchor are undesirably repelled from it, leading to degraded model performance. To address these limitations, in this article, we devise an adaptive sampling strategy termed “AdaS. ” The proposed AdaS framework can be trained to adaptively encode the importance of different negative nodes, so as to encourage learning from the most informative graph nodes. Meanwhile, an auxiliary polarization regularizer is proposed to suppress the adverse impacts of the false negatives and enhance the discrimination ability of AdaS. The experimental results on a variety of real-world datasets firmly verify the effectiveness of our AdaS in improving the performance of graph CL.
Published in: IEEE Transactions on Neural Networks and Learning Systems ( Volume: 35, Issue: 11, November 2024)
Page(s): 15971 - 15983
Date of Publication: 13 July 2023

ISSN Information:

PubMed ID: 37440376

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.