AFANS: Augmentation-Free Graph Contrastive Learning with Adversarial Negative Sampling

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Graph Contrastive Learning (GCL) has emerged as a highly promising methodology in graph representation learning, mainly due to its label-independent nature. The construction of positive and negative samples is crucial for the effectiveness of GCL. Yet, the accurate identification of genuine positive and negative samples poses a formidable challenge. Traditional methods employ data augmentation for constructing positive samples, which confronts two significant impediments: i) the potential distortion of semantic integrity and ii) the difficulty in devising augmentation strategies universally applicable across diverse datasets. In the realm of negative sample generation, reliance on in-batch negative samples or a memory bank may engender “easy” or “false” negative samples, detrimentally impacting model performance. To address these issues, we propose to use Exponential Moving Average (EMA) instead of data augmentation to construct effective positive samples. Additionally, we introduce an adversarial generator to fabricate more challenging negative samples, which are subsequently amalgamated with in-batch negative samples. Furthermore, we implement two constrained loss functions aimed at reducing redundancy amongst negative samples, enriching the model with more salient information. The effectiveness of our proposed method is validated through an unsupervised graph classification task on five real-world datasets. Empirical results substantiate that our approach surpasses current state-of-the-art methodologies.

Original languageEnglish
Title of host publicationAdvanced Intelligent Computing Technology and Applications - 20th International Conference, ICIC 2024, Proceedings
EditorsDe-Shuang Huang, Yijie Pan, Jiayang Guo
PublisherSpringer Science and Business Media Deutschland GmbH
Pages376-387
Number of pages12
ISBN (Print)9789819756148
DOIs
StatePublished - 2024
Event20th International Conference on Intelligent Computing, ICIC 2024 - Tianjin, China
Duration: 5 Aug 20248 Aug 2024

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14873 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference20th International Conference on Intelligent Computing, ICIC 2024
Country/TerritoryChina
CityTianjin
Period5/08/248/08/24

Keywords

  • Adversarial Generation
  • Data Augmentation
  • Graph Contrastive Learning

Fingerprint

Dive into the research topics of 'AFANS: Augmentation-Free Graph Contrastive Learning with Adversarial Negative Sampling'. Together they form a unique fingerprint.

Cite this