paper-with-me

Papers

GIMM: InfoMin-Max for Automated Graph Contrastive Learning

2023-05-27 · Xin Xiong, Furao Shen, Xiangyu Wang, Jian Zhao

Graph contrastive learning (GCL) shows great potential in unsupervised graph representation learning. Data augmentation plays a vital role in GCL, and its optimal choice heavily depends on the downstream task. Many GCL methods with automated data augmentation face the risk of insufficient information as they fail to preserve the essential information necessary for the downstream task. To solve this problem, we propose InfoMin-Max for automated Graph contrastive learning (GIMM), which prevents GCL from encoding redundant information and losing essential information. GIMM consists of two major modules: (1) automated graph view generator, which acquires the approximation of InfoMin's optimal views through adversarial training without requiring task-relevant information; (2) view comparison, which learns an excellent encoder by applying InfoMax to view representations. To the best of our knowledge, GIMM is the first method that combines the InfoMin and InfoMax principles in GCL. Besides, GIMM introduces randomness to augmentation, thus stabilizing the model against perturbations. Extensive experiments on unsupervised and semi-supervised learning for node and graph classification demonstrate the superiority of our GIMM over state-of-the-art GCL methods with automated and manual data augmentation.

📄 PDF Abstract BibTeX arXiv:2305.17437

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningData AugmentationGraph ClassificationGraph Representation LearningRepresentation Learning

Methods 이 논문이 사용한 방법론

fail 설명 없음
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Bringing Your Own View: Graph Contrastive Learning without Prefabricated Data Augmentations

2022-01-04 · Yuning You, Tianlong Chen, Zhangyang Wang, Yang shen

Self-supervision is recently surging at its new frontier of graph learning. It facilitates graph representations beneficial to downstream tasks; but its success could hinge on domain knowledge for handcraft or the often …

Contrastive LearningGraph Learning

Adversarial Learning Data Augmentation for Graph Contrastive Learning in Recommendation

2023-02-05 · JunJie Huang, Qi Cao, Ruobing Xie, Shaoliang Zhang 외

Recently, Graph Neural Networks (GNNs) achieve remarkable success in Recommendation. To reduce the influence of data sparsity, Graph Contrastive Learning (GCL) is adopted in GNN-based CF methods for enhancing performance…

Contrastive LearningData Augmentation

MGIMM: Multi-Granularity Instruction Multimodal Model for Attribute-Guided Remote Sensing Image Detailed Description

2024-06-07 · Cong Yang, Zuchao Li, Lefei Zhang

Recently, large multimodal models have built a bridge from visual to textual information, but they tend to underperform in remote sensing scenarios. This underperformance is due to the complex distribution of objects and…

Attribute

Scalable Infomin Learning

2023-02-21 · Yanzhi Chen, Weihao Sun, Yingzhen Li, Adrian Weller

The task of infomin learning aims to learn a representation with high utility while being uninformative about a specified target, with the latter achieved by minimising the mutual information between the representation a…

Domain AdaptationFairnessRepresentation Learning

Generalizable Implicit Motion Modeling for Video Frame Interpolation

2024-07-11 · Zujin Guo, Wei Li, Chen Change Loy

Motion modeling is critical in flow-based Video Frame Interpolation (VFI). Existing paradigms either consider linear combinations of bidirectional flows or directly predict bilateral flows for given timestamps without ex…

Video Frame Interpolation