paper-with-me

홈 › Papers

Robust Optimization as Data Augmentation for Large-scale Graphs

2020-10-19 · CVPR 2022 1 · Kezhi Kong, Guohao Li, Mucong Ding, Zuxuan Wu, Chen Zhu, Bernard Ghanem, Gavin Taylor, Tom Goldstein

Data augmentation helps neural networks generalize better by enlarging the training set, but it remains an open question how to effectively augment graph data to enhance the performance of GNNs (Graph Neural Networks). While most existing graph regularizers focus on manipulating graph topological structures by adding/removing edges, we offer a method to augment node features for better performance. We propose FLAG (Free Large-scale Adversarial Augmentation on Graphs), which iteratively augments node features with gradient-based adversarial perturbations during training. By making the model invariant to small fluctuations in input data, our method helps models generalize to out-of-distribution samples and boosts model performance at test time. FLAG is a general-purpose approach for graph data, which universally works in node classification, link prediction, and graph classification tasks. FLAG is also highly flexible and scalable, and is deployable with arbitrary GNN backbones and large-scale datasets. We demonstrate the efficacy and stability of our method through extensive experiments and ablation studies. We also provide intuitive observations for a deeper understanding of our method.

📄 PDF Abstract BibTeX arXiv:2010.09891

Code (3)

devnkong/FLAG 공식 구현 pytorch
sangyx/gtrick/tree/main/benchmark/pyg pytorch
ytchx1999/GCN_res-FLAG pytorch

Tasks

Data AugmentationGraph ClassificationLink PredictionNode ClassificationNode Property PredictionOpen-Ended Question Answering

Similar Papers 제목 키워드 기반

GRAND+: Scalable Graph Random Neural Networks

2022-03-12 · Wenzheng Feng, Yuxiao Dong, Tinglin Huang, Ziqi Yin 외

Graph neural networks (GNNs) have been widely adopted for semi-supervised learning on graphs. A recent study shows that the graph random neural network (GRAND) model can generate state-of-the-art performance for this pro…

Data AugmentationGraph LearningModel OptimizationNode Classification

Jointly Learnable Data Augmentations for Self-Supervised GNNs

2021-08-23 · Zekarias T. Kefato, Sarunas Girdzijauskas, Hannes Stärk

Self-supervised Learning (SSL) aims at learning representations of objects without relying on manual labeling. Recently, a number of SSL methods for graph representation learning have achieved performance comparable to S…

Data AugmentationGraph Representation LearningNode ClassificationRepresentation Learning+1

Large-Scale Representation Learning on Graphs via Bootstrapping

2021-02-12 · ICLR 2022 4 · Shantanu Thakoor, Corentin Tallec, Mohammad Gheshlaghi Azar, Mehdi Azabou 외

Self-supervised learning provides a promising path towards eliminating the need for costly label information in representation learning on graphs. However, to achieve state-of-the-art performance, methods often need larg…

Contrastive LearningGraph Representation LearningRepresentation LearningSelf-Supervised Learning

Through the Dual-Prism: A Spectral Perspective on Graph Data Augmentation for Graph Classification

2024-01-18 · Yutong Xia, Runpeng Yu, Yuxuan Liang, Xavier Bresson 외

Graph Neural Networks have become the preferred tool to process graph data, with their efficacy being boosted through graph data augmentation techniques. Despite the evolution of augmentation methods, issues like graph p…

Data AugmentationGraph Classification

DAVINCI: A Single-Stage Architecture for Constrained CAD Sketch Inference

2024-10-30 · Ahmet Serdar Karadeniz, Dimitrios Mallis, Nesryne Mejri, Kseniya Cherenkova 외

This work presents DAVINCI, a unified architecture for single-stage Computer-Aided Design (CAD) sketch parameterization and constraint inference directly from raster sketch images. By jointly learning both outputs, DAVIN…

Data Augmentation