paper-with-me

Papers

From Moments to Models: Graphon-Mixture Learning for Mixup and Contrastive Learning

2025-10-04 · Ali Azizpour, Reza Ramezanpour, Santiago Segarra arxiv

Real-world graph datasets often arise from mixtures of populations, where graphs are generated by multiple distinct underlying distributions. In this work, we propose a unified framework that explicitly models graph data as a mixture of probabilistic graph generative models represented by graphons. To characterize and estimate these graphons, we leverage graph moments (motif densities) to cluster graphs generated from the same underlying model. We establish a novel theoretical guarantee, deriving a tighter bound showing that graphs sampled from structurally similar graphons exhibit similar motif densities with high probability. This result enables principled estimation of graphon mixture components. We show how incorporating estimated graphon mixture components enhances two widely used downstream paradigms: graph data augmentation via mixup and graph contrastive learning. By conditioning these methods on the underlying generative models, we develop graphon-mixture-aware mixup (GMAM) and model-aware graph contrastive learning (MGCL). Extensive experiments on both simulated and real-world datasets demonstrate strong empirical performance. In supervised learning, GMAM outperforms existing augmentation strategies, achieving new state-of-the-art accuracy on 6 out of 7 datasets. In unsupervised learning, MGCL performs competitively across seven benchmark datasets and achieves the lowest average rank overall.

📄 PDF Abstract BibTeX arXiv:2510.03690

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningData Augmentation

Similar Papers 제목 키워드 기반

G-Mixup: Graph Augmentation for Graph Classification

2021-09-29 · Xiaotian Han, Zhimeng Jiang, Ninghao Liu, Xia Hu

This work develops \emph{mixup to graph data}. Mixup has shown superiority in improving the generalization and robustness of neural networks by interpolating features and labels of random two samples. Traditionally, Mixu…

ClassificationGraph Classification

G-Mixup: Graph Data Augmentation for Graph Classification

2022-02-15 · Xiaotian Han, Zhimeng Jiang, Ninghao Liu, Xia Hu

This work develops \emph{mixup for graph data}. Mixup has shown superiority in improving the generalization and robustness of neural networks by interpolating features and labels between two random samples. Traditionally…

ClassificationData AugmentationGraph Classification

Mixup Your Own Pairs

2023-09-28 · Yilei Wu, Zijian Dong, Chongyao Chen, Wangchunshu Zhou 외

In representation learning, regression has traditionally received less attention than classification. Directly applying representation learning techniques designed for classification to regression often results in fragme…

Contrastive LearningregressionRepresentation LearningTime Series+1

Graphon Mixtures

2025-05-20 · Sevvandi Kandanaarachchi, Cheng Soon Ong

Social networks have a small number of large hubs, and a large number of small dense communities. We propose a generative model that captures both hub and dense structures. Based on recent results about graphons on line …

GraphMAD: Graph Mixup for Data Augmentation using Data-Driven Convex Clustering

2022-10-27 · Madeline Navarro, Santiago Segarra

We develop a novel data-driven nonlinear mixup mechanism for graph data augmentation and present different mixup functions for sample pairs and their labels. Mixup is a data augmentation method to create new training dat…

ClusteringData AugmentationGraph Classification