paper-with-me

Papers

GALA: Graph Diffusion-based Alignment with Jigsaw for Source-free Domain Adaptation

2024-10-22 · Junyu Luo, Yiyang Gu, Xiao Luo, Wei Ju, Zhiping Xiao, Yusheng Zhao, Jingyang Yuan, Ming Zhang

Source-free domain adaptation is a crucial machine learning topic, as it contains numerous applications in the real world, particularly with respect to data privacy. Existing approaches predominantly focus on Euclidean data, such as images and videos, while the exploration of non-Euclidean graph data remains scarce. Recent graph neural network (GNN) approaches can suffer from serious performance decline due to domain shift and label scarcity in source-free adaptation scenarios. In this study, we propose a novel method named Graph Diffusion-based Alignment with Jigsaw (GALA), tailored for source-free graph domain adaptation. To achieve domain alignment, GALA employs a graph diffusion model to reconstruct source-style graphs from target data. Specifically, a score-based graph diffusion model is trained using source graphs to learn the generative source styles. Then, we introduce perturbations to target graphs via a stochastic differential equation instead of sampling from a prior, followed by the reverse process to reconstruct source-style graphs. We feed the source-style graphs into an off-the-shelf GNN and introduce class-specific thresholds with curriculum learning, which can generate accurate and unbiased pseudo-labels for target graphs. Moreover, we develop a simple yet effective graph-mixing strategy named graph jigsaw to combine confident graphs and unconfident graphs, which can enhance generalization capabilities and robustness via consistency learning. Extensive experiments on benchmark datasets validate the effectiveness of GALA.

📄 PDF Abstract BibTeX arXiv:2410.16606

Code (1)

luo-junyu/gala 공식 구현 pytorch

Tasks

Domain AdaptationGRAPH DOMAIN ADAPTATIONGraph Neural NetworkSource-Free Domain Adaptation

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Jigsaw Jigsaw is a self-supervision approach that relies on jigsaw-like puzzles as the pretext task in order to learn image representations.
Focus 설명 없음
GALA Most attention mechanisms learn where to focus using only weak supervisory signals from class labels, which inspired Linsley et al. to investigate how explicit human supervision…

Similar Papers 제목 키워드 기반

Geometric deep learning for galaxy-halo connection: a case study for galaxy intrinsic alignments

2024-09-27 · Yesukhei Jagvaral, Francois Lanusse, Rachel Mandelbaum

Forthcoming cosmological imaging surveys, such as the Rubin Observatory LSST, require large-scale simulations encompassing realistic galaxy populations for a variety of scientific applications. Of particular concern is t…

Euclid Quick Data Release (Q1). Active galactic nuclei identification using diffusion-based inpainting of Euclid VIS images

2025-03-19 · Euclid Collaboration, G. Stevens, S. Fotopoulou, M. N. Bremer 외

Light emission from galaxies exhibit diverse brightness profiles, influenced by factors such as galaxy type, structural features and interactions with other galaxies. Elliptical galaxies feature more uniform light distri…

Graph-Jigsaw Conditioned Diffusion Model for Skeleton-based Video Anomaly Detection

2024-03-18 · Ali Karami, Thi Kieu Khanh Ho, Narges Armanfard

Skeleton-based video anomaly detection (SVAD) is a crucial task in computer vision. Accurately identifying abnormal patterns or events enables operators to promptly detect suspicious activities, thereby enhancing safety.…

Anomaly DetectionGraph AttentionVideo Anomaly Detection

JigsawRL: Assembling RL Pipelines for Efficient LLM Post-Training

2026-04-26 · Zhengding Hu, Hehua Ouyang, Chang Chen, Zaifeng Pan 외 arxiv

We present JigsawRL, a cost-efficient framework that explores Pipeline Multiplexing as a new dimension of RL parallelism. JigsawRL decomposes each pipeline into a Sub-Stage Graph that exposes the intra-stage and inter-wo…

On the Trainability of Masked Diffusion Language Models via Blockwise Locality

2026-04-27 · Yuxiang Wang, Yu Xiang, Baojian Zhou, Qifang Zhao 외 arxiv

Masked diffusion language models (MDMs) have recently emerged as a promising alternative to standard autoregressive large language models (AR-LLMs), yet their optimization can be substantially less stable. We study block…