paper-with-me

홈 › Papers

DAFOS: Dynamic Adaptive Fanout Optimization Sampler

2025-07-08 · Irfan Ullah, Young-Koo Lee arxiv

Graph Neural Networks (GNNs) are becoming an essential tool for learning from graph-structured data, however uniform neighbor sampling and static fanout settings frequently limit GNNs' scalability and efficiency. In this paper, we propose the Dynamic Adaptive Fanout Optimization Sampler (DAFOS), a novel approach that dynamically adjusts the fanout based on model performance and prioritizes important nodes during training. Our approach leverages node scoring based on node degree to focus computational resources on structurally important nodes, incrementing the fanout as the model training progresses. DAFOS also integrates an early stopping mechanism to halt training when performance gains diminish. Experiments conducted on three benchmark datasets, ogbnarxiv, Reddit, and ogbn-products, demonstrate that our approach significantly improves training speed and accuracy compared to a state-of-the-art approach. DAFOS achieves a 3.57x speedup on the ogbn-arxiv dataset and a 12.6x speedup on the Reddit dataset while improving the F1 score from 68.5% to 71.21% on ogbn-arxiv and from 73.78% to 76.88% on the ogbn-products dataset, respectively. These results highlight the potential of DAFOS as an efficient and scalable solution for large-scale GNN training.

📄 PDF Abstract BibTeX arXiv:2507.08845

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Domain Adaptive Few-Shot Open-Set Learning

2023-09-22 · ICCV 2023 1 · Debabrata Pal, Deeptej More, Sai Bhargav, Dipesh Tamboli 외

Few-shot learning has made impressive strides in addressing the crucial challenges of recognizing unknown samples from novel classes in target query sets and managing visual shifts between domains. However, existing tech…

cross-domain few-shot learningFew-Shot LearningMeta-LearningOpen Set Learning

Global convergence of optimized adaptive importance samplers

2022-01-02 · Ömer Deniz Akyildiz

We analyze the optimized adaptive importance sampler (OAIS) for performing Monte Carlo integration with general proposals. We leverage a classical result which shows that the bias and the mean-squared error (MSE) of the …

global-optimization

Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and Pipelining

2021-10-16 · Tim Kaler, Nickolas Stathas, Anne Ouyang, Alexandros-Stavros Iliopoulos 외

Improving the training and inference performance of graph neural networks (GNNs) is faced with a challenge uncommon in general neural networks: creating mini-batches requires a lot of computation and data movement due to…

GPU

Adaptive Bayesian Sampling with Monte Carlo EM

2017-11-06 · NeurIPS 2017 12 · Anirban Roychowdhury, Srinivasan Parthasarathy

We present a novel technique for learning the mass matrices in samplers obtained from discretized dynamics that preserve some energy function. Existing adaptive samplers use Riemannian preconditioning techniques, where t…

A Neural Network MCMC sampler that maximizes Proposal Entropy

2020-10-07 · Zengyi Li, Yubei Chen, Friedrich T. Sommer

Markov Chain Monte Carlo (MCMC) methods sample from unnormalized probability distributions and offer guarantees of exact sampling. However, in the continuous case, unfavorable geometry of the target distribution can grea…