paper-with-me

Papers

A Batch-Insensitive Dynamic GNN Approach to Address Temporal Discontinuity in Graph Streams

2025-06-24 · Yang Zhou, Xiaoning Ren

In dynamic graphs, preserving temporal continuity is critical. However, Memory-based Dynamic Graph Neural Networks (MDGNNs) trained with large batches often disrupt event sequences, leading to temporal information loss. This discontinuity not only deteriorates temporal modeling but also hinders optimization by increasing the difficulty of parameter convergence. Our theoretical study quantifies this through a Lipschitz upper bound, showing that large batch sizes enlarge the parameter search space. In response, we propose BADGNN, a novel batch-agnostic framework consisting of two core components: (1) Temporal Lipschitz Regularization (TLR) to control parameter search space expansion, and (2) Adaptive Attention Adjustment (A3) to alleviate attention distortion induced by both regularization and batching. Empirical results on three benchmark datasets show that BADGNN maintains strong performance while enabling significantly larger batch sizes and faster training compared to TGN. Our code is available at Code: https://anonymous.4open.science/r/TGN_Lipichitz-C033/.

📄 PDF Abstract BibTeX arXiv:2506.19282

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

TGN Temporal Graph Network, or TGN, is a framework for deep learning on dynamic graphs represented as sequences of timed events. The memory (state) of the model at time $t$…

Similar Papers 제목 키워드 기반

PRES: Toward Scalable Memory-Based Dynamic Graph Neural Networks

2024-02-06 · Junwei Su, Difan Zou, Chuan Wu

Memory-based Dynamic Graph Neural Networks (MDGNNs) are a family of dynamic graph neural networks that leverage a memory module to extract, distill, and memorize long-term temporal dependencies, leading to superior perfo…

D2ACE: Multi-Label Batch Selection Guided by Dual Dynamics and Adaptive Correlation Enhancement

2026-05-10 · Bin Liu, Haoyu Peng, Zhijia Wei, Jiajing Zhang 외 arxiv

Batch selection is crucial for improving both training efficiency and predictive performance in deep multi-label classification (MLC). Existing batch selection methods typically rely on a single metric to assess instance…

Multi-Label Classification

Dynamic Regression Discontinuity: An Event-Study Approach

2023-07-26 · Francesco Ruggieri

I propose a novel argument to identify economically interpretable intertemporal treatment effects in dynamic regression discontinuity designs (RDDs). Specifically, I develop a dynamic potential outcomes model and reformu…

regression

Traversing the noise of dynamic mini-batch sub-sampled loss functions: A visual guide

2019-03-20 · Dominic Kafka, Daniel Wilke

Mini-batch sub-sampling in neural network training is unavoidable, due to growing data demands, memory-limited computational resources such as graphical processing units (GPUs), and the dynamics of on-line learning. In t…

Stochastic Optimization

Multi-scale 2D Temporal Map Diffusion Models for Natural Language Video Localization

2024-01-16 · Chongzhi Zhang, Mingyuan Zhang, Zhiyang Teng, Jiayi Li 외

Natural Language Video Localization (NLVL), grounding phrases from natural language descriptions to corresponding video segments, is a complex yet critical task in video understanding. Despite ongoing advancements, many …

DecoderDenoisingVideo Understanding