ReDiTT: Retrieval Augmented Conditional Diffusion Transformers for Asynchronous Time Series
We present a diffusion based model for asynchronous time series prediction, where the goal is to predict the next inter event time and event type. To address the inherent uncertainty of future events, we introduce ReDiTT, a retrieval augmented conditional diffusion transformer that operates in latent space. ReDiTT retrieves structurally similar latent sequences from a memory bank during both training and inference and incorporates them as reference conditions through cross attention. This retrieval based conditioning allows the model to attend to relevant temporal dynamics and provides global structural guidance for generation. As a result, ReDiTT stabilizes long horizon forecasting and improves sample diversity. Experiments on seven real world datasets demonstrate state of the art performance on next event prediction and long horizon forecasting. Our code is available at https://github.com/BorealisAI/ReDiTT.
Code (0)
등록된 구현이 없습니다.
Tasks
Time Series PredictionSimilar Papers 제목 키워드 기반
On Statistical Rates of Conditional Diffusion Transformers: Approximation, Estimation and Minimax Optimality
We investigate the approximation and estimation rates of conditional diffusion transformers (DiTs) with classifier-free guidance. We present a comprehensive analysis for ``in-context'' conditional DiTs under four common …
RADD: Retrieval-Augmented Discrete Diffusion for Multi-Modal Knowledge Graph Completion
Most multi-modal knowledge graph completion (MMKGC) models use one embedding scorer to do both retrieval over the full entity set and final decision making. We argue that this coupling is a core bottleneck: global high-r…
Knowledge Graph CompletionDecision MakingLatent Retrieval Augmented Generation of Cross-Domain Protein Binders
Designing protein binders targeting specific sites, which requires to generate realistic and functional interaction patterns, is a fundamental challenge in drug discovery. Current structure-based generative models are li…
Domain GeneralizationDrug DiscoveryRetrieval Augmented Diffusion Model for Structure-informed Antibody Design and Optimization
Antibodies are essential proteins responsible for immune responses in organisms, capable of specifically recognizing antigen molecules of pathogens. Recent advances in generative models have significantly enhanced ration…
DenoisingModel OptimizationRetrievalCPR: Retrieval Augmented Generation for Copyright Protection
Retrieval Augmented Generation (RAG) is emerging as a flexible and robust technique to adapt models to private users data without training, to handle credit attribution, and to allow efficient machine unlearning at scale…
Image GenerationMachine UnlearningRAGRetrieval+1