paper-with-me

홈 › Papers

Accelerating Frequency Domain Diffusion Models with Error-Feedback Event-Driven Caching

2026-04-24 · Dong Liu, Haisheng Wang, Yanxuan Yu arxiv

Diffusion models achieve remarkable success in time series generation. However, slow inference limits their practical deployment. We propose E$^2$-CRF (Error-Feedback Event-Driven Cumulative Residual Feature caching) to accelerate frequency domain diffusion models. Our method exploits two structural properties: (1) spectral localization, where signal energy concentrates in low frequencies, and (2) mirror symmetry, which halves the effective frequency dimension. E$^2$-CRF uses a closed-loop error-feedback system that adaptively caches transformer KV features across diffusion steps. We trigger recomputation using event-driven residual dynamics instead of fixed schedules. Our method selectively recomputes high-energy or rapidly-changing tokens while reusing cached features for stable high-frequency components. E$^2$-CRF achieves ~2.2 speedup while maintaining sample quality. We demonstrate effectiveness on 5 datasets. Our caching strategy naturally aligns with the diffusion process's structure-to-detail progression. We include sufficient-condition error and complexity bounds under standard regularity assumptions (Appendix), alongside empirical validation. Our code is available at https://github.com/NoakLiu/FastFourierDiffusion and is also integrated in https://github.com/NoakLiu/FastCache-xDiT.

📄 PDF Abstract BibTeX arXiv:2604.22901

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Frequency-Aware Error-Bounded Caching for Accelerating Diffusion Transformers

2026-03-05 · Guandong Li arxiv

Diffusion Transformers (DiTs) have emerged as the dominant architecture for high-quality image and video generation, yet their iterative denoising process incurs substantial computational cost during inference. Existing …

Video Generation

FreqCa: Accelerating Diffusion Models via Frequency-Aware Caching

2025-10-09 · Jiacheng Liu, Peiliang Cai, Qinming Zhou, Yuqi Lin 외 arxiv

The application of diffusion transformers is suffering from their significant inference costs. Recently, feature caching has been proposed to solve this problem by reusing features from previous timesteps, thereby skippi…

Accelerating trajectory optimization with Sobolev-trained diffusion policies

2026-04-21 · Théotime Le Hellard, Franki Nguimatsia Tiofack, Quentin Le Lidec, Justin Carpentier arxiv

Trajectory Optimization (TO) solvers exploit known system dynamics to compute locally optimal trajectories through iterative improvements. A downside is that each new problem instance is solved independently; therefore, …

Accelerating Diffusion-based Super-Resolution with Dynamic Time-Spatial Sampling

2025-05-17 · Rui Qin, Qijie Wang, Ming Sun, Haowei Zhu 외

Diffusion models have gained attention for their success in modeling complex distributions, achieving impressive perceptual quality in SR tasks. However, existing diffusion-based SR methods often suffer from high computa…

DenoisingSuper-Resolution

Hyper-DP3: Frequency-Aware Right-Sizing of 3D Diffusion Policies for Visuomotor Control

2026-05-02 · Jinhao Zhang, Zhexuan Zhou, Huizhe Li, Yichen Lai 외 arxiv

Diffusion-based visuomotor policies perform well in robotic manipulation, yet current methods still inherit image-generation-style decoders and multi-step sampling. We revisit this design from a frequency-domain perspect…

Image Generation