paper-with-me

Papers

A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generation

2025-10-22 · Jiacheng Liu, Xinyu Wang, Yuqi Lin, Zhikai Wang, Peiru Wang, Peiliang Cai, Qinming Zhou, Zhengan Yan, Zexuan Yan, Zhengyi Shi, Chang Zou, Yue Ma, Linfeng Zhang arxiv

Diffusion Models have become a cornerstone of modern generative AI for their exceptional generation quality and controllability. However, their inherent \textit{multi-step iterations} and \textit{complex backbone networks} lead to prohibitive computational overhead and generation latency, forming a major bottleneck for real-time applications. Although existing acceleration techniques have made progress, they still face challenges such as limited applicability, high training costs, or quality degradation. Against this backdrop, \textbf{Diffusion Caching} offers a promising training-free, architecture-agnostic, and efficient inference paradigm. Its core mechanism identifies and reuses intrinsic computational redundancies in the diffusion process. By enabling feature-level cross-step reuse and inter-layer scheduling, it reduces computation without modifying model parameters. This paper systematically reviews the theoretical foundations and evolution of Diffusion Caching and proposes a unified framework for its classification and analysis. Through comparative analysis of representative methods, we show that Diffusion Caching evolves from \textit{static reuse} to \textit{dynamic prediction}. This trend enhances caching flexibility across diverse tasks and enables integration with other acceleration techniques such as sampling optimization and model distillation, paving the way for a unified, efficient inference framework for future multimodal and interactive applications. We argue that this paradigm will become a key enabler of real-time and efficient generative AI, injecting new vitality into both theory and practice of \textit{Efficient Generative Intelligence}.

📄 PDF Abstract BibTeX arXiv:2510.19755

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Survey on Large Language Model Acceleration based on KV Cache Management

2024-12-27 · Haoyang Li, Yiming Li, Anxin Tian, Tianhao Tang 외

Large Language Models (LLMs) have revolutionized a wide range of domains such as natural language processing, computer vision, and multi-modal tasks due to their ability to comprehend context and perform logical reasonin…

Language ModelingLanguage ModellingLarge Language ModelLogical Reasoning+3

WorldCache: Accelerating World Models for Free via Heterogeneous Token Caching

2026-03-06 · Weilun Feng, Guoxin Fan, Haotong Qin, Mingqiang Wu 외 arxiv

Diffusion-based world models have shown strong potential for unified world simulation, but the iterative denoising remains too costly for interactive use and long-horizon rollouts. While feature caching can accelerate in…

EchoCache: Energy-Guided Cross-Modal Caching for Efficient Audio-Driven Video Generation

2026-08-03 · Jiayu Chen, Xiaoyu Wu, Rongshan Gao, Maoliang Li 외 arxiv

Audio-driven video generation (A2V) has achieved promising progress in synthesizing temporally coherent and audio-visually aligned videos, yet its inference remains expensive due to the iterative denoising process of dif…

Video Generation

SyncCache: Exploiting Asymmetric Dynamics for Fast Audio-Driven Portrait Animation

2026-06-29 · Juncheng Ma, Yuxuan Du, Yanan Sun, Zhening Xing 외 arxiv

Diffusion Transformers (DiTs) have significantly advanced audio-driven portrait animation, but their high computational cost leads to substantial inference latency. Although training-free diffusion caching accelerates in…

SmoothCache: A Universal Inference Acceleration Technique for Diffusion Transformers

2024-11-15 · Joseph Liu, Joshua Geddes, Ziyu Guo, Haomiao Jiang 외

Diffusion Transformers (DiT) have emerged as powerful generative models for various tasks, including image, video, and speech synthesis. However, their inference process remains computationally expensive due to the repea…

Image GenerationSpeech Synthesis