paper-with-me

홈 › Papers

InfiniteAudio: Infinite-Length Audio Generation with Consistency

2025-06-03 · Chaeyoung Jung, Hojoon Ki, Ji-Hoon Kim, Junmo Kim, Joon Son Chung

This paper presents InfiniteAudio, a simple yet effective strategy for generating infinite-length audio using diffusion-based text-to-audio methods. Current approaches face memory constraints because the output size increases with input length, making long duration generation challenging. A common workaround is to concatenate short audio segments, but this often leads to inconsistencies due to the lack of shared temporal context. To address this, InfiniteAudio integrates seamlessly into existing pipelines without additional training. It introduces two key techniques: FIFO sampling, a first-in, first-out inference strategy with fixed-size inputs, and curved denoising, which selectively prioritizes key diffusion steps for efficiency. Experiments show that InfiniteAudio achieves comparable or superior performance across all metrics. Audio samples are available on our project page.

📄 PDF Abstract BibTeX arXiv:2506.03020

Code (0)

등록된 구현이 없습니다.

Tasks

Audio GenerationDenoising

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

StableAvatar: Infinite-Length Audio-Driven Avatar Video Generation

2025-08-11 · Shuyuan Tu, Yueming Pan, Yinming Huang, Xintong Han 외 arxiv

Current diffusion models for audio-driven avatar video generation struggle to synthesize long videos with natural audio synchronization and identity consistency. This paper presents StableAvatar, the first end-to-end vid…

Video Generation

JoyStreamer-Flash: Real-time and Infinite Audio-Driven Avatar Generation with Autoregressive Diffusion

2025-12-12 · Chaochao Li, Ruikui Wang, Liangbo Zhou, Jinheng Feng 외 arxiv

Existing DiT-based audio-driven avatar generation methods have achieved considerable progress, yet their broader application is constrained by limitations such as high computational overhead and the inability to synthesi…

Video Generation

Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length

2025-12-04 · Yubo Huang, Hailong Guo, Fangtai Wu, Weiqiang Wang 외 arxiv

Audio-driven avatar interaction demands real-time, streaming, and infinite-length generation -- capabilities fundamentally at odds with the sequential denoising and long-horizon drift of current diffusion models. We pres…

SkyReels-Audio: Omni Audio-Conditioned Talking Portraits in Video Diffusion Transformers

2025-06-01 · Zhengcong Fei, Hao Jiang, Di Qiu, Baoxuan Gu 외

The generation and editing of audio-conditioned talking portraits guided by multimodal inputs, including text, images, and videos, remains under explored. In this paper, we present SkyReels-Audio, a unified framework for…

Denoising

Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation

2023-05-29 · Jiawei Huang, Yi Ren, Rongjie Huang, Dongchao Yang 외

Large diffusion models have been successful in text-to-audio (T2A) synthesis tasks, but they often suffer from common issues such as semantic misalignment and poor temporal consistency due to limited natural language und…

Audio GenerationDenoisingNatural Language UnderstandingTemporal Information Extraction