paper-with-me

홈 › Papers

Prompt-guided Precise Audio Editing with Diffusion Models

2024-05-11 · Manjie Xu, Chenxing Li, Duzhen Zhang, Dan Su, Wei Liang, Dong Yu

Audio editing involves the arbitrary manipulation of audio content through precise control. Although text-guided diffusion models have made significant advancements in text-to-audio generation, they still face challenges in finding a flexible and precise way to modify target events within an audio track. We present a novel approach, referred to as PPAE, which serves as a general module for diffusion models and enables precise audio editing. The editing is based on the input textual prompt only and is entirely training-free. We exploit the cross-attention maps of diffusion models to facilitate accurate local editing and employ a hierarchical local-global pipeline to ensure a smoother editing process. Experimental results highlight the effectiveness of our method in various editing tasks.

📄 PDF Abstract BibTeX arXiv:2406.04350

Code (0)

등록된 구현이 없습니다.

Tasks

Audio Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

RFM-Editing: Rectified Flow Matching for Text-guided Audio Editing

2025-09-17 · Liting Gao, Yi Yuan, Yaru Chen, Yuelan Cheng 외 arxiv

Diffusion models have shown remarkable progress in text-to-audio generation. However, text-guided audio editing remains in its early stages. This task focuses on modifying the target content within an audio signal while …

Audio Generation

Audio-Guided Visual Editing with Complex Multi-Modal Prompts

2025-08-28 · Hyeonyu Kim, Seokhoon Jeong, Seonghee Han, Chanhyuk Choi 외 arxiv

Visual editing with diffusion models has made significant progress but often struggles with complex scenarios that textual guidance alone could not adequately describe, highlighting the need for additional non-text editi…

RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformers

2026-06-18 · Liting Gao, Yonggang Zhu, Yaru Chen, Dongyu Wang 외 arxiv

Audio editing aims to modify specific content in an existing audio clip according to a text instruction or description while preserving the remaining acoustic content. Despite the remarkable progress of diffusion models,…

EditGen: Harnessing Cross-Attention Control for Instruction-Based Auto-Regressive Audio Editing

2025-07-15 · Vassilis Sioros, Alexandros Potamianos, Giorgos Paraskevopoulos arxiv

In this study, we investigate leveraging cross-attention control for efficient audio editing within auto-regressive models. Inspired by image editing methodologies, we develop a Prompt-to-Prompt-like approach that guides…

Image Editing

Custom-Edit: Text-Guided Image Editing with Customized Diffusion Models

2023-05-25 · Jooyoung Choi, Yunjey Choi, Yunji Kim, Junho Kim 외

Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. Recent research has extended these models to support text-guided image editing. While text guidance is an int…

text-guided-image-editing