Score Distillation Sampling for Audio: Source Separation, Synthesis, and Beyond
We introduce Audio-SDS, a generalization of Score Distillation Sampling (SDS) to text-conditioned audio diffusion models. While SDS was initially designed for text-to-3D generation using image diffusion, its core idea of distilling a powerful generative prior into a separate parametric representation extends to the audio domain. Leveraging a single pretrained model, Audio-SDS enables a broad range of tasks without requiring specialized datasets. In particular, we demonstrate how Audio-SDS can guide physically informed impact sound simulations, calibrate FM-synthesis parameters, and perform prompt-specified source separation. Our findings illustrate the versatility of distillation-based methods across modalities and establish a robust foundation for future work using generative priors in audio tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
3D GenerationAudio Source SeparationText to 3DMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Sampling-Frequency-Independent Audio Source Separation Using Convolution Layer Based on Impulse Invariant Method
Audio source separation is often used as preprocessing of various applications, and one of its ultimate goals is to construct a single versatile model capable of dealing with the varieties of audio signals. Since samplin…
Audio Source SeparationMusic Source SeparationSudo rm -rf: Efficient Networks for Universal Audio Source Separation
In this paper, we present an efficient neural network for end-to-end general purpose audio source separation. Specifically, the backbone structure of this convolutional network is the SUccessive DOwnsampling and Resampli…
Audio Source SeparationEfficient Neural NetworkSpeech SeparationSampling Frequency Independent Dialogue Separation
In some DNNs for audio source separation, the relevant model parameters are independent of the sampling frequency of the audio used for training. Considering the application of dialogue separation, this is shown for two …
Audio Source SeparationScore-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Music
Music source separation is the task of separating a mixture of instruments into constituent tracks. Music source separation models are typically trained using only audio data, although additional information can be used …
Music Source SeparationA Knowledge-Driven Approach to Music Segmentation, Music Source Separation and Cinematic Audio Source Separation
We propose a knowledge-driven, model-based approach to segmenting audio into single-category and mixed-category chunks with applications to source separation. "Knowledge" here denotes information associated with the data…
Music Source SeparationAudio Source Separation