Diffusion Timbre Transfer Via Mutual Information Guided Inpainting
We study timbre transfer as an inference-time editing problem for music audio. Starting from a strong pre-trained latent diffusion model, we introduce a lightweight procedure that requires no additional training: (i) a dimension-wise noise injection that targets latent channels most informative of instrument identity, and (ii) an early-step clamping mechanism that re-imposes the input's melodic and rhythmic structure during reverse diffusion. The method operates directly on audio latents and is compatible with text/audio conditioning (e.g., CLAP). We discuss design choices,analyze trade-offs between timbral change and structural preservation, and show that simple inference-time controls can meaningfully steer pre-trained models for style-transfer use cases.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Emotional Text-To-Speech Based on Mutual-Information-Guided Emotion-Timbre Disentanglement
Current emotional Text-To-Speech (TTS) and style transfer methods rely on reference encoders to control global style or emotion vectors, but do not capture nuanced acoustic details of the reference speech. To this end, w…
Style TransferWaveTransfer: A Flexible End-to-end Multi-instrument Timbre Transfer with Diffusion
As diffusion-based deep generative models gain prevalence, researchers are actively investigating their potential applications across various domains, including music synthesis and style alteration. Within this work, we …
DenoisingSchedulingRemix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems
Timbre transfer aims to modify the timbral identity of a musical recording while preserving the original melody and rhythm. While single-instrument timbre transfer has made substantial progress, existing approaches to mu…
Style TransferTimbre transfer using image-to-image denoising diffusion implicit models
Timbre transfer techniques aim at converting the sound of a musical piece generated by one instrument into the same one as if it was played by another instrument, while maintaining as much as possible the content in term…
DenoisingImage DenoisingLatent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfer
Music timbre transfer is a challenging task that involves modifying the timbral characteristics of an audio signal while preserving its melodic structure. In this paper, we propose a novel method based on dual diffusion …
FAD