paper-with-me

홈 › Papers

Style Transfer for Non-differentiable Audio Effects

2023-09-29 · Kieran Grant

Digital audio effects are widely used by audio engineers to alter the acoustic and temporal qualities of audio data. However, these effects can have a large number of parameters which can make them difficult to learn for beginners and hamper creativity for professionals. Recently, there have been a number of efforts to employ progress in deep learning to acquire the low-level parameter configurations of audio effects by minimising an objective function between an input and reference track, commonly referred to as style transfer. However, current approaches use inflexible black-box techniques or require that the effects under consideration are implemented in an auto-differentiation framework. In this work, we propose a deep learning approach to audio production style matching which can be used with effects implemented in some of the most widely used frameworks, requiring only that the parameters under consideration have a continuous domain. Further, our method includes style matching for various classes of effects, many of which are difficult or impossible to be approximated closely using differentiable functions. We show that our audio embedding approach creates logical encodings of timbral information, which can be used for a number of downstream tasks. Further, we perform a listening test which demonstrates that our approach is able to convincingly style match a multi-band compressor effect.

📄 PDF Abstract BibTeX arXiv:2309.17125

Code (0)

등록된 구현이 없습니다.

Tasks

Style Transfer

Similar Papers 제목 키워드 기반

Diff-MST: Differentiable Mixing Style Transfer

2024-07-11 · Soumya Sai Vanka, Christian Steinmetz, Jean-Baptiste Rolland, Joshua Reiss 외

Mixing style transfer automates the generation of a multitrack mix for a given set of tracks by inferring production attributes from a reference song. However, existing systems for mixing style transfer are limited in th…

Style Transfer

Music Mixing Style Transfer: A Contrastive Learning Approach to Disentangle Audio Effects

2022-11-04 · Junghyun Koo, Marco A. Martínez-Ramírez, Wei-Hsiang Liao, Stefan Uhlich 외

We propose an end-to-end music mixing style transfer system that converts the mixing style of an input multitrack to that of a reference song. This is achieved with an encoder pre-trained with a contrastive objective to …

Contrastive LearningDisentanglementMusic Source SeparationStyle Transfer

Differentiable WORLD Synthesizer-based Neural Vocoder With Application To End-To-End Audio Style Transfer

2022-08-15 · Shahan Nercessian

In this paper, we propose a differentiable WORLD synthesizer and demonstrate its use in end-to-end audio style transfer tasks such as (singing) voice conversion and the DDSP timbre transfer task. Accordingly, our baselin…

Style TransferVoice Conversion

Improving Inference-Time Optimisation for Vocal Effects Style Transfer with a Gaussian Prior

2025-05-16 · Chin-Yun Yu, Marco A. Martínez-Ramírez, Junghyun Koo, Wei-Hsiang Liao 외

Style Transfer with Inference-Time Optimisation (ST-ITO) is a recent approach for transferring the applied effects of a reference audio to a raw audio track. It optimises the effect parameters to minimise the distance be…

Style Transfer

DDSP-SFX: Acoustically-guided sound effects generation with differentiable digital signal processing

2023-09-14 · Yunyi Liu, Craig Jin, David Gunawan

Controlling the variations of sound effects using neural audio synthesis models has been a difficult task. Differentiable digital signal processing (DDSP) provides a lightweight solution that achieves high-quality sound …

AttributeAudio Synthesis