paper-with-me

Papers

Sampling-Frequency-Independent Audio Source Separation Using Convolution Layer Based on Impulse Invariant Method

2021-05-10 · Koichi Saito, Tomohiko Nakamura, Kohei Yatabe, Yuma Koizumi, Hiroshi Saruwatari

Audio source separation is often used as preprocessing of various applications, and one of its ultimate goals is to construct a single versatile model capable of dealing with the varieties of audio signals. Since sampling frequency, one of the audio signal varieties, is usually application specific, the preceding audio source separation model should be able to deal with audio signals of all sampling frequencies specified in the target applications. However, conventional models based on deep neural networks (DNNs) are trained only at the sampling frequency specified by the training data, and there are no guarantees that they work with unseen sampling frequencies. In this paper, we propose a convolution layer capable of handling arbitrary sampling frequencies by a single DNN. Through music source separation experiments, we show that the introduction of the proposed layer enables a conventional audio source separation model to consistently work with even unseen sampling frequencies.

📄 PDF Abstract BibTeX arXiv:2105.04079

Code (1)

TomohikoNakamura/sfi_convtasnet 공식 구현 pytorch

Tasks

Audio Source SeparationMusic Source Separation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Sampling Frequency Independent Dialogue Separation

2022-06-05 · Jouni Paulus, Matteo Torcoli

In some DNNs for audio source separation, the relevant model parameters are independent of the sampling frequency of the audio used for training. Considering the application of dialogue separation, this is shown for two …

Audio Source Separation

Independent Deeply Learned Matrix Analysis for Multichannel Audio Source Separation

2018-06-27

In this paper, we address a multichannel audio source separation task and propose a new efficient method called independent deeply learned matrix analysis (IDLMA). IDLMA estimates the demixing matrix in a blind manner an…

Audio Source Separation

RTFS-Net: Recurrent Time-Frequency Modelling for Efficient Audio-Visual Speech Separation

2023-09-29 · Samuel Pegg, Kai Li, Xiaolin Hu

Audio-visual speech separation methods aim to integrate different modalities to generate high-quality separated speech, thereby enhancing the performance of downstream tasks such as speech recognition. Most existing stat…

Audio-Visual Speech Recognitionspeech-recognitionSpeech RecognitionSpeech Separation+1

Consistent ICA: Determined BSS meets spectrogram consistency

2020-05-20 · Kohei Yatabe

Multichannel audio blind source separation (BSS) in the determined situation (the number of microphones is equal to that of the sources), or determined BSS, is performed by multichannel linear filtering in the time-frequ…

blind source separation

Determined BSS based on time-frequency masking and its application to harmonic vector analysis

2020-04-29 · Kohei Yatabe, Daichi Kitamura

This paper proposes harmonic vector analysis (HVA) based on a general algorithmic framework of audio blind source separation (BSS) that is also presented in this paper. BSS for a convolutive audio mixture is usually perf…

blind source separation