paper-with-me

Papers

Sampling Frequency Independent Dialogue Separation

2022-06-05 · Jouni Paulus, Matteo Torcoli

In some DNNs for audio source separation, the relevant model parameters are independent of the sampling frequency of the audio used for training. Considering the application of dialogue separation, this is shown for two DNN architectures: a U-Net and a fully-convolutional model. The models are trained with audio sampled at 8 kHz. The learned parameters are transferred to models for processing audio at 48 kHz. The separated audio sources are compared with the ones produced by the same model architectures trained with 48 kHz versions of the same training data. A listening test and computational measures show that there is no significant perceptual difference between the models trained with 8 kHz or with 48 kHz. This transferability of the learned parameters allows for a faster and computationally less costly training. It also enables using training datasets available at a lower sampling frequency than the one needed by the application at hand, or using data collections with multiple sampling frequencies.

📄 PDF Abstract BibTeX arXiv:2206.02124

Code (0)

등록된 구현이 없습니다.

Tasks

Audio Source Separation

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

Sampling-Frequency-Independent Audio Source Separation Using Convolution Layer Based on Impulse Invariant Method

2021-05-10 · Koichi Saito, Tomohiko Nakamura, Kohei Yatabe, Yuma Koizumi 외

Audio source separation is often used as preprocessing of various applications, and one of its ultimate goals is to construct a single versatile model capable of dealing with the varieties of audio signals. Since samplin…

Audio Source SeparationMusic Source Separation

A Generalized Bandsplit Neural Network for Cinematic Audio Source Separation

2023-09-05 · Karn N. Watcharasupat, Chih-Wei Wu, Yiwei Ding, Iroro Orife 외

Cinematic audio source separation is a relatively new subtask of audio source separation, with the aim of extracting the dialogue, music, and effects stems from their mixture. In this work, we developed a model generaliz…

Audio Source Separation

Sub-Nyquist Sampling with Optical Pulses for Photonic Blind Source Separation

2021-07-25 · Taichu Shi, Yang Qi, Weipeng Zhang, Paul Prucnal 외

We proposed and demonstrated an optical pulse sampling method for photonic blind source separation. It can separate large bandwidth of mixed signals by small sampling frequency, which can reduce the workload of digital s…

blind source separation

Sampling-Frequency-Independent Universal Sound Separation

2023-09-22 · Tomohiko Nakamura, Kohei Yatabe

This paper proposes a universal sound separation (USS) method capable of handling untrained sampling frequencies (SFs). The USS aims at separating arbitrary sources of different types and can be the key technique to real…

TF-MLPNet: Tiny Real-Time Neural Speech Separation

2025-08-05 · Malek Itani, Tuochao Chen, Shyamnath Gollakota arxiv

Speech separation on hearable devices can enable transformative augmented and enhanced hearing capabilities. However, state-of-the-art speech separation networks cannot run in real-time on tiny, low-power neural accelera…

Speech ExtractionSpeech Separation