paper-with-me

홈 › Papers

MMS-MSG: A Multi-purpose Multi-Speaker Mixture Signal Generator

2022-09-23 · Tobias Cord-Landwehr, Thilo von Neumann, Christoph Boeddeker, Reinhold Haeb-Umbach

The scope of speech enhancement has changed from a monolithic view of single, independent tasks, to a joint processing of complex conversational speech recordings. Training and evaluation of these single tasks requires synthetic data with access to intermediate signals that is as close as possible to the evaluation scenario. As such data often is not available, many works instead use specialized databases for the training of each system component, e.g WSJ0-mix for source separation. We present a Multi-purpose Multi-Speaker Mixture Signal Generator (MMS-MSG) for generating a variety of speech mixture signals based on any speech corpus, ranging from classical anechoic mixtures (e.g., WSJ0-mix) over reverberant mixtures (e.g., SMS-WSJ) to meeting-style data. Its highly modular and flexible structure allows for the simulation of diverse environments and dynamic mixing, while simultaneously enabling an easy extension and modification to generate new scenarios and mixture types. These meetings can be used for prototyping, evaluation, or training purposes. We provide example evaluation data and baseline results for meetings based on the WSJ corpus. Further, we demonstrate the usefulness for realistic scenarios by using MMS-MSG to provide training data for the LibriCSS database.

📄 PDF Abstract BibTeX arXiv:2209.11494

Code (1)

fgnt/mms_msg 공식 구현 pytorch

Tasks

Speech Enhancement

Similar Papers 제목 키워드 기반

Who Spoke What? A Latent Variable Framework for the Joint Decoding of Multiple Speakers and their Keywords

2015-04-29 · Harshavardhan Sundar, Thippur V. Sreenivas

In this paper, we present a latent variable (LV) framework to identify all the speakers and their keywords given a multi-speaker mixture signal. We introduce two separate LVs to denote active speakers and the keywords ut…

Exploiting spatial information with the informed complex-valued spatial autoencoder for target speaker extraction

2022-10-27 · Annika Briegleb, Mhd Modar Halimeh, Walter Kellermann

In conventional multichannel audio signal enhancement, spatial and spectral filtering are often performed sequentially. In contrast, it has been shown that for neural spatial filtering a joint approach of spectro-spatial…

PositionTarget Speaker Extraction

USEV: Universal Speaker Extraction with Visual Cue

2021-09-30 · Zexu Pan, Meng Ge, Haizhou Li

A speaker extraction algorithm seeks to extract the target speaker's speech from a multi-talker speech mixture. The prior studies focus mostly on speaker extraction from a highly overlapped multi-talker speech mixture. H…

Listen to Extract: Onset-Prompted Target Speaker Extraction

2025-05-08 · Pengjie Shen, Kangrui Chen, Shulin He, Pengru Chen 외

We propose $\textit{listen to extract}$ (LExt), a highly-effective while extremely-simple algorithm for monaural target speaker extraction (TSE). Given an enrollment utterance of a target speaker, LExt aims at extracting…

Target Speaker Extraction

UNSSOR: Unsupervised Neural Speech Separation by Leveraging Over-determined Training Mixtures

2023-05-31 · NeurIPS 2023 11

In reverberant conditions with multiple concurrent speakers, each microphone acquires a mixture signal of multiple speakers at a different location. In over-determined conditions where the microphones out-number speakers…

Speaker SeparationSpeech Separation