paper-with-me

Papers

GPU-accelerated Guided Source Separation for Meeting Transcription

2022-12-10 · Desh Raj, Daniel Povey, Sanjeev Khudanpur

Guided source separation (GSS) is a type of target-speaker extraction method that relies on pre-computed speaker activities and blind source separation to perform front-end enhancement of overlapped speech signals. It was first proposed during the CHiME-5 challenge and provided significant improvements over the delay-and-sum beamforming baseline. Despite its strengths, however, the method has seen limited adoption for meeting transcription benchmarks primarily due to its high computation time. In this paper, we describe our improved implementation of GSS that leverages the power of modern GPU-based pipelines, including batched processing of frequencies and segments, to provide 300x speed-up over CPU-based inference. The improved inference time allows us to perform detailed ablation studies over several parameters of the GSS algorithm -- such as context duration, number of channels, and noise class, to name a few. We provide end-to-end reproducible pipelines for speaker-attributed transcription of popular meeting benchmarks: LibriCSS, AMI, and AliMeeting. Our code and recipes are publicly available: https://github.com/desh2608/gss.

📄 PDF Abstract BibTeX arXiv:2212.05271

Code (2)

desh2608/diarizer 공식 구현
desh2608/gss 공식 구현

Tasks

blind source separationCPUGPUSpeech RecognitionTarget Speaker Extraction

Similar Papers 제목 키워드 기반

Utterance-Wise Meeting Transcription System Using Asynchronous Distributed Microphones

2020-07-31 · Shota Horiguchi, Yusuke Fujita, Kenji Nagamatsu

A novel framework for meeting transcription using asynchronous microphones is proposed in this paper. It consists of audio synchronization, speaker diarization, utterance-wise speech enhancement using guided source separ…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speaker-diarizationSpeaker Diarization+3

Self-Supervised Learning-Based Source Separation for Meeting Data

2023-04-03 · Yuang Li, Xianrui Zheng, Philip C. Woodland

Source separation can improve automatic speech recognition (ASR) under multi-party meeting scenarios by extracting single-speaker signals from overlapped speech. Despite the success of self-supervised learning models in …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Self-Supervised Learningspeech-recognition+1

Advances in Online Audio-Visual Meeting Transcription

2019-12-10 · Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen 외

This paper describes a system that generates speaker-annotated transcripts of meetings by using a microphone array and a 360-degree camera. The hallmark of the system is its ability to handle overlapped speech, which has…

Sound Source Localizationspeaker-diarizationSpeaker DiarizationSpeaker Identification+1

Recognizing Overlapped Speech in Meetings: A Multichannel Separation Approach Using Neural Networks

2018-10-08 · Takuya Yoshioka, Hakan Erdogan, Zhuo Chen, Xiong Xiao 외

The goal of this work is to develop a meeting transcription system that can recognize speech even when utterances of different speakers are overlapped. While speech overlaps have been regarded as a major obstacle in accu…

speech-recognitionSpeech RecognitionSpeech Separation

LibriWASN: A Data Set for Meeting Separation, Diarization, and Recognition with Asynchronous Recording Devices

2023-08-21 · Joerg Schmalenstroeer, Tobias Gburrek, Reinhold Haeb-Umbach

We present LibriWASN, a data set whose design follows closely the LibriCSS meeting recognition data set, with the marked difference that the data is recorded with devices that are randomly positioned on a meeting table a…