paper-with-me

Papers

rVAD: An Unsupervised Segment-Based Robust Voice Activity Detection Method

2019-06-09 · Zheng-Hua Tan, Achintya Kr. Sarkar, Najim Dehak

This paper presents an unsupervised segment-based method for robust voice activity detection (rVAD). The method consists of two passes of denoising followed by a voice activity detection (VAD) stage. In the first pass, high-energy segments in a speech signal are detected by using a posteriori signal-to-noise ratio (SNR) weighted energy difference and if no pitch is detected within a segment, the segment is considered as a high-energy noise segment and set to zero. In the second pass, the speech signal is denoised by a speech enhancement method, for which several methods are explored. Next, neighbouring frames with pitch are grouped together to form pitch segments, and based on speech statistics, the pitch segments are further extended from both ends in order to include both voiced and unvoiced sounds and likely non-speech parts as well. In the end, a posteriori SNR weighted energy difference is applied to the extended pitch segments of the denoised speech signal for detecting voice activity. We evaluate the VAD performance of the proposed method using two databases, RATS and Aurora-2, which contain a large variety of noise conditions. The rVAD method is further evaluated, in terms of speaker verification performance, on the RedDots 2016 challenge database and its noise-corrupted versions. Experiment results show that rVAD is compared favourably with a number of existing methods. In addition, we present a modified version of rVAD where computationally intensive pitch extraction is replaced by computationally efficient spectral flatness calculation. The modified version significantly reduces the computational complexity at the cost of moderately inferior VAD performance, which is an advantage when processing a large amount of data and running on low resource devices. The source code of rVAD is made publicly available.

📄 PDF Abstract BibTeX arXiv:1906.03588

Code (3)

zhenghuatan/gmm-ubm_map_sv 공식 구현
zhenghuatan/rVAD 공식 구현
zhenghuatan/rvadfast 공식 구현

Tasks

Action DetectionActivity DetectionDenoisingSpeaker VerificationSpeech Enhancement

Similar Papers 제목 키워드 기반

Unsupervised Voice Activity Detection by Modeling Source and System Information using Zero Frequency Filtering

2022-06-27 · Eklavya Sarkar, RaviShankar Prasad, Mathew Magimai. -Doss

Voice activity detection (VAD) is an important pre-processing step for speech technology applications. The task consists of deriving segment boundaries of audio signals which contain voicing information. In recent years,…

Action DetectionActivity Detection

The Newsbridge -Telecom SudParis VoxCeleb Speaker Recognition Challenge 2022 System Description

2023-01-17 · Yannis Tevissen, Jérôme Boudy, Frédéric Petitpont

We describe the system used by our team for the VoxCeleb Speaker Recognition Challenge 2022 (VoxSRC 2022) in the speaker diarization track. Our solution was designed around a new combination of voice activity detection a…

Action DetectionActivity DetectionClusteringspeaker-diarization+2

Kernel-based Sensor Fusion with Application to Audio-Visual Voice Activity Detection

2016-04-11 · David Dov, Ronen Talmon, Israel Cohen

In this paper, we address the problem of multiple view data fusion in the presence of noise and interferences. Recent studies have approached this problem using kernel methods, by relying particularly on a product of ker…

Action DetectionActivity DetectionSensor Fusion

On training targets for noise-robust voice activity detection

2021-02-15 · Sebastian Braun, Ivan Tashev

The task of voice activity detection (VAD) is an often required module in various speech processing, analysis and classification tasks. While state-of-the-art neural network based VADs can achieve great results, they oft…

Action DetectionActivity Detection

End-to-end speaker segmentation for overlap-aware resegmentation

2021-04-08 · Hervé Bredin, Antoine Laurent

Speaker segmentation consists in partitioning a conversation between one or more speakers into speaker turns. Usually addressed as the late combination of three sub-tasks (voice activity detection, speaker change detecti…

Action DetectionActivity DetectionChange DetectionMulti-Label Classification+4