paper-with-me

홈 › Papers

Voice Activity Detection for Transient Noisy Environment Based on Diffusion Nets

2021-06-25 · Amir Ivry, Baruch Berdugo, Israel Cohen

We address voice activity detection in acoustic environments of transients and stationary noises, which often occur in real life scenarios. We exploit unique spatial patterns of speech and non-speech audio frames by independently learning their underlying geometric structure. This process is done through a deep encoder-decoder based neural network architecture. This structure involves an encoder that maps spectral features with temporal information to their low-dimensional representations, which are generated by applying the diffusion maps method. The encoder feeds a decoder that maps the embedded data back into the high-dimensional space. A deep neural network, which is trained to separate speech from non-speech frames, is obtained by concatenating the decoder to the encoder, resembling the known Diffusion nets architecture. Experimental results show enhanced performance compared to competing voice activity detection methods. The improvement is achieved in both accuracy, robustness and generalization ability. Our model performs in a real-time manner and can be integrated into audio-based communication systems. We also present a batch algorithm which obtains an even higher accuracy for off-line applications.

📄 PDF Abstract BibTeX arXiv:2106.13763

Code (0)

등록된 구현이 없습니다.

Tasks

Action DetectionActivity DetectionDecoder

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Tiny Noise-Robust Voice Activity Detector for Voice Assistants

2025-07-29 · Hamed Jafarzadeh Asl, Mahsa Ghazvini Nejad, Amin Edraki, Masoud Asgharian 외 arxiv

Voice Activity Detection (VAD) in the presence of background noise remains a challenging problem in speech processing. Accurate VAD is essential in automatic speech recognition, voice-to-text, conversational agents, etc,…

Speech RecognitionActivity Detection

Adversarial Multi-Task Deep Learning for Noise-Robust Voice Activity Detection with Low Algorithmic Delay

2022-07-04 · Claus Meyer Larsen, Peter Koch, Zheng-Hua Tan

Voice Activity Detection (VAD) is an important pre-processing step in a wide variety of speech processing systems. VAD should in a practical application be able to detect speech in both noisy and noise-free environments,…

Action DetectionActivity DetectionMulti-Task Learning

A robust DOA estimation method for a linear microphone array under reverberant and noisy environments

2019-04-14

A robust method for linear array is proposed to address the difficulty of direction-of-arrival (DOA) estimation in reverberant and noisy environments. A direct-path dominance test based on the onset detection is utilized…

Onset Detection

SVVAD: Personal Voice Activity Detection for Speaker Verification

2023-05-31 · Zuheng Kang, Jianzong Wang, Junqing Peng, Jing Xiao

Voice activity detection (VAD) improves the performance of speaker verification (SV) by preserving speech segments and attenuating the effects of non-speech. However, this scheme is not ideal: (1) it fails in noisy envir…

Action DetectionActivity DetectionSpeaker VerificationTriplet

Noise-Robust Target-Speaker Voice Activity Detection Through Self-Supervised Pretraining

2025-01-06 · Holger Severin Bovbjerg, Jan Østergaard, Jesper Jensen, Zheng-Hua Tan

Target-Speaker Voice Activity Detection (TS-VAD) is the task of detecting the presence of speech from a known target-speaker in an audio frame. Recently, deep neural network-based models have shown good performance in th…

Action DetectionActivity DetectionDenoisingSelf-Supervised Learning