Array Configuration-Agnostic Personal Voice Activity Detection Based on Spatial Coherence
Personal voice activity detection has received increased attention due to the growing popularity of personal mobile devices and smart speakers. PVAD is often an integral element to speech enhancement and recognition for these applications in which lightweight signal processing is only enabled for the target user. However, in real-world scenarios, the detection performance may degrade because of competing speakers, background noise, and reverberation. To address this problem, we proposed to use equivalent rectangular bandwidth ERB-scaled spatial coherence as the input feature to train an array configuration-agnostic PVAD network. Whereas the network model requires only 112k parameters, it exhibits excellent detection performance and robustness in adverse acoustic conditions. Notably, the proposed ARCA-PVAD system is scalable to array configurations. Experimental results have demonstrated the superior performance achieved by the proposed ARCA-PVAD system over a baseline in terms of the area under receiver operating characteristic curve and equal error rate.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionActivity DetectionSpeech EnhancementSimilar Papers 제목 키워드 기반
Array Configuration-Agnostic Personalized Speech Enhancement using Long-Short-Term Spatial Coherence
Personalized speech enhancement has been a field of active research for suppression of speechlike interferers such as competing speakers or TV dialogues. Compared with single channel approaches, multichannel PSE systems …
Speech EnhancementChannel-Combination Algorithms for Robust Distant Voice Activity and Overlapped Speech Detection
Voice Activity Detection (VAD) and Overlapped Speech Detection (OSD) are key pre-processing tasks for speaker diarization. In the meeting context, it is often easier to capture speech with a distant device. This consider…
Action DetectionActivity Detectionspeaker-diarizationSpeaker DiarizationComparative Analysis of Personalized Voice Activity Detection Systems: Assessing Real-World Effectiveness
Voice activity detection (VAD) is a critical component in various applications such as speech recognition, speech enhancement, and hands-free communication systems. With the increasing demand for personalized and context…
Action DetectionActivity DetectionSpeech Enhancementspeech-recognition+1Personal VAD 2.0: Optimizing Personal Voice Activity Detection for On-Device Speech Recognition
Personalization of on-device speech recognition (ASR) has seen explosive growth in recent years, largely due to the increasing popularity of personal assistant features on mobile devices and smart home speakers. In this …
Action DetectionActivity DetectionCPUspeech-recognition+1Self-supervised Pretraining for Robust Personalized Voice Activity Detection in Adverse Conditions
In this paper, we propose the use of self-supervised pretraining on a large unlabelled data set to improve the performance of a personalized voice activity detection (VAD) model in adverse conditions. We pretrain a long …
Action DetectionActivity DetectionDenoising