paper-with-me

홈 › Papers

Array Configuration-Agnostic Personal Voice Activity Detection Based on Spatial Coherence

2023-04-18 · Yicheng Hsu, Mingsian R. Bai

Personal voice activity detection has received increased attention due to the growing popularity of personal mobile devices and smart speakers. PVAD is often an integral element to speech enhancement and recognition for these applications in which lightweight signal processing is only enabled for the target user. However, in real-world scenarios, the detection performance may degrade because of competing speakers, background noise, and reverberation. To address this problem, we proposed to use equivalent rectangular bandwidth ERB-scaled spatial coherence as the input feature to train an array configuration-agnostic PVAD network. Whereas the network model requires only 112k parameters, it exhibits excellent detection performance and robustness in adverse acoustic conditions. Notably, the proposed ARCA-PVAD system is scalable to array configurations. Experimental results have demonstrated the superior performance achieved by the proposed ARCA-PVAD system over a baseline in terms of the area under receiver operating characteristic curve and equal error rate.

📄 PDF Abstract BibTeX arXiv:2304.08887

Code (0)

등록된 구현이 없습니다.

Tasks

Action DetectionActivity DetectionSpeech Enhancement

Similar Papers 제목 키워드 기반

Array Configuration-Agnostic Personalized Speech Enhancement using Long-Short-Term Spatial Coherence

2022-11-16 · Yicheng Hsu, Yonghan Lee, Mingsian R. Bai

Personalized speech enhancement has been a field of active research for suppression of speechlike interferers such as competing speakers or TV dialogues. Compared with single channel approaches, multichannel PSE systems …

Speech Enhancement

Channel-Combination Algorithms for Robust Distant Voice Activity and Overlapped Speech Detection

2024-02-13 · Théo Mariotte, Anthony Larcher, Silvio Montrésor, Jean-Hugh Thomas

Voice Activity Detection (VAD) and Overlapped Speech Detection (OSD) are key pre-processing tasks for speaker diarization. In the meeting context, it is often easier to capture speech with a distant device. This consider…

Action DetectionActivity Detectionspeaker-diarizationSpeaker Diarization

Comparative Analysis of Personalized Voice Activity Detection Systems: Assessing Real-World Effectiveness

2024-06-12 · Satyam Kumar, Sai Srujana Buddi, Utkarsh Oggy Sarawgi, Vineet Garg 외

Voice activity detection (VAD) is a critical component in various applications such as speech recognition, speech enhancement, and hands-free communication systems. With the increasing demand for personalized and context…

Action DetectionActivity DetectionSpeech Enhancementspeech-recognition+1

Personal VAD 2.0: Optimizing Personal Voice Activity Detection for On-Device Speech Recognition

2022-04-08 · Shaojin Ding, Rajeev Rikhye, Qiao Liang, Yanzhang He 외

Personalization of on-device speech recognition (ASR) has seen explosive growth in recent years, largely due to the increasing popularity of personal assistant features on mobile devices and smart home speakers. In this …

Action DetectionActivity DetectionCPUspeech-recognition+1

Self-supervised Pretraining for Robust Personalized Voice Activity Detection in Adverse Conditions

2023-12-27 · Holger Severin Bovbjerg, Jesper Jensen, Jan Østergaard, Zheng-Hua Tan

In this paper, we propose the use of self-supervised pretraining on a large unlabelled data set to improve the performance of a personalized voice activity detection (VAD) model in adverse conditions. We pretrain a long …

Action DetectionActivity DetectionDenoising