paper-with-me

Papers

VADOI:Voice-Activity-Detection Overlapping Inference For End-to-end Long-form Speech Recognition

2022-02-22 · Jinhan Wang, Xiaosu Tong, Jinxi Guo, Di He, Roland Maas

While end-to-end models have shown great success on the Automatic Speech Recognition task, performance degrades severely when target sentences are long-form. The previous proposed methods, (partial) overlapping inference are shown to be effective on long-form decoding. For both methods, word error rate (WER) decreases monotonically when overlapping percentage decreases. Setting aside computational cost, the setup with 50% overlapping during inference can achieve the best performance. However, a lower overlapping percentage has an advantage of fast inference speed. In this paper, we first conduct comprehensive experiments comparing overlapping inference and partial overlapping inference with various configurations. We then propose Voice-Activity-Detection Overlapping Inference to provide a trade-off between WER and computation cost. Results show that the proposed method can achieve a 20% relative computation cost reduction on Librispeech and Microsoft Speech Language Translation long-form corpus while maintaining the WER performance when comparing to the best performing overlapping inference algorithm. We also propose Soft-Match to compensate for similar words mis-aligned problem.

📄 PDF Abstract BibTeX arXiv:2202.10593

Code (0)

등록된 구현이 없습니다.

Tasks

Action DetectionActivity DetectionAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)Formspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

An End-to-End Architecture for Keyword Spotting and Voice Activity Detection

2016-11-28 · Chris Lengerich, Awni Hannun

We propose a single neural network architecture for two tasks: on-line keyword spotting and voice activity detection. We develop novel inference algorithms for an end-to-end Recurrent Neural Network trained with the Conn…

Action DetectionActivity DetectionGeneral ClassificationKeyword Spotting

A Convolutional Neural Network Smartphone App for Real-Time Voice Activity Detection

2018-02-01 · IEEE Access 2018 2 · Abhishek Sehgal, Nasser Kehtarnavaz

This paper presents a smartphone app that performs real-time voice activity detection based on convolutional neural network. Real-time implementation issues are discussed showing how the slow inference time associated wi…

Action DetectionActivity DetectionAudio Signal RecognitionNoise Estimation

Multitask Detection of Speaker Changes, Overlapping Speech and Voice Activity Using wav2vec 2.0

2022-10-26 · Marie Kunešová, Zbyněk Zajíc

Self-supervised learning approaches have lately achieved great success on a broad spectrum of machine learning problems. In the field of speech processing, one of the most successful recent self-supervised models is wav2…

Action DetectionActivity DetectionChange DetectionSelf-Supervised Learning

Speaker Diarization with Overlapping Community Detection Using Graph Attention Networks and Label Propagation Algorithm

2025-06-03 · Zhaoyang Li, Jie Wang, Xiaoxiao Li, Wangjie Li 외

In speaker diarization, traditional clustering-based methods remain widely used in real-world applications. However, these methods struggle with the complex distribution of speaker embeddings and overlapping speech segme…

Action DetectionActivity DetectionClusteringCommunity Detection+3

Target-Speaker Voice Activity Detection: a Novel Approach for Multi-Speaker Diarization in a Dinner Party Scenario

2020-05-14 · Ivan Medennikov, Maxim Korenevsky, Tatiana Prisyach, Yuri Khokhlov 외

Speaker diarization for real-life scenarios is an extremely challenging problem. Widely used clustering-based diarization approaches perform rather poorly in such conditions, mainly due to the limited ability to handle o…

Action DetectionActivity DetectionBinary ClassificationClustering+2