paper-with-me

Papers

Speaker Tagging Correction With Non-Autoregressive Language Models

2024-08-30 · Grigor Kirakosyan, Davit Karamyan

Speech applications dealing with conversations require not only recognizing the spoken words but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate systems, namely, an automatic speech recognition (ASR) system and a speaker diarization (SD) system. In practical settings, speaker diarization systems can experience significant degradation in performance due to a variety of factors, including uniform segmentation with a high temporal resolution, inaccurate word timestamps, incorrect clustering and estimation of speaker numbers, as well as background noise. Therefore, it is important to automatically detect errors and make corrections if possible. We used a second-pass speaker tagging correction system based on a non-autoregressive language model to correct mistakes in words placed at the borders of sentences spoken by different speakers. We first show that the employed error correction approach leads to reductions in word diarization error rate (WDER) on two datasets: TAL and test set of Fisher. Additionally, we evaluated our system in the Post-ASR Speaker Tagging Correction challenge and observed significant improvements in cpWER compared to baseline methods.

📄 PDF Abstract BibTeX arXiv:2409.00151

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modellingspeaker-diarizationSpeaker Diarizationspeech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Large Language Model Based Generative Error Correction: A Challenge and Baselines for Speech Recognition, Speaker Tagging, and Emotion Recognition

2024-09-15 · Chao-Han Huck Yang, Taejin Park, Yuan Gong, Yuanchao Li 외

Given recent advances in generative AI technology, a key question is how large language models (LLMs) can enhance acoustic modeling tasks using text decoding results from a frozen, pretrained automatic speech recognition…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Emotion RecognitionLanguage Modeling+4

Character Transformations for Non-Autoregressive GEC Tagging

2021-11-17 · WNUT (ACL) 2021 11 · Milan Straka, Jakub Náplava, Jana Straková

We propose a character-based nonautoregressive GEC approach, with automatically generated character transformations. Recently, per-word classification of correction edits has proven an efficient, parallelizable alternati…

Decoder

RedPenNet for Grammatical Error Correction: Outputs to Tokens, Attentions to Spans

2023-09-19 · Bohdan Didenko, Andrii Sameliuk

The text editing tasks, including sentence fusion, sentence splitting and rephrasing, text simplification, and Grammatical Error Correction (GEC), share a common trait of dealing with highly similar input and output sequ…

Grammatical Error CorrectionMachine Translationnamed-entity-recognitionNamed Entity Recognition+7

EdiT5: Semi-Autoregressive Text-Editing with T5 Warm-Start

2022-05-24 · Jonathan Mallinson, Jakub Adamek, Eric Malmi, Aliaksei Severyn

We present EdiT5 - a novel semi-autoregressive text-editing model designed to combine the strengths of non-autoregressive text-editing and autoregressive decoding. EdiT5 is faster during inference than conventional seque…

DecoderGrammatical Error CorrectionSentenceSentence Fusion

Multi-head Sequence Tagging Model for Grammatical Error Correction

2024-10-21 · Kamal Al-Sabahi, Kang Yang, Wangwang Liu, Guanyu Jiang 외

To solve the Grammatical Error Correction (GEC) problem , a mapping between a source sequence and a target one is needed, where the two differ only on few spans. For this reason, the attention has been shifted to the non…

DenoisingGrammatical Error CorrectionMulti-Task Learning