paper-with-me

Papers

Span Classification with Structured Information for Disfluency Detection in Spoken Utterances

2022-03-30 · Sreyan Ghosh, Sonal Kumar, Yaman Kumar Singla, Rajiv Ratn Shah, S. Umesh

Existing approaches in disfluency detection focus on solving a token-level classification task for identifying and removing disfluencies in text. Moreover, most works focus on leveraging only contextual information captured by the linear sequences in text, thus ignoring the structured information in text which is efficiently captured by dependency trees. In this paper, building on the span classification paradigm of entity recognition, we propose a novel architecture for detecting disfluencies in transcripts from spoken utterances, incorporating both contextual information through transformers and long-distance structured information captured by dependency trees, through graph convolutional networks (GCNs). Experimental results show that our proposed model achieves state-of-the-art results on the widely used English Switchboard for disfluency detection and outperforms prior-art by a significant margin. We make all our codes publicly available on GitHub (https://github.com/Sreyan88/Disfluency-Detection-with-Span-Classification)

📄 PDF Abstract BibTeX arXiv:2203.16028

Code (1)

sreyan88/disfluency-detection-with-span-classification 공식 구현 pytorch

Tasks

Classification

Similar Papers 제목 키워드 기반

Auxiliary Sequence Labeling Tasks for Disfluency Detection

2020-10-24 · Dongyub Lee, Byeongil Ko, Myeong Cheol Shin, Taesun Whang 외

Detecting disfluencies in spontaneous speech is an important preprocessing step in natural language processing and speech recognition applications. Existing works for disfluency detection have focused on designing a sing…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+3

Alzheimer's Dementia Recognition Using Acoustic, Lexical, Disfluency and Speech Pause Features Robust to Noisy Inputs

2021-06-29 · Morteza Rohanian, Julian Hough, Matthew Purver

We present two multimodal fusion-based deep learning models that consume ASR transcribed speech and acoustic data simultaneously to classify whether a speaker in a structured diagnostic task has Alzheimer's Disease and t…

Diagnostic

Transition-Based Disfluency Detection using LSTMs

2017-09-01 · EMNLP 2017 9 · Shaolei Wang, Wanxiang Che, Yue Zhang, Meishan Zhang 외

In this paper, we model the problem of disfluency detection using a transition-based framework, which incrementally constructs and labels the disfluency chunk of input sentences using a new transition system without synt…

Information Retrieval

Identification of primary and collateral tracks in stuttered speech

2020-03-02 · LREC 2020 5 · Rachid Riad, Anne-Catherine Bachoud-Lévi, Frank Rudzicz, Emmanuel Dupoux

Disfluent speech has been previously addressed from two main perspectives: the clinical perspective focusing on diagnostic, and the Natural Language Processing (NLP) perspective aiming at modeling these events and detect…

Diagnostic

Streaming Joint Speech Recognition and Disfluency Detection

2022-11-16 · Hayato Futami, Emiru Tsunoo, Kentaro Shibata, Yosuke Kashiwagi 외

Disfluency detection has mainly been solved in a pipeline approach, as post-processing of speech recognition. In this study, we propose Transformer-based encoder-decoder models that jointly solve speech recognition and d…

DecoderLanguage Modellingspeech-recognitionSpeech Recognition