paper-with-me

Papers

Filler Word Detection and Classification: A Dataset and Benchmark

2022-03-28 · Ge Zhu, Juan-Pablo Caceres, Justin Salamon

Filler words such as uh' or um' are sounds or words people use to signal they are pausing to think. Finding and removing filler words from recordings is a common and tedious task in media editing. Automatically detecting and classifying filler words could greatly aid in this task, but few studies have been published on this problem to date. A key reason is the absence of a dataset with annotated filler words for model training and evaluation. In this work, we present a novel speech dataset, PodcastFillers, with 35K annotated filler words and 50K annotations of other sounds that commonly occur in podcasts such as breaths, laughter, and word repetitions. We propose a pipeline that leverages VAD and ASR to detect filler candidates and a classifier to distinguish between filler word types. We evaluate our proposed pipeline on PodcastFillers, compare to several baselines, and present a detailed ablation study. In particular, we evaluate the importance of using ASR and how it compares to a transcription-free approach resembling keyword spotting. We show that our pipeline obtains state-of-the-art results, and that leveraging ASR strongly outperforms a keyword spotting approach. We make PodcastFillers publicly available, in the hope that our work serves as a benchmark for future research.

📄 PDF Abstract BibTeX arXiv:2203.15135

Code (1)

gzhu06/PodcastFillers_Utils 공식 구현

Tasks

ClassificationKeyword SpottingSound Event Localization and Detection

Similar Papers 제목 키워드 기반

Filler Word Detection with Hard Category Mining and Inter-Category Focal Loss

2023-04-12 · Zhiyuan Zhao, Lijun Wu, Chuanxin Tang, Dacheng Yin 외

Filler words like ``um" or ``uh" are common in spontaneous speech. It is desirable to automatically detect and remove them in recordings, as they affect the fluency, confidence, and professionalism of speech. Previous st…

Transcription free filler word detection with Neural semi-CRFs

2023-03-11 · Ge Zhu, Yujia Yan, Juan-Pablo Caceres, Zhiyao Duan

Non-linguistic filler words, such as "uh" or "um", are prevalent in spontaneous speech and serve as indicators for expressing hesitation or uncertainty. Previous works for detecting certain non-linguistic filler words ar…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

WhisperD: Dementia Speech Recognition and Filler Word Detection with Whisper

2025-05-25 · Emmanuel Akinrintoyo, Nadine Abdelhalim, Nicole Salomons

Whisper fails to correctly transcribe dementia speech because persons with dementia (PwDs) often exhibit irregular speech patterns and disfluencies such as pauses, repetitions, and fragmented sentences. It was trained on…

speech-recognitionSpeech Recognition

Constraining constructions with WordNet: pros and cons for the semantic annotation of fillers in the Italian Constructicon

2025-01-10 · Flavio Pisciotta, Ludovica Pannitto, Lucia Busso, Beatrice Bernasconi 외

The paper discusses the role of WordNet-based semantic classification in the formalization of constructions, and more specifically in the semantic annotation of schematic fillers, in the Italian Constructicon. We outline…

Small-Footprint Open-Vocabulary Keyword Spotting with Quantized LSTM Networks

2020-02-25 · Théodore Bluche, Maël Primet, Thibault Gisselbrecht

We explore a keyword-based spoken language understanding system, in which the intent of the user can directly be derived from the detection of a sequence of keywords in the query. In this paper, we focus on an open-vocab…

Keyword SpottingSpoken Language Understanding