paper-with-me

홈 › Papers

Keyword-Aware ASR Error Augmentation for Robust Dialogue State Tracking

2024-09-10 · Jihyun Lee, Solee Im, Wonjun Lee, Gary Geunbae Lee

Dialogue State Tracking (DST) is a key part of task-oriented dialogue systems, identifying important information in conversations. However, its accuracy drops significantly in spoken dialogue environments due to named entity errors from Automatic Speech Recognition (ASR) systems. We introduce a simple yet effective data augmentation method that targets those entities to improve the robustness of DST model. Our novel method can control the placement of errors using keyword-highlighted prompts while introducing phonetically similar errors. As a result, our method generated sufficient error patterns on keywords, leading to improved accuracy in noised and low-accuracy ASR environments.

📄 PDF Abstract BibTeX arXiv:2409.06263

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data AugmentationDialogue State Trackingspeech-recognitionSpeech RecognitionTask-Oriented Dialogue Systems

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.

Similar Papers 제목 키워드 기반

Adapting Text-based Dialogue State Tracker for Spoken Dialogues

2023-08-29 · Jaeseok Yoon, Seunghyun Hwang, Ran Han, Jeonguk Bang 외

Although there have been remarkable advances in dialogue systems through the dialogue systems technology competition (DSTC), it remains one of the key challenges to building a robust task-oriented dialogue system with a …

Automatic Speech RecognitionData Augmentationspeech-recognitionSpeech Recognition

Automatically Learning Data Augmentation Policies for Dialogue Tasks

2019-09-27 · IJCNLP 2019 11 · Tong Niu, Mohit Bansal

Automatic data augmentation (AutoAugment) (Cubuk et al., 2019) searches for optimal perturbation policies via a controller trained using performance rewards of a sampled policy on the target task, hence reducing data-lev…

Data AugmentationDialogue GenerationPOSTAG

Multimodal Dialogue State Tracking By QA Approach with Data Augmentation

2020-07-20 · Xiangyang Mou, Brandyn Sigouin, Ian Steenstra, Hui Su

Recently, a more challenging state tracking task, Audio-Video Scene-Aware Dialogue (AVSD), is catching an increasing amount of attention among researchers. Different from purely text-based dialogue state tracking, the di…

Data AugmentationDecoderDialogue State TrackingOpen-Domain Question Answering+2

CAB: Empathetic Dialogue Generation with Cognition, Affection and Behavior

2023-02-03 · Pan Gao, Donghong Han, Rui Zhou, Xuejiao Zhang 외

Empathy is an important characteristic to be considered when building a more intelligent and humanized dialogue agent. However, existing methods did not fully comprehend empathy as a complex process involving three aspec…

Dialogue Generation

Speaker-Aware Simulation Improves Conversational Speech Recognition

2026-02-04 · Máté Gedeon, Péter Mihajlik arxiv

Automatic speech recognition (ASR) for conversational speech remains challenging due to the limited availability of large-scale, well-annotated multi-speaker dialogue data and the complex temporal dynamics of natural int…

Dialogue GenerationSpeech RecognitionData Augmentation