paper-with-me

홈 › Papers

Are cascade dialogue state tracking models speaking out of turn in spoken dialogues?

2023-11-03 · Lucas Druart, Léo Jacqmin, Benoît Favre, Lina Maria Rojas-Barahona, Valentin Vielzeuf

In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's needs is key to a smooth interaction. Traditionally TOD systems are composed of several modules that interact with one another. While each of these components is the focus of active research communities, their behavior in interaction can be overlooked. This paper proposes a comprehensive analysis of the errors of state of the art systems in complex settings such as Dialogue State Tracking which highly depends on the dialogue context. Based on spoken MultiWoz, we identify that errors on non-categorical slots' values are essential to address in order to bridge the gap between spoken and chat-based dialogue systems. We explore potential solutions to improve transcriptions and help dialogue state tracking generative models correct such errors.

📄 PDF Abstract BibTeX arXiv:2311.04922

Code (0)

등록된 구현이 없습니다.

Tasks

Dialogue State Tracking

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Is one brick enough to break the wall of spoken dialogue state tracking?

2023-11-03 · Lucas Druart, Valentin Vielzeuf, Yannick Estève

In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's requests (\textit{a.k.a} dialogue state tracking) is key to a smooth interaction. Traditionally, TOD systems perform th…

Dialogue State Tracking

DuplexCascade: Full-Duplex Speech-to-Speech Dialogue with VAD-Free Cascaded ASR-LLM-TTS Pipeline and Micro-Turn Optimization

2026-03-10 · Jianing Yang, Yusuke Fujita, Yui Sudo arxiv

Spoken dialog systems with cascaded ASR-LLM-TTS modules retain strong LLM intelligence, but VAD segmentation often forces half-duplex turns and brittle control. On the other hand, VAD-free end-to-end model support full-d…

Style-Talker: Finetuning Audio Language Model and Style-Based Text-to-Speech Model for Fast Spoken Dialogue Generation

2024-08-13 · Yinghao Aaron Li, Xilin Jiang, Jordan Darefsky, Ge Zhu 외

The rapid advancement of large language models (LLMs) has significantly propelled the development of text-based chatbots, demonstrating their capability to engage in coherent and contextually relevant dialogues. However,…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Dialogue GenerationLanguage Modeling+6

Cascaded LSTMs based Deep Reinforcement Learning for Goal-driven Dialogue

2019-10-31 · Yue Ma, Xiaojie Wang, Zhenjiang Dong, Hong Chen

This paper proposes a deep neural network model for joint modeling Natural Language Understanding (NLU) and Dialogue Management (DM) in goal-driven dialogue systems. There are three parts in this model. A Long Short-Term…

Deep Reinforcement LearningDialogue ManagementManagementNatural Language Understanding+3

Common Ground Tracking in Multimodal Dialogue

2024-03-26 · Ibrahim Khebour, Kenneth Lai, Mariah Bradford, Yifan Zhu 외

Within Dialogue Modeling research in AI and NLP, considerable attention has been spent on ``dialogue state tracking'' (DST), which is the ability to update the representations of the speaker's needs at each turn in the d…

Dialogue State Tracking