paper-with-me

Papers

Dynamic Time-Aware Attention to Speaker Roles and Contexts for Spoken Language Understanding

2017-09-30 · Po-Chun Chen, Ta-Chung Chi, Shang-Yu Su, Yun-Nung Chen

Spoken language understanding (SLU) is an essential component in conversational systems. Most SLU component treats each utterance independently, and then the following components aggregate the multi-turn information in the separate phases. In order to avoid error propagation and effectively utilize contexts, prior work leveraged history for contextual SLU. However, the previous model only paid attention to the content in history utterances without considering their temporal information and speaker roles. In the dialogues, the most recent utterances should be more important than the least recent ones. Furthermore, users usually pay attention to 1) self history for reasoning and 2) others' utterances for listening, the speaker of the utterances may provides informative cues to help understanding. Therefore, this paper proposes an attention-based network that additionally leverages temporal information and speaker role for better SLU, where the attention to contexts and speaker roles can be automatically learned in an end-to-end manner. The experiments on the benchmark Dialogue State Tracking Challenge 4 (DSTC4) dataset show that the time-aware dynamic role attention networks significantly improve the understanding performance.

📄 PDF Abstract BibTeX arXiv:1710.00165

Code (1)

MiuLab/Time-SLU 공식 구현 tf

Tasks

Dialogue State TrackingSpoken Language Understanding

Similar Papers 제목 키워드 기반

Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialogue

2020-09-14 · Longxiang Liu, Zhuosheng Zhang, Hai Zhao, Xi Zhou 외

A multi-turn dialogue is composed of multiple utterances from two or more different speaker roles. Thus utterance- and speaker-aware clues are supposed to be well captured in models. However, in the existing retrieval-ba…

Retrieval

Contrastive Speaker-Aware Learning for Multi-party Dialogue Generation with LLMs

2025-03-11 · Tianyu Sun, Kun Qian, Wenhong Wang

Multi-party dialogue generation presents significant challenges due to the complex interplay of multiple speakers and interwoven conversational threads. Traditional approaches often fall short in capturing these complexi…

Contrastive LearningDialogue GenerationDiversityInformativeness

DualTalk: Dual-Speaker Interaction for 3D Talking Head Conversations

2025-05-23 · CVPR 2025 1 · Ziqiao Peng, Yanbo Fan, HaoYu Wu, Xuan Wang 외

In face-to-face conversations, individuals need to switch between speaking and listening roles seamlessly. Existing 3D talking head generation models focus solely on speaking or listening, neglecting the natural dynamics…

Talking Head Generation

Joint ASR and Speaker Role Tagging with Serialized Output Training

2025-06-12 · Anfeng Xu, Tiantian Feng, Shrikanth Narayanan

Automatic Speech Recognition systems have made significant progress with large-scale pre-trained models. However, most current systems focus solely on transcribing the speech without identifying speaker roles, a function…

Automatic Speech Recognitionspeech-recognitionSpeech Recognition

Channel-aware Decoupling Network for Multi-turn Dialogue Comprehension

2023-01-10 · Zhuosheng Zhang, Hai Zhao, Longxiang Liu

Training machines to understand natural language and interact with humans is one of the major goals of artificial intelligence. Recent years have witnessed an evolution from matching networks to pre-trained language mode…