paper-with-me

홈 › Papers

Deep Dialog Act Recognition using Multiple Token, Segment, and Context Information Representations

2018-07-23 · Eugénio Ribeiro, Ricardo Ribeiro, David Martins de Matos

Dialog act (DA) recognition is a task that has been widely explored over the years. Recently, most approaches to the task explored different DNN architectures to combine the representations of the words in a segment and generate a segment representation that provides cues for intention. In this study, we explore means to generate more informative segment representations, not only by exploring different network architectures, but also by considering different token representations, not only at the word level, but also at the character and functional levels. At the word level, in addition to the commonly used uncontextualized embeddings, we explore the use of contextualized representations, which provide information concerning word sense and segment structure. Character-level tokenization is important to capture intention-related morphological aspects that cannot be captured at the word level. Finally, the functional level provides an abstraction from words, which shifts the focus to the structure of the segment. We also explore approaches to enrich the segment representation with context information from the history of the dialog, both in terms of the classifications of the surrounding segments and the turn-taking history. This kind of information has already been proved important for the disambiguation of DAs in previous studies. Nevertheless, we are able to capture additional information by considering a summary of the dialog history and a wider turn-taking context. By combining the best approaches at each step, we achieve results that surpass the previous state-of-the-art on generic DA recognition on both SwDA and MRDA, two of the most widely explored corpora for the task. Furthermore, by considering both past and future context, simulating annotation scenario, our approach achieves a performance similar to that of a human annotator on SwDA and surpasses it on MRDA.

📄 PDF Abstract BibTeX arXiv:1807.08587

Code (0)

등록된 구현이 없습니다.

Tasks

Word Embeddings

Similar Papers 제목 키워드 기반

Joint Learning of Dialog Act Segmentation and Recognition in Spoken Dialog Using Neural Networks

2017-11-01 · IJCNLP 2017 11 · Tianyu Zhao, Tatsuya Kawahara

Dialog act segmentation and recognition are basic natural language understanding tasks in spoken dialog systems. This paper investigates a unified architecture for these two tasks, which aims to improve the model{'}s per…

Automatic Speech Recognition (ASR)Natural Language UnderstandingSegmentationSpeech Recognition+1

Better, Stronger, Faster: Tackling the Trilemma in MLLM-based Segmentation with Simultaneous Textual Mask Prediction

2025-11-29 · Jiazhen Liu, Mingkuan Feng, Long Chen arxiv

Integrating segmentation into Multimodal Large Language Models (MLLMs) presents a core trilemma: simultaneously preserving dialogue ability, achieving high segmentation performance, and ensuring fast inference. Prevailin…

Dialogue Generation

A Unified Neural Architecture for Joint Dialog Act Segmentation and Recognition in Spoken Dialog System

2018-07-01 · WS 2018 7 · Tianyu Zhao, Tatsuya Kawahara

In spoken dialog systems (SDSs), dialog act (DA) segmentation and recognition provide essential information for response generation. A majority of previous works assumed ground-truth segmentation of DA units, which is no…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+5

What Helps Transformers Recognize Conversational Structure? Importance of Context, Punctuation, and Labels in Dialog Act Recognition

2021-07-05 · Piotr Żelasko, Raghavendra Pappagari, Najim Dehak

Dialog acts can be interpreted as the atomic units of a conversation, more fine-grained than utterances, characterized by a specific communicative function. The ability to structure a conversational transcript as a seque…

SegmentationSpecificitySpoken Language Understanding

Multiscale Contextual Learning for Speech Emotion Recognition in Emergency Call Center Conversations

2023-08-28 · Théo Deschamps-Berger, Lori Lamel, Laurence Devillers

Emotion recognition in conversations is essential for ensuring advanced human-machine interactions. However, creating robust and accurate emotion recognition systems in real life is challenging, mainly due to the scarcit…

Emotion RecognitionSpeech Emotion Recognition