paper-with-me

홈 › Papers

Dialog-context aware end-to-end speech recognition

2018-08-07 · Suyoun Kim, Florian Metze

Existing speech recognition systems are typically built at the sentence level, although it is known that dialog context, e.g. higher-level knowledge that spans across sentences or speakers, can help the processing of long conversations. The recent progress in end-to-end speech recognition systems promises to integrate all available information (e.g. acoustic, language resources) into a single model, which is then jointly optimized. It seems natural that such dialog context information should thus also be integrated into the end-to-end models to improve further recognition accuracy. In this work, we present a dialog-context aware speech recognition model, which explicitly uses context information beyond sentence-level information, in an end-to-end fashion. Our dialog-context model captures a history of sentence-level context so that the whole system can be trained with dialog-context information in an end-to-end manner. We evaluate our proposed approach on the Switchboard conversational speech corpus and show that our system outperforms a comparable sentence-level end-to-end speech recognition system.

📄 PDF Abstract BibTeX arXiv:1808.02171

Code (0)

등록된 구현이 없습니다.

Tasks

Sentencespeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Enhancing Dialogue Speech Recognition with Robust Contextual Awareness via Noise Representation Learning

2024-08-12 · Wonjun Lee, San Kim, Gary Geunbae Lee

Recent dialogue systems rely on turn-based spoken interactions, requiring accurate Automatic Speech Recognition (ASR). Errors in ASR can significantly impact downstream dialogue tasks. To address this, using dialogue con…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderRepresentation Learning+2

Context-Aware Dialog Re-Ranking for Task-Oriented Dialog Systems

2018-11-28 · Junki Ohmura, Maxine Eskenazi

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused…

Re-Rankingspeech-recognitionSpeech Recognition

Emotion-Aware Speech Generation with Character-Specific Voices for Comics

2025-09-18 · Zhiwen Qian, Jinhua Liang, Huan Zhang arxiv

This paper presents an end-to-end pipeline for generating character-specific, emotion-aware speech from comics. The proposed system takes full comic volumes as input and produces speech aligned with each character's dial…

An Interaction-aware Attention Network for Speech Emotion Recognition in Spoken Dialogs

2019-04-17 · ICASSP 2019 4 · Sung-Lin Yeh, Yun-Shao Lin, Chi-Chun Lee

In this work, we propose an interaction-aware attention network (IAAN) that incorporate contextual information in the learned vocal representation through a novel attention mechanism. Our proposed method achieves 66.3% a…

Emotion RecognitionSpeech Emotion Recognition

Reading the Mood Behind Words: Integrating Prosody-Derived Emotional Context into Socially Responsive VR Agents

2026-03-10 · SangYeop Jeong, Yeongseo Na, Seung Gyu Jeong, Jin-Woo Jeong 외 arxiv

In VR interactions with embodied conversational agents, users' emotional intent is often conveyed more by how something is said than by what is said. However, most VR agent pipelines rely on speech-to-text processing, di…

Speech Emotion Recognition