paper-with-me

Papers

Latent-IM: Latent Interaction Management for Speech LLMs

2026-07-29 · Adar Avsian, Atahan Dokme, Tony Woo, Larry Heck arxiv

Classical spoken dialogue systems often separated dialogue management from response realization: a policy selected the next dialogue action, and a generation component expressed that action. As dialogue systems shift toward LLMs, this decomposition has largely disappeared into the model's hidden representations. We ask whether an LLM-internal analogue of state estimation and action control can be recovered for conversational moves such as acknowledging, checking, querying, explaining, and replying. We formulate move control as two coupled problems: selection, predicting the appropriate next move from the dialogue context, and realization, causally producing a chosen move at generation time. We introduce Latent-IM, an internal dialogue-management framework that provides a general interface for choosing and deploying conversational moves under different objectives. Here, we use this control to reproduce human move choices, improving average end-to-end move accuracy by 12.5 points over the unsteered backbone while performing comparably to fine-tuning.

📄 PDF Abstract BibTeX arXiv:2607.26928

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

LaSR: Context-Aware Speech Recognition via Latent Reasoning

2026-05-30 · Heyang Liu, Ziyang Cheng, Jiayi Huang, Wenyang Xiao 외 arxiv

Recent advances in Speech Large Language Models (Speech LLMs) have significantly enhanced spoken language understanding and reasoning. However, their contextual awareness is limited, struggling to perform speech recognit…

Spoken Language UnderstandingSpeech Recognition

Audio-driven Gesture Generation via Deviation Feature in the Latent Space

2025-03-27 · Jiahui Chen, Yang Huan, Runhua Shi, Chanfan Ding 외

Gestures are essential for enhancing co-speech communication, offering visual emphasis and complementing verbal interactions. While prior work has concentrated on point-level motion or fully supervised data-driven method…

Gesture GenerationVideo GenerationWeakly-supervised Learning

Do LLMs Recognize Your Latent Preferences? A Benchmark for Latent Information Discovery in Personalized Interaction

2025-10-20 · Ioannis Tsaknakis, Bingqing Song, Shuyu Gan, Dongyeop Kang 외 arxiv

Large Language Models (LLMs) excel at producing broadly relevant text, but this generality becomes a limitation when user-specific preferences are required, such as recommending restaurants or planning travel. In these s…

Text SummarizationQuestion Answering

Interaction-via-Actions: Cattle Interaction Detection with Joint Learning of Action-Interaction Latent Space

2025-12-18 · Ren Nakagawa, Yang Yang, Risa Shinoda, Hiroaki Santo 외 arxiv

This paper introduces a method and application for automatically detecting behavioral interactions between grazing cattle from a single image, which is essential for smart livestock management in the cattle industry, suc…

Contrastive Learning

Hybrid Supervised Reinforced Model for Dialogue Systems

2020-11-04 · Carlos Miranda, Yacine Kessaci

This paper presents a recurrent hybrid model and training procedure for task-oriented dialogue systems based on Deep Recurrent Q-Networks (DRQN). The model copes with both tasks required for Dialogue Management: State Tr…

Decision MakingDialogue ManagementManagementmodel+1