paper-with-me

홈 › Papers

ReSpAct: Harmonizing Reasoning, Speaking, and Acting Towards Building Large Language Model-Based Conversational AI Agents

2024-11-01 · Vardhan Dongre, Xiaocheng Yang, Emre Can Acikgoz, Suvodip Dey, Gokhan Tur, Dilek Hakkani-Tür

Large language model (LLM)-based agents are increasingly employed to interact with external environments (e.g., games, APIs, world models) to solve user-provided tasks. However, current frameworks often lack the ability to collaborate effectively with users in fully conversational settings. Conversations are essential for aligning on task details, achieving user-defined goals, and satisfying preferences. While existing agents address ambiguity through clarification questions, they underutilize the broader potential of an LLM's conversational capabilities. In this work, we introduce ReSpAct, an LLM-based agent designed to seamlessly integrate reasoning, decision-making, and dynamic dialogue for task-solving. Expanding on reasoning-first approaches like ReAct, ReSpAct employs active, free-flowing dialogues to interpret instructions, clarify goals, provide status updates, resolve subtask failures, and refine plans based on user inputs without any explicit dialogue schema. By alternating between task-solving actions and interactive conversations, ReSpAct demonstrates improved performance across diverse environments. We evaluate ReSpAct in user-interactive settings, including task-oriented dialogue systems (MultiWOZ) and decision-making tasks (ALFWorld, WebShop). ReSpAct outperforms ReAct with absolute success rate improvements of 6% and 4% in ALFWorld and WebShop, respectively, and achieves a 5.5% gain in Inform and a 3% gain in Success scores in MultiWOZ. These results highlight the value of integrating dynamic user-agent collaboration for more effective task resolution.

📄 PDF Abstract BibTeX arXiv:2411.00927

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingLanguage ModelingLanguage ModellingLarge Language ModelTask-Oriented Dialogue Systems

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Mind-Paced Speaking: A Dual-Brain Approach to Real-Time Reasoning in Spoken Language Models

2025-10-10 · Donghang Wu, Haoyang Zhang, Jun Chen, Xiangyu 외 arxiv

Real-time Spoken Language Models (SLMs) struggle to leverage Chain-of-Thought (CoT) reasoning due to the prohibitive latency of generating the entire thought process sequentially. Enabling SLMs to think while speaking, s…

Mathematical Reasoning

Harmonizing word alignments and syntactic structures for extracting phrasal translation equivalents

2015-06-01 · WS 2015 6 · Dun Deng, Nianwen Xue, Shiman Guo
Machine TranslationTranslationWord Alignment

Detecting speaking persons in video

2021-10-25 · Hannes Fassold

We present a novel method for detecting speaking persons in video, by extracting facial landmarks with a neural network and analysing these landmarks statistically over time

Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoning

2026-09-09 · Mehrnaz Mofakhami, Ananya Sahu, Alejandro R. Salamanca, Daniel D'souza 외 arxiv

Reasoning language models have made substantial advances on a variety of complex tasks, yet their capabilities remain overwhelmingly English-centric: models primarily reason in English regardless of the language they are…

Instruction Following

O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning

2025-01-22 · Haotian Luo, Li Shen, Haiying He, Yibo Wang 외

Recently, long-thought reasoning LLMs, such as OpenAI's O1, adopt extended reasoning processes similar to how humans ponder over complex problems. This reasoning paradigm significantly enhances the model's problem-solvin…

Mathematical Reasoning