paper-with-me

홈 › Papers

Document-editing Assistants and Model-based Reinforcement Learning as a Path to Conversational AI

2020-08-27 · Katya Kudashkina, Patrick M. Pilarski, Richard S. Sutton

Intelligent assistants that follow commands or answer simple questions, such as Siri and Google search, are among the most economically important applications of AI. Future conversational AI assistants promise even greater capabilities and a better user experience through a deeper understanding of the domain, the user, or the user's purposes. But what domain and what methods are best suited to researching and realizing this promise? In this article we argue for the domain of voice document editing and for the methods of model-based reinforcement learning. The primary advantages of voice document editing are that the domain is tightly scoped and that it provides something for the conversation to be about (the document) that is delimited and fully accessible to the intelligent assistant. The advantages of reinforcement learning in general are that its methods are designed to learn from interaction without explicit instruction and that it formalizes the purposes of the assistant. Model-based reinforcement learning is needed in order to genuinely understand the domain of discourse and thereby work efficiently with the user to achieve their goals. Together, voice document editing and model-based reinforcement learning comprise a promising research direction for achieving conversational AI.

📄 PDF Abstract BibTeX arXiv:2008.12095

Code (0)

등록된 구현이 없습니다.

Tasks

Model-based Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

HiMeS: Hippocampus-inspired Memory System for Personalized AI Assistants

2026-01-06 · Hailong Li, Feifei Li, Wenhui Que, Xingyu Fan arxiv

Large language models (LLMs) power many interactive systems such as chatbots, customer-service agents, and personal assistants. In knowledge-intensive scenarios requiring user-specific personalization, conventional retri…

Reinforcement Learning

NaRLE: Natural Language Models using Reinforcement Learning with Emotion Feedback

2021-10-05 · Ruijie Zhou, Soham Deshmukh, Jeremiah Greer, Charles Lee

Current research in dialogue systems is focused on conversational assistants working on short conversations in either task-oriented or open domain settings. In this paper, we focus on improving task-based conversational …

Deep Reinforcement Learningintent-classificationIntent ClassificationNatural Language Understanding+3

Beyond the Chat: Executable and Verifiable Text-Editing with LLMs

2023-09-27 · Philippe Laban, Jesse Vig, Marti A. Hearst, Caiming Xiong 외

Conversational interfaces powered by Large Language Models (LLMs) have recently become a popular way to obtain feedback during document editing. However, standard chat-based conversational interfaces do not support trans…

AI-driven formative assessment and adaptive learning in data-science education: Evaluating an LLM-powered virtual teaching assistant

2025-09-17 · Fadjimata I Anaroua, Qing Li, Yan Tang, Hong P. Liu arxiv

This paper presents VITA (Virtual Teaching Assistants), an adaptive distributed learning (ADL) platform that embeds a large language model (LLM)-powered chatbot (BotCaptain) to provide dialogic support, interoperable ana…

What to Edit Next: Visually Aligned Image-Editing Follow-Up Suggestions in Conversational Systems

2026-08-03 · Zhijing Zhang, Jinpeng Yu, Xin Song, Bingnan Li 외 hf

Conversational assistants increasingly recommend follow-up edits to help users continue a task. Existing systems primarily target text-only interactions, leaving image-creation conversations underexplored. In image-creat…

Multimodal RecommendationReinforcement Learning