paper-with-me

홈 › Papers

Situated Mapping of Sequential Instructions to Actions with Single-step Reward Observation

2018-05-25 · ACL 2018 7 · Alane Suhr, Yoav Artzi

We propose a learning approach for mapping context-dependent sequential instructions to actions. We address the problem of discourse and state dependencies with an attention-based model that considers both the history of the interaction and the state of the world. To train from start and goal states without access to demonstrations, we propose SESTRA, a learning algorithm that takes advantage of single-step reward observations and immediate expected reward maximization. We evaluate on the SCONE domains, and show absolute accuracy improvements of 9.8%-25.3% across the domains over approaches that use high-level logical representations.

📄 PDF Abstract BibTeX arXiv:1805.10209

Code (1)

clic-lab/scone 공식 구현

Similar Papers 제목 키워드 기반

Situated Instruction Following

2024-07-15 · So Yeon Min, Xavi Puig, Devendra Singh Chaplot, Tsung-Yen Yang 외

Language is never spoken in a vacuum. It is expressed, comprehended, and contextualized within the holistic backdrop of the speaker's history, actions, and environment. Since humans are used to communicating efficiently …

Instruction Following

Weakly Supervised Learning of Semantic Parsers for Mapping Instructions to Actions

2013-01-01 · TACL 2013 1 · Yoav Artzi, Luke Zettlemoyer

The context in which language is used provides a strong signal for learning to recover its meaning. In this paper, we show it can be used within a grounded CCG semantic parsing approach that learns a joint model of meani…

Semantic ParsingWeakly-supervised Learning

Language-Guided Adaptive Perception for Efficient Grounded Communication with Robotic Manipulators in Cluttered Environments

2018-07-01 · WS 2018 7 · Siddharth Patki, Thomas Howard

The utility of collaborative manipulators for shared tasks is highly dependent on the speed and accuracy of communication between the human and the robot. The run-time of recently developed probabilistic inference models…

Robot Manipulation

A Computational Model for Situated Task Learning with Interactive Instruction

2016-04-23 · Shiwali Mohan, James Kirk, John Laird

Learning novel tasks is a complex cognitive activity requiring the learner to acquire diverse declarative and procedural knowledge. Prior ACT-R models of acquiring task knowledge from instruction focused on learning proc…

Executing Instructions in Situated Collaborative Interactions

2019-10-08 · IJCNLP 2019 11 · Alane Suhr, Claudia Yan, Charlotte Schluger, Stanley Yu 외

We study a collaborative scenario where a user not only instructs a system to complete tasks, but also acts alongside it. This allows the user to adapt to the system abilities by changing their language or deciding to si…