paper-with-me

Papers

Building and Learning Structures in a Situated Blocks World Through Deep Language Understanding

2018-06-01 · WS 2018 6 · Ian Perera, James Allen, Choh Man Teng, Lucian Galescu

We demonstrate a system for understanding natural language utterances for structure description and placement in a situated blocks world context. By relying on a rich, domain-specific adaptation of a generic ontology and a logical form structure produced by a semantic parser, we obviate the need for an intermediate, domain-specific representation and can produce a reasoner that grounds and reasons over concepts and constraints with real-valued data. This linguistic base enables more flexibility in interpreting natural language expressions invoking intrinsic concepts and features of structures and space. We demonstrate some of the capabilities of a system grounded in deep language understanding and present initial results in a structure learning task.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Back to the Blocks World: Learning New Actions through Situated Human-Robot Dialogue

2014-06-01 · WS 2014 6 · Lanbo She, Shaohua Yang, Yu Cheng, Yunyi Jia 외

A Situated Dialogue System for Learning Structural Concepts in Blocks World

2018-07-01 · WS 2018 7 · Ian Perera, James Allen, Choh Man Teng, Lucian Galescu

We present a modular, end-to-end dialogue system for a situated agent to address a multimodal, natural language dialogue task in which the agent learns complex representations of block structure classes through assertion…

Transfer Learning

MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks

2021-09-13 · EMNLP 2021 11 · Cristian-Paul Bara, Sky CH-Wang, Joyce Chai

An ideal integration of autonomous agents in a human world implies that they are able to collaborate on human terms. In particular, theory of mind plays an important role in maintaining common ground during human collabo…

MinecraftTheory of Mind Modeling

Equivariant Maps for Hierarchical Structures

2020-06-05 · Renhao Wang, Marjan Albooyeh, Siamak Ravanbakhsh

While using invariant and equivariant maps, it is possible to apply deep learning to a range of primitive data structures, a formalism for dealing with hierarchy is lacking. This is a significant issue because many pract…

3D Semantic SegmentationSemantic SegmentationTranslation

Equivariant Networks for Hierarchical Structures

2020-12-01 · NeurIPS 2020 12 · Renhao Wang, Marjan Albooyeh, Siamak Ravanbakhsh

While using invariant and equivariant maps, it is possible to apply deep learning to a range of primitive data structures, a formalism for dealing with hierarchy is lacking. This is a significant issue because many pract…

Semantic SegmentationTranslation