paper-with-me

Papers

Zero-Shot Coordination via Semantic Relationships Between Actions and Observations

2021-09-29 · Mingwei Ma, Jizhou Liu, Samuel Sokota, Max Kleiman-Weiner, Jakob Nicolaus Foerster

An unaddressed challenge in zero-shot coordination is to take advantage of the semantic relationship between the features of an action and the features of observations. Humans take advantage of these relationships in highly intuitive ways. For instance in the absence of a shared-language, we might point to the object we desire or hold up fingers to indicate how many objects we want. To address this challenge, we investigate the effect of network architecture on the propensity of learning algorithms to make use of these relationships in human-compatible ways. We find that attention-based architectures that jointly process a featurized representation of the observation and the action, have a better inductive bias for exploiting semantic relationships for zero-shot coordination. Excitingly, in a set of diagnostic tasks, these agents produce highly human-compatible policies, without requiring the symmetry relationships of the problems to be hard-coded.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticInductive Bias

Similar Papers 제목 키워드 기반

Neighborhood Sensitive Mapping for Zero-Shot Classification using Independently Learned Semantic Embeddings

2016-05-26 · Gaurav Singh, Fabrizio Silvestri, John Shawe-Taylor

In a traditional setting, classifiers are trained to approximate a target function $f:X \rightarrow Y$ where at least a sample for each $y \in Y$ is presented to the training algorithm. In a zero-shot setting we have a s…

General Classificationzero-shot-classificationZero-Shot Learning

Automatic Curriculum Design for Zero-Shot Human-AI Coordination

2025-03-10 · Won-Sang You, Tae-Gwan Ha, Seo-Young Lee, Kyung-Joong Kim

Zero-shot human-AI coordination is the training of an ego-agent to coordinate with humans without using human data. Most studies on zero-shot human-AI coordination have focused on enhancing the ego-agent's coordination a…

Primitive Generation and Semantic-related Alignment for Universal Zero-Shot Segmentation

2023-06-19 · CVPR 2023 1 · Shuting He, Henghui Ding, Wei Jiang

We study universal zero-shot segmentation in this work to achieve panoptic, instance, and semantic segmentation for novel categories without any training samples. Such zero-shot segmentation ability relies on inter-class…

Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation+1

Improving Zero-Shot Multilingual Translation with Universal Representations and Cross-Mappings

2022-10-28 · Shuhao Gu, Yang Feng

The many-to-many multilingual neural machine translation can translate between language pairs unseen during training, i.e., zero-shot translation. Improving zero-shot translation requires the model to learn universal rep…

Machine TranslationTranslation

Compensating Supervision Incompleteness with Prior Knowledge in Semantic Image Interpretation

2019-10-01 · Ivan Donadello, Luciano Serafini

Semantic Image Interpretation is the task of extracting a structured semantic description from images. This requires the detection of visual relationships: triples (subject,relation,object) describing a semantic relation…

ObjectRelationRelational ReasoningRelationship Detection+3