Zero-Shot Coordination via Semantic Relationships Between Actions and Observations
An unaddressed challenge in zero-shot coordination is to take advantage of the semantic relationship between the features of an action and the features of observations. Humans take advantage of these relationships in highly intuitive ways. For instance in the absence of a shared-language, we might point to the object we desire or hold up fingers to indicate how many objects we want. To address this challenge, we investigate the effect of network architecture on the propensity of learning algorithms to make use of these relationships in human-compatible ways. We find that attention-based architectures that jointly process a featurized representation of the observation and the action, have a better inductive bias for exploiting semantic relationships for zero-shot coordination. Excitingly, in a set of diagnostic tasks, these agents produce highly human-compatible policies, without requiring the symmetry relationships of the problems to be hard-coded.
Code (0)
등록된 구현이 없습니다.
Tasks
DiagnosticInductive BiasSimilar Papers 제목 키워드 기반
Neighborhood Sensitive Mapping for Zero-Shot Classification using Independently Learned Semantic Embeddings
In a traditional setting, classifiers are trained to approximate a target function $f:X \rightarrow Y$ where at least a sample for each $y \in Y$ is presented to the training algorithm. In a zero-shot setting we have a s…
General Classificationzero-shot-classificationZero-Shot LearningAutomatic Curriculum Design for Zero-Shot Human-AI Coordination
Zero-shot human-AI coordination is the training of an ego-agent to coordinate with humans without using human data. Most studies on zero-shot human-AI coordination have focused on enhancing the ego-agent's coordination a…
Primitive Generation and Semantic-related Alignment for Universal Zero-Shot Segmentation
We study universal zero-shot segmentation in this work to achieve panoptic, instance, and semantic segmentation for novel categories without any training samples. Such zero-shot segmentation ability relies on inter-class…
Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation+1Improving Zero-Shot Multilingual Translation with Universal Representations and Cross-Mappings
The many-to-many multilingual neural machine translation can translate between language pairs unseen during training, i.e., zero-shot translation. Improving zero-shot translation requires the model to learn universal rep…
Machine TranslationTranslationCompensating Supervision Incompleteness with Prior Knowledge in Semantic Image Interpretation
Semantic Image Interpretation is the task of extracting a structured semantic description from images. This requires the detection of visual relationships: triples (subject,relation,object) describing a semantic relation…
ObjectRelationRelational ReasoningRelationship Detection+3