paper-with-me

Papers

Inferring Behavior-Specific Context Improves Zero-Shot Generalization in Reinforcement Learning

2024-04-15 · Tidiane Camaret Ndir, André Biedenkapp, Noor Awad

In this work, we address the challenge of zero-shot generalization (ZSG) in Reinforcement Learning (RL), where agents must adapt to entirely novel environments without additional training. We argue that understanding and utilizing contextual cues, such as the gravity level of the environment, is critical for robust generalization, and we propose to integrate the learning of context representations directly with policy learning. Our algorithm demonstrates improved generalization on various simulated domains, outperforming prior context-learning techniques in zero-shot settings. By jointly learning policy and context, our method acquires behavior-specific context representations, enabling adaptation to unseen environments and marks progress towards reinforcement learning systems that generalize across diverse real-world tasks. Our code and experiments are available at https://github.com/tidiane-camaret/contextual_rl_zero_shot.

📄 PDF Abstract BibTeX arXiv:2404.09521

Code (1)

tidiane-camaret/contextual_rl_zero_shot 공식 구현 pytorch

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)Zero-shot Generalization

Methods 이 논문이 사용한 방법론

Gravity Gravity is a kinematic approach to optimization based on gradients.

Similar Papers 제목 키워드 기반

PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts

2023-08-02 · Bang An, Sicheng Zhu, Michael-Andrei Panaitescu-Liess, Chaithanya Kumar Mummadi 외

Vision-language models like CLIP are widely used in zero-shot image classification due to their ability to understand various visual concepts and natural language descriptions. However, how to fully leverage CLIP's unpre…

Classificationimage-classificationImage ClassificationLanguage Modelling+4

Dreaming of Many Worlds: Learning Contextual World Models Aids Zero-Shot Generalization

2024-03-16 · Sai Prasanna, Karim Farid, Raghu Rajan, André Biedenkapp

Zero-shot generalization (ZSG) to unseen dynamics is a major challenge for creating generally capable embodied agents. To address the broader challenge, we start with the simpler setting of contextual reinforcement learn…

Zero-shot Generalization

A Vision-and-Knowledge Enhanced Large Language Model for Generalizable Pedestrian Crossing Behavior Inference

2026-01-02 · Qingwen Pu, Kun Xie, Hong Yang, Guocong Zhai arxiv

Existing paradigms for inferring pedestrian crossing behavior, ranging from statistical models to supervised learning methods, demonstrate limited generalizability and perform inadequately on new sites. Recent advances i…

Few-Shot Learning

Ethical-Advice Taker: Do Language Models Understand Natural Language Interventions?

2021-06-02 · Findings (ACL) 2021 8 · Jieyu Zhao, Daniel Khashabi, Tushar Khot, Ashish Sabharwal 외

Is it possible to use natural language to intervene in a model's behavior and alter its prediction in a desired way? We investigate the effectiveness of natural language interventions for reading-comprehension systems, s…

EthicsFew-Shot LearningQuestion AnsweringReading Comprehension

Zero-Shot Crowd Behavior Recognition

2019-08-16 · Xun Xu, Shaogang Gong, Timothy Hospedales

Understanding crowd behavior in video is challenging for computer vision. There have been increasing attempts on modeling crowded scenes by introducing ever larger property ontologies (attributes) and annotating ever lar…

AttributeZero-Shot Learning