paper-with-me

Papers

Teaching Embodied Reinforcement Learning Agents: Informativeness and Diversity of Language Use

2024-10-31 · Jiajun Xi, Yinong He, Jianing Yang, Yinpei Dai, Joyce Chai

In real-world scenarios, it is desirable for embodied agents to have the ability to leverage human language to gain explicit or implicit knowledge for learning tasks. Despite recent progress, most previous approaches adopt simple low-level instructions as language inputs, which may not reflect natural human communication. It's not clear how to incorporate rich language use to facilitate task learning. To address this question, this paper studies different types of language inputs in facilitating reinforcement learning (RL) embodied agents. More specifically, we examine how different levels of language informativeness (i.e., feedback on past behaviors and future guidance) and diversity (i.e., variation of language expressions) impact agent learning and inference. Our empirical results based on four RL benchmarks demonstrate that agents trained with diverse and informative language feedback can achieve enhanced generalization and fast adaptation to new tasks. These findings highlight the pivotal role of language use in teaching embodied agents new tasks in an open world. Project website: https://github.com/sled-group/Teachable_RL

📄 PDF Abstract BibTeX arXiv:2410.24218

Code (1)

sled-group/teachable_rl 공식 구현

Tasks

DiversityInformativenessReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

LectūraAgents: A Multi-Agent Framework for Adaptive Personalized AI-Assisted Learning and Embodied Teaching

2026-06-15 · Jaward Sesay, Yue Yu, Siwei Dong, Börje F. Karlsson arxiv

Effective personalized AI-assisted learning demands systems that can not only generate accurate learner-specific educational materials, but also dynamically adapt their instruction to diverse learners. However, existing …

Semantic Segmentation

LAGEA: Language Guided Embodied Agents for Robotic Manipulation

2025-09-27 · Abdul Monaf Chowdhury, Akm Moshiur Rahman Mazumder, Rabeya Akter, Safaeid Hossain Arib arxiv

Robotic manipulation benefits from foundation models that describe goals, but today's agents still lack a principled way to learn from their own mistakes. We ask whether natural language can serve as feedback, an error-r…

Reinforcement Learning

Benchmarking Augmentation Methods for Learning Robust Navigation Agents: the Winning Entry of the 2021 iGibson Challenge

2021-09-22 · Naoki Yokoyama, Qian Luo, Dhruv Batra, Sehoon Ha

Recent advances in deep reinforcement learning and scalable photorealistic simulation have led to increasingly mature embodied AI for various visual tasks, including navigation. However, while impressive progress has bee…

BenchmarkingData AugmentationDeep Reinforcement LearningImage Augmentation+4

Class Teaching for Inverse Reinforcement Learners

2019-11-29 · Manuel Lopes, Francisco Melo

In this paper we propose the first machine teaching algorithm for multiple inverse reinforcement learners. Specifically, our contributions are: (i) we formally introduce the problem of teaching a sequential task to a het…

Distilling Internet-Scale Vision-Language Models into Embodied Agents

2023-01-29 · Theodore Sumers, Kenneth Marino, Arun Ahuja, Rob Fergus 외

Instruction-following agents must ground language into their observation and action spaces. Learning to ground language is challenging, typically requiring domain-specific engineering or large quantities of human interac…

Instruction Following