paper-with-me

Papers

Follow your Nose: Using General Value Functions for Directed Exploration in Reinforcement Learning

2022-03-02 · Durgesh Kalwar, Omkar Shelke, Somjit Nath, Hardik Meisheri, Harshad Khadilkar

Improving sample efficiency is a key challenge in reinforcement learning, especially in environments with large state spaces and sparse rewards. In literature, this is resolved either through the use of auxiliary tasks (subgoals) or through clever exploration strategies. Exploration methods have been used to sample better trajectories in large environments while auxiliary tasks have been incorporated where the reward is sparse. However, few studies have attempted to tackle both large scale and reward sparsity at the same time. This paper explores the idea of combining exploration with auxiliary task learning using General Value Functions (GVFs) and a directed exploration strategy. We present a way to learn value functions which can be used to sample actions and provide directed exploration. Experiments on navigation tasks with varying grid sizes demonstrate the performance advantages over several competitive baselines.

📄 PDF Abstract BibTeX arXiv:2203.00874

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Reward (Mis)design for Autonomous Driving

2021-04-28 · W. Bradley Knox, Alessandro Allievi, Holger Banzhaf, Felix Schmitt 외

This article considers the problem of diagnosing certain common errors in reward design. Its insights are also applicable to the design of cost functions and performance metrics more generally. To diagnose common errors,…

Autonomous Drivingreinforcement-learningReinforcement Learning (RL)

Shape Your Body: Value Gradients for Multi-Embodiment Robot Design

2026-05-30 · Nico Bohlinger, Jan Peters arxiv

We propose to turn generalist multi-embodiment value functions into reusable models for robot design. Instead of running a new reinforcement learning co-design loop for each robot, we first train an embodiment-aware poli…

Reinforcement Learning

Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation

2024-06-04 · Yue Ma, Hongyu Liu, Hongfa Wang, Heng Pan 외

We present Follow-Your-Emoji, a diffusion-based framework for portrait animation, which animates a reference portrait with target landmark sequences. The main challenge of portrait animation is to preserve the identity o…

Portrait Animation

Follow Your Nose -- Which Code Smells are Worth Chasing?

2021-03-02 · Idan Amit, Nili Ben Ezra, Dror G. Feitelson

The common use case of code smells assumes causality: Identify a smell, remove it, and by doing so improve the code. We empirically investigate their fitness to this use. We present a list of properties that code smells …

Trading Strategies with Position Limits

2017-12-19

Whether you trade futures for yourself or a hedge fund, your strategy is counted. Long and short position limits make the number of unique strategies finite. Formulas of the numbers of strategies, transactions, do nothin…

Position