paper-with-me

홈 › Papers

Dynamic Observation Policies in Observation Cost-Sensitive Reinforcement Learning

2023-07-05 · Colin Bellinger, Mark Crowley, Isaac Tamblyn

Reinforcement learning (RL) has been shown to learn sophisticated control policies for complex tasks including games, robotics, heating and cooling systems and text generation. The action-perception cycle in RL, however, generally assumes that a measurement of the state of the environment is available at each time step without a cost. In applications such as materials design, deep-sea and planetary robot exploration and medicine, however, there can be a high cost associated with measuring, or even approximating, the state of the environment. In this paper, we survey the recently growing literature that adopts the perspective that an RL agent might not need, or even want, a costly measurement at each time step. Within this context, we propose the Deep Dynamic Multi-Step Observationless Agent (DMSOA), contrast it with the literature and empirically evaluate it on OpenAI gym and Atari Pong environments. Our results, show that DMSOA learns a better policy with fewer decision steps and measurements than the considered alternative from the literature.

📄 PDF Abstract BibTeX arXiv:2307.02620

Code (1)

cbellinger27/learning-when-to-observe-in-rl 공식 구현 pytorch

Tasks

OpenAI Gymreinforcement-learningReinforcement LearningReinforcement Learning (RL)Text Generation

Similar Papers 제목 키워드 기반

Optimal Policies for Observing Time Series and Related Restless Bandit Problems

2017-03-29 · Christopher R. Dance, Tomi Silander

The trade-off between the cost of acquiring and processing data, and uncertainty due to a lack of data is fundamental in machine learning. A basic instance of this trade-off is the problem of deciding when to make noisy …

Time SeriesTime Series Analysis

Model-Predictive Policy Learning with Uncertainty Regularization for Driving in Dense Traffic

2019-01-08 · ICLR 2019 5 · Mikael Henaff, Alfredo Canziani, Yann Lecun

Learning a policy using only observational data is challenging because the distribution of states it induces at execution time may differ from the distribution observed during training. We propose to train a policy by un…

Rolling Shutter Correction

Seeing Differently, Acting Similarly: Heterogeneously Observable Imitation Learning

2021-06-17 · Xin-Qiang Cai, Yao-Xiang Ding, Zi-Xuan Chen, Yuan Jiang 외

In many real-world imitation learning tasks, the demonstrator and the learner have to act under different observation spaces. This situation brings significant obstacles to existing imitation learning approaches, since m…

Imitation Learning

Risk-Aware Reinforcement Learning for Mobile Manipulation

2026-03-04 · Michael Groom, James Wilson, Nick Hawes, Lars Kunze arxiv

For robots to successfully transition from lab settings to everyday environments, they must begin to reason about the risks associated with their actions and make informed, risk-aware decisions. This is particularly true…

Reinforcement Learning

To Measure or Not: A Cost-Sensitive, Selective Measuring Environment for Agricultural Management Decisions with Reinforcement Learning

2025-01-22 · Hilmy Baja, Michiel Kallenberg, Ioannis N. Athanasiadis

Farmers rely on in-field observations to make well-informed crop management decisions to maximize profit and minimize adverse environmental impact. However, obtaining real-world crop state measurements is labor-intensive…

ManagementReinforcement Learning (RL)