Online Active Perception for Partially Observable Markov Decision Processes with Limited Budget
Active perception strategies enable an agent to selectively gather information in a way to improve its performance. In applications in which the agent does not have prior knowledge about the available information sources, it is crucial to synthesize active perception strategies at runtime. We consider a setting in which at runtime an agent is capable of gathering information under a limited budget. We pose the problem in the context of partially observable Markov decision processes. We propose a generalized greedy strategy that selects a subset of information sources with near-optimality guarantees on uncertainty reduction. Our theoretical analysis establishes that the proposed active perception strategy achieves near-optimal performance in terms of expected cumulative reward. We demonstrate the resulting strategies in simulations on a robotic navigation problem.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Perception-Aware Point-Based Value Iteration for Partially Observable Markov Decision Processes
Partially observable Markov decision processes (POMDPs) are a widely-used framework to model decision-making with uncertainty about the environment and under stochastic outcome. In conventional POMDP models, the observat…
Decision MakingIntegrated Control and Active Perception in POMDPs for Temporal Logic Tasks and Information Acquisition
This paper studies the synthesis of a joint control and active perception policy for a stochastic system modeled as a partially observable Markov decision process (POMDP), subject to temporal logic specifications. The PO…
Active Bayesian Inference for Robust Control under Sensor False Data Injection Attacks
We present a framework for bridging the gap between sensor attack detection and recovery in cyber-physical systems. The proposed framework models modern-day, complex perception pipelines as bipartite graphs, which combin…
Bayesian InferenceGEC: A Unified Framework for Interactive Decision Making in MDP, POMDP, and Beyond
We study sample efficient reinforcement learning (RL) under the general framework of interactive decision making, which includes Markov decision process (MDP), partially observable Markov decision process (POMDP), and pr…
Decision MakingReinforcement Learning (RL)Mobile Target Search with Imperfect Perception: A Partially Observable Stochastic Game Theoretical Approach
This paper investigates mobile target search under imperfect perceptions caused by sensor limitations, malicious jamming, or communication noise. Searchers and targets operate in a grid-shaped area with bounded mobility,…