paper-with-me

홈 › Papers

Learning Visual Planning Models from Partially Observed Images

2022-11-25 · Kebing Jin, Zhanhao Xiao, Hankui Hankz Zhuo, Hai Wan, Jiaran Cai

There has been increasing attention on planning model learning in classical planning. Most existing approaches, however, focus on learning planning models from structured data in symbolic representations. It is often difficult to obtain such structured data in real-world scenarios. Although a number of approaches have been developed for learning planning models from fully observed unstructured data (e.g., images), in many scenarios raw observations are often incomplete. In this paper, we provide a novel framework, \aType{Recplan}, for learning a transition model from partially observed raw image traces. More specifically, by considering the preceding and subsequent images in a trace, we learn the latent state representations of raw observations and then build a transition model based on such representations. Additionally, we propose a neural-network-based approach to learn a heuristic model that estimates the distance toward a given goal observation. Based on the learned transition model and heuristic model, we implement a classical planner for images. We exhibit empirically that our approach is more effective than a state-of-the-art approach of learning visual planning models in the environment with incomplete observations.

📄 PDF Abstract BibTeX arXiv:2211.15666

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Generative Temporal Models with Spatial Memory for Partially Observed Environments

2018-04-25 · ICML 2018 7 · Marco Fraccaro, Danilo Jimenez Rezende, Yori Zwols, Alexander Pritzel 외

In model-based reinforcement learning, generative and temporal models of environments can be leveraged to boost agent performance, either by tuning the agent's representations during training or via use as part of an exp…

Model-based Reinforcement LearningReinforcement Learning

POPCORN: Partially Observed Prediction COnstrained ReiNforcement Learning

2020-01-13 · Joseph Futoma, Michael C. Hughes, Finale Doshi-Velez

Many medical decision-making tasks can be framed as partially observed Markov decision processes (POMDPs). However, prevailing two-stage approaches that first learn a POMDP and then solve it often fail because the model …

Decision MakingPredictionreinforcement-learningReinforcement Learning+1

When is Particle Filtering Efficient for Planning in Partially Observed Linear Dynamical Systems?

2020-06-10 · Simon S. Du, Wei Hu, Zhiyuan Li, Ruoqi Shen 외

Particle filtering is a popular method for inferring latent states in stochastic dynamical systems, whose theoretical properties have been well studied in machine learning and statistics communities. In many control prob…

Decision MakingSequential Decision Making

CAR-DESPOT: Causally-Informed Online POMDP Planning for Robots in Confounded Environments

2023-04-13 · Ricardo Cannizzaro, Lars Kunze

Robots operating in real-world environments must reason about possible outcomes of stochastic actions and make decisions based on partial observations of the true world state. A major challenge for making accurate and ro…

Decision Making

A Meta-Bayesian Model of Intentional Visual Search

2020-06-05 · Maell Cullen, Jonathan Monney, M. Berk Mirza, Rosalyn Moran

We propose a computational model of visual search that incorporates Bayesian interpretations of the neural mechanisms that underlie categorical perception and saccade planning. To enable meaningful comparisons between si…

Decision Making