paper-with-me

Papers

Learning Interactive World Model for Object-Centric Reinforcement Learning

2025-11-04 · Fan Feng, Phillip Lippe, Sara Magliacane arxiv

Agents that understand objects and their interactions can learn policies that are more robust and transferable. However, most object-centric RL methods factor state by individual objects while leaving interactions implicit. We introduce the Factored Interactive Object-Centric World Model (FIOC-WM), a unified framework that learns structured representations of both objects and their interactions within a world model. FIOC-WM captures environment dynamics with disentangled and modular representations of object interactions, improving sample efficiency and generalization for policy learning. Concretely, FIOC-WM first learns object-centric latents and an interaction structure directly from pixels, leveraging pre-trained vision encoders. The learned world model then decomposes tasks into composable interaction primitives, and a hierarchical policy is trained on top: a high level selects the type and order of interactions, while a low level executes them. On simulated robotic and embodied-AI benchmarks, FIOC-WM improves policy-learning sample efficiency and generalization over world-model baselines, indicating that explicit, modular interaction learning is crucial for robust control.

📄 PDF Abstract BibTeX arXiv:2511.02225

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Object-Centric World Models Meet Monte Carlo Tree Search

2026-01-10 · Rodion Vakhitov, Leonid Ugadiarov, Aleksandr Panov arxiv

In this paper, we introduce ObjectZero, a novel reinforcement learning (RL) algorithm that leverages the power of object-level representations to model dynamic environments more effectively. Unlike traditional approaches…

Reinforcement Learning

EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templates

2026-04-13 · Weikun Peng, Denys Iliash, Manolis Savva arxiv

We present EgoFun3D, a coordinated task formulation, dataset, and benchmark for modeling interactive 3D objects from egocentric videos. Interactive objects are of high interest for embodied AI but scarce, making modeling…

Structured World Belief for Reinforcement Learning in POMDP

2021-07-19 · Gautam Singh, Skand Peri, Junghyun Kim, Hyunseok Kim 외

Object-centric world models provide structured representation of the scene and can be an important backbone in reinforcement learning and planning. However, existing approaches suffer in partially-observable environments…

Inductive BiasObjectObject Trackingreinforcement-learning+2

Relational Object-Centric Actor-Critic

2023-10-26 · Leonid Ugadiarov, Vitaliy Vorobyov, Aleksandr I. Panov

The advances in unsupervised object-centric representation learning have significantly improved its application to downstream tasks. Recent works highlight that disentangled object representations can aid policy learning…

Model-based Reinforcement LearningObjectreinforcement-learningReinforcement Learning+1

Interactive Imitation Learning for Dexterous Robotic Manipulation: Challenges and Perspectives -- A Survey

2025-05-30 · Edgar Welte, Rania Rayyes

Dexterous manipulation is a crucial yet highly complex challenge in humanoid robotics, demanding precise, adaptable, and sample-efficient learning methods. As humanoid robots are usually designed to operate in human-cent…

Imitation Learning