paper-with-me

홈 › Papers

Disentangled Object-Centric Image Representation for Robotic Manipulation

2025-03-14 · David Emukpere, Romain Deffayet, Bingbing Wu, Romain Brégier, Michael Niemaz, Jean-Luc Meunier, Denys Proux, Jean-Michel Renders, Seungsu Kim

Learning robotic manipulation skills from vision is a promising approach for developing robotics applications that can generalize broadly to real-world scenarios. As such, many approaches to enable this vision have been explored with fruitful results. Particularly, object-centric representation methods have been shown to provide better inductive biases for skill learning, leading to improved performance and generalization. Nonetheless, we show that object-centric methods can struggle to learn simple manipulation skills in multi-object environments. Thus, we propose DOCIR, an object-centric framework that introduces a disentangled representation for objects of interest, obstacles, and robot embodiment. We show that this approach leads to state-of-the-art performance for learning pick and place skills from visual inputs in multi-object environments and generalizes at test time to changing objects of interest and distractors in the scene. Furthermore, we show its efficacy both in simulation and zero-shot transfer to the real world.

📄 PDF Abstract BibTeX arXiv:2503.11565

Code (0)

등록된 구현이 없습니다.

Tasks

Object

Similar Papers 제목 키워드 기반

Relational Object-Centric Actor-Critic

2023-10-26 · Leonid Ugadiarov, Vitaliy Vorobyov, Aleksandr I. Panov

The advances in unsupervised object-centric representation learning have significantly improved its application to downstream tasks. Recent works highlight that disentangled object representations can aid policy learning…

Model-based Reinforcement LearningObjectreinforcement-learningReinforcement Learning+1

Learning Global Object-Centric Representations via Disentangled Slot Attention

2024-10-24 · Tonglin Chen, Yinxuan Huang, Zhimeng Shen, Jinghao Huang 외

Humans can discern scene-independent features of objects across various environments, allowing them to swiftly identify objects amidst changing factors such as lighting, perspective, size, and position and imagine the co…

ObjectPositionRepresentation LearningScene Generation

Learning Disentangled Representation in Object-Centric Models for Visual Dynamics Prediction via Transformers

2024-07-03 · Sanket Gandhi, Atul, Samanyu Mahajan, Vishal Sharma 외

Recent work has shown that object-centric representations can greatly help improve the accuracy of learning dynamics while also bringing interpretability. In this work, we take this idea one step further, ask the followi…

AttributeObject

Learning Interactive World Model for Object-Centric Reinforcement Learning

2025-11-04 · Fan Feng, Phillip Lippe, Sara Magliacane arxiv

Agents that understand objects and their interactions can learn policies that are more robust and transferable. However, most object-centric RL methods factor state by individual objects while leaving interactions implic…

Reinforcement Learning

3D-DLP: Self-Supervised 3D Object-Centric Scene Representation Learning

2026-06-17 · Ellina Zhang, Madhaven Iyengar, Amir Zadeh, Chuan Li 외 arxiv

We introduce 3D-DLP, a self-supervised object-centric representation learning model that decomposes scene-level RGB-D or voxel observations into a set of 3D latent particles. Building on the Deep Latent Particles (DLP) f…

Representation Learning