paper-with-me

Papers

Explicitly Disentangled Representations in Object-Centric Learning

2024-01-18 · Riccardo Majellaro, Jonathan Collu, Aske Plaat, Thomas M. Moerland

Extracting structured representations from raw visual data is an important and long-standing challenge in machine learning. Recently, techniques for unsupervised learning of object-centric representations have raised growing interest. In this context, enhancing the robustness of the latent features can improve the efficiency and effectiveness of the training of downstream tasks. A promising step in this direction is to disentangle the factors that cause variation in the data. Previously, Invariant Slot Attention disentangled position, scale, and orientation from the remaining features. Extending this approach, we focus on separating the shape and texture components. In particular, we propose a novel architecture that biases object-centric models toward disentangling shape and texture components into two non-overlapping subsets of the latent space dimensions. These subsets are known a priori, hence before the training process. Experiments on a range of object-centric benchmarks reveal that our approach achieves the desired disentanglement while also numerically improving baseline performance in most cases. In addition, we show that our method can generate novel textures for a specific object or transfer textures between objects with distinct shapes.

📄 PDF Abstract BibTeX arXiv:2401.10148

Code (1)

riccardomajellaro/disentangled-slot-attention 공식 구현 pytorch

Tasks

DisentanglementObject

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

When Object-Centric World Models Meet Policy Learning: From Pixels to Policies, and Where It Breaks

2025-11-08 · Stefano Ferraro, Akihiro Nakano, Masahiro Suzuki, Yutaka Matsuo arxiv

Object-centric world models (OCWM) aim to decompose visual scenes into object-level representations, providing structured abstractions that could improve compositional generalization and data efficiency in reinforcement …

Reinforcement Learning

Learning Global Object-Centric Representations via Disentangled Slot Attention

2024-10-24 · Tonglin Chen, Yinxuan Huang, Zhimeng Shen, Jinghao Huang 외

Humans can discern scene-independent features of objects across various environments, allowing them to swiftly identify objects amidst changing factors such as lighting, perspective, size, and position and imagine the co…

ObjectPositionRepresentation LearningScene Generation

Learning Disentangled Representation in Object-Centric Models for Visual Dynamics Prediction via Transformers

2024-07-03 · Sanket Gandhi, Atul, Samanyu Mahajan, Vishal Sharma 외

Recent work has shown that object-centric representations can greatly help improve the accuracy of learning dynamics while also bringing interpretability. In this work, we take this idea one step further, ask the followi…

AttributeObject

Dynamic Scene Understanding through Object-Centric Voxelization and Neural Rendering

2024-07-30 · Yanpeng Zhao, Yiwei Hao, Siyu Gao, Yunbo Wang 외

Learning object-centric representations from unsupervised videos is challenging. Unlike most previous approaches that focus on decomposing 2D images, we present a 3D generative model named DynaVol-S for dynamic scenes th…

Inverse RenderingNeRFNeural RenderingNovel View Synthesis+3

Language-Mediated, Object-Centric Representation Learning

2020-12-31 · Findings (ACL) 2021 8 · Ruocheng Wang, Jiayuan Mao, Samuel J. Gershman, Jiajun Wu

We present Language-mediated, Object-centric Representation Learning (LORL), a paradigm for learning disentangled, object-centric scene representations from vision and language. LORL builds upon recent advances in unsupe…

ObjectObject DiscoveryReferring ExpressionReferring Expression Comprehension+3