paper-with-me

홈 › Papers

Learning Global Object-Centric Representations via Disentangled Slot Attention

2024-10-24 · Tonglin Chen, Yinxuan Huang, Zhimeng Shen, Jinghao Huang, Bin Li, xiangyang xue

Humans can discern scene-independent features of objects across various environments, allowing them to swiftly identify objects amidst changing factors such as lighting, perspective, size, and position and imagine the complete images of the same object in diverse settings. Existing object-centric learning methods only extract scene-dependent object-centric representations, lacking the ability to identify the same object across scenes as humans. Moreover, some existing methods discard the individual object generation capabilities to handle complex scenes. This paper introduces a novel object-centric learning method to empower AI systems with human-like capabilities to identify objects across scenes and generate diverse scenes containing specific objects by learning a set of global object-centric representations. To learn the global object-centric representations that encapsulate globally invariant attributes of objects (i.e., the complete appearance and shape), this paper designs a Disentangled Slot Attention module to convert the scene features into scene-dependent attributes (such as scale, position and orientation) and scene-independent representations (i.e., appearance and shape). Experimental results substantiate the efficacy of the proposed method, demonstrating remarkable proficiency in global object-centric representation learning, object identification, scene generation with specific objects and scene decomposition.

📄 PDF Abstract BibTeX arXiv:2410.18809

Code (0)

등록된 구현이 없습니다.

Tasks

ObjectPositionRepresentation LearningScene Generation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Slot-VAE: Object-Centric Scene Generation with Slot Attention

2023-06-12 · Yanbo Wang, Letao Liu, Justin Dauwels

Slot attention has shown remarkable object-centric representation learning performance in computer vision tasks without requiring any supervision. Despite its object-centric binding ability brought by compositional model…

ObjectRepresentation LearningScene Generation

Learning Object-Centric Representations Based on Slots in Real World Scenarios

2025-09-29 · Adil Kaan Akan arxiv

A central goal in AI is to represent scenes as compositions of discrete objects, enabling fine-grained, controllable image and video generation. Yet leading diffusion models treat images holistically and rely on text con…

Unsupervised Video Object SegmentationVideo GenerationImage Generation

Learning Disentangled Representation in Object-Centric Models for Visual Dynamics Prediction via Transformers

2024-07-03 · Sanket Gandhi, Atul, Samanyu Mahajan, Vishal Sharma 외

Recent work has shown that object-centric representations can greatly help improve the accuracy of learning dynamics while also bringing interpretability. In this work, we take this idea one step further, ask the followi…

AttributeObject

Object-Aware DINO (Oh-A-Dino): Enhancing Self-Supervised Representations for Multi-Object Instance Retrieval

2025-03-12 · Stefan Sylvius Wagner, Stefan Harmeling

Object-centric learning is fundamental to human vision and crucial for models requiring complex reasoning. Traditional approaches rely on slot-based bottlenecks to learn object properties explicitly, while recent self-su…

ObjectRetrievalScene Understanding

Explicitly Disentangled Representations in Object-Centric Learning

2024-01-18 · Riccardo Majellaro, Jonathan Collu, Aske Plaat, Thomas M. Moerland

Extracting structured representations from raw visual data is an important and long-standing challenge in machine learning. Recently, techniques for unsupervised learning of object-centric representations have raised gro…

DisentanglementObject