paper-with-me

홈 › Papers

Object-Centric Learning with Slot Mixture Module

2023-11-08 · Daniil Kirilenko, Vitaliy Vorobyov, Alexey K. Kovalev, Aleksandr I. Panov

Object-centric architectures usually apply a differentiable module to the entire feature map to decompose it into sets of entity representations called slots. Some of these methods structurally resemble clustering algorithms, where the cluster's center in latent space serves as a slot representation. Slot Attention is an example of such a method, acting as a learnable analog of the soft k-means algorithm. Our work employs a learnable clustering method based on the Gaussian Mixture Model. Unlike other approaches, we represent slots not only as centers of clusters but also incorporate information about the distance between clusters and assigned vectors, leading to more expressive slot representations. Our experiments demonstrate that using this approach instead of Slot Attention improves performance in object-centric scenarios, achieving state-of-the-art results in the set property prediction task.

📄 PDF Abstract BibTeX arXiv:2311.04640

Code (1)

airi-institute/smm 공식 구현 pytorch

Tasks

ClusteringObjectProperty Prediction

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Identifiable Object-Centric Representation Learning via Probabilistic Slot Attention

2024-06-11 · Avinash Kori, Francesco Locatello, Ainkaran Santhirasekaram, Francesca Toni 외

Learning modular object-centric representations is crucial for systematic generalization. Existing methods show promising object-binding capabilities empirically, but theoretical identifiability guarantees remain relativ…

ObjectRepresentation LearningSystematic Generalization

Slot-VAE: Object-Centric Scene Generation with Slot Attention

2023-06-12 · Yanbo Wang, Letao Liu, Justin Dauwels

Slot attention has shown remarkable object-centric representation learning performance in computer vision tasks without requiring any supervision. Despite its object-centric binding ability brought by compositional model…

ObjectRepresentation LearningScene Generation

Reasoning-Enhanced Object-Centric Learning for Videos

2024-03-22 · Jian Li, Pu Ren, Yang Liu, Hao Sun

Object-centric learning aims to break down complex visual scenes into more manageable object representations, enhancing the understanding and reasoning abilities of machine learning systems toward the physical world. Rec…

ObjectObject Tracking

Illiterate DALL-E Learns to Compose

2021-10-17 · Gautam Singh, Fei Deng, Sungjin Ahn

Although DALL-E has shown an impressive ability of composition-based systematic generalization in image generation, it requires the dataset of text-image pairs and the compositionality is provided by the text. In contras…

DecoderImage GenerationObjectSystematic Generalization

GLASS: Guided Latent Slot Diffusion for Object-Centric Learning

2025-01-01 · CVPR 2025 1 · Krishnakant Singh, Simone Schaub-Meyer, Stefan Roth

Object-centric learning aims to decompose an input image into a set of meaningful object files (slots). These latent object representations enable a variety of downstream tasks. Yet, object-centric learning struggles…

Conditional Image GenerationImage GenerationObjectObject Discovery