paper-with-me

Papers

Object-Centric Learning with Slot Attention

2020-06-26 · NeurIPS 2020 12 · Francesco Locatello, Dirk Weissenborn, Thomas Unterthiner, Aravindh Mahendran, Georg Heigold, Jakob Uszkoreit, Alexey Dosovitskiy, Thomas Kipf

Learning object-centric representations of complex scenes is a promising step towards enabling efficient abstract reasoning from low-level perceptual features. Yet, most deep learning approaches learn distributed representations that do not capture the compositional properties of natural scenes. In this paper, we present the Slot Attention module, an architectural component that interfaces with perceptual representations such as the output of a convolutional neural network and produces a set of task-dependent abstract representations which we call slots. These slots are exchangeable and can bind to any object in the input by specializing through a competitive procedure over multiple rounds of attention. We empirically demonstrate that Slot Attention can extract object-centric representations that enable generalization to unseen compositions when trained on unsupervised object discovery and supervised property prediction tasks.

📄 PDF Abstract BibTeX arXiv:2006.15055

Code (8)

google-research/google-research/tree/master/slot_attention 공식 구현 tf
HHousen/object-discovery-pytorch pytorch
Michedev/slot-attention-pytorch pytorch
a-imamshah/savi-pytorch pytorch
a-imamshah/slotattention.jl tf
adityabingi/Slot-Attention pytorch
lucidrains/slot-attention pytorch
untitled-ai/slot_attention pytorch

Tasks

ObjectObject DiscoveryProperty Prediction

Methods 이 논문이 사용한 방법론

[fAq`s~PubliC]Do you get your money back if you cancel a cruise? 설명 없음
How do I escalate a complaint with Expedia?*EscalateFastService How do I escalate a complaint with Expedia? Call + 1 ≈ 888 ≈ 829 ≈ 0881 or + 1 || 888 || 829 || 0881 for Fast Resolution & Exclusive Travel Deals! Need to escalate a complaint…

Similar Papers 제목 키워드 기반

Slot-VAE: Object-Centric Scene Generation with Slot Attention

2023-06-12 · Yanbo Wang, Letao Liu, Justin Dauwels

Slot attention has shown remarkable object-centric representation learning performance in computer vision tasks without requiring any supervision. Despite its object-centric binding ability brought by compositional model…

ObjectRepresentation LearningScene Generation

GLASS: Guided Latent Slot Diffusion for Object-Centric Learning

2025-01-01 · CVPR 2025 1 · Krishnakant Singh, Simone Schaub-Meyer, Stefan Roth

Object-centric learning aims to decompose an input image into a set of meaningful object files (slots). These latent object representations enable a variety of downstream tasks. Yet, object-centric learning struggles…

Conditional Image GenerationImage GenerationObjectObject Discovery

Identifiable Object-Centric Representation Learning via Probabilistic Slot Attention

2024-06-11 · Avinash Kori, Francesco Locatello, Ainkaran Santhirasekaram, Francesca Toni 외

Learning modular object-centric representations is crucial for systematic generalization. Existing methods show promising object-binding capabilities empirically, but theoretical identifiability guarantees remain relativ…

ObjectRepresentation LearningSystematic Generalization

Unlocking Slot Attention by Changing Optimal Transport Costs

2023-01-30 · Yan Zhang, David W. Zhang, Simon Lacoste-Julien, Gertjan J. Burghouts 외

Slot attention is a powerful method for object-centric modeling in images and videos. However, its set-equivariance limits its ability to handle videos with a dynamic number of objects because it cannot break ties. To ov…

Object

Unsupervised Musical Object Discovery from Audio

2023-11-13 · Joonsu Gha, Vincent Herrmann, Benjamin Grewe, Jürgen Schmidhuber 외

Current object-centric learning models such as the popular SlotAttention architecture allow for unsupervised visual scene decomposition. Our novel MusicSlots method adapts SlotAttention to the audio domain, to achieve un…

ObjectObject DiscoveryProperty Prediction