paper-with-me

홈 › Papers

Temporally Consistent Object-Centric Learning by Contrasting Slots

2024-12-18 · CVPR 2025 1 · Anna Manasyan, Maximilian Seitzer, Filip Radovic, Georg Martius, Andrii Zadaianchuk

Unsupervised object-centric learning from videos is a promising approach to extract structured representations from large, unlabeled collections of videos. To support downstream tasks like autonomous control, these representations must be both compositional and temporally consistent. Existing approaches based on recurrent processing often lack long-term stability across frames because their training objective does not enforce temporal consistency. In this work, we introduce a novel object-level temporal contrastive loss for video object-centric models that explicitly promotes temporal consistency. Our method significantly improves the temporal consistency of the learned object-centric representations, yielding more reliable video decompositions that facilitate challenging downstream tasks such as unsupervised object dynamics prediction. Furthermore, the inductive bias added by our loss strongly improves object discovery, leading to state-of-the-art results on both synthetic and real-world datasets, outperforming even weakly-supervised methods that leverage motion masks as additional cues.

📄 PDF Abstract BibTeX arXiv:2412.14295

Code (0)

등록된 구현이 없습니다.

Tasks

Inductive BiasObjectObject Discovery

Similar Papers 제목 키워드 기반

Learning Object-Centric Video Models by Contrasting Sets

2020-11-20 · Sindy Löwe, Klaus Greff, Rico Jonschkowski, Alexey Dosovitskiy 외

Contrastive, self-supervised learning of object representations recently emerged as an attractive alternative to reconstruction-based training. Prior approaches focus on contrasting individual object representations (slo…

Future predictionObjectSelf-Supervised Learning

Reconstruction-Guided Slot Curriculum: Addressing Object Over-Fragmentation in Video Object-Centric Learning

2026-03-24 · WonJun Moon, Hyun Seok Seong, Jae-Pil Heo arxiv

Video Object-Centric Learning seeks to decompose raw videos into a small set of object slots, but existing slot-attention models often suffer from severe over-fragmentation. This is because the model is implicitly encour…

Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspective

2025-11-14 · Nhat Chung, Taisei Hanyu, Toan Nguyen, Huy Le 외 arxiv

As embodied agents operate in increasingly complex environments, the ability to perceive, track, and reason about individual object instances over time becomes essential, especially in tasks requiring sequenced interacti…

Object Tracking

Self-supervised Object-Centric Learning for Videos

2023-10-10 · NeurIPS 2023 11

Unsupervised multi-object segmentation has shown impressive results on images by utilizing powerful semantics learned from self-supervised pretraining. An additional modality such as depth or motion is often used to faci…

ObjectSemantic Segmentation

Compositional Video Synthesis by Temporal Object-Centric Learning

2025-07-28 · Adil Kaan Akan, Yucel Yemez arxiv

We present a novel framework for compositional video synthesis that leverages temporally consistent object-centric representations, extending our previous work, SlotAdapt, from images to video. While existing object-cent…

Scene UnderstandingVideo Generation