Efficient Object-centric Representation Learning with Pre-trained Geometric Prior
This paper addresses key challenges in object-centric representation learning of video. While existing approaches struggle with complex scenes, we propose a novel weakly-supervised framework that emphasises geometric understanding and leverages pre-trained vision models to enhance object discovery. Our method introduces an efficient slot decoder specifically designed for object-centric learning, enabling effective representation of multi-object scenes without requiring explicit depth information. Results on synthetic video benchmarks with increasing complexity in terms of objects and their movement, object occlusion and camera motion demonstrate that our approach achieves comparable performance to supervised methods while maintaining computational efficiency. This advances the field towards more practical applications in complex real-world scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyDecoderObjectObject DiscoveryRepresentation LearningSimilar Papers 제목 키워드 기반
Towards Stable Self-Supervised Object Representations in Unconstrained Egocentric Video
Humans develop visual intelligence through perceiving and interacting with their environment - a self-supervised learning process grounded in egocentric experience. Inspired by this, we ask how can artificial systems lea…
Self-Supervised LearningSemantic SegmentationDynaVol: Unsupervised Learning for Dynamic Scenes through Object-Centric Voxelization
Unsupervised learning of object-centric representations in dynamic visual scenes is challenging. Unlike most previous approaches that learn to decompose 2D images, we present DynaVol, a 3D scene generative model that uni…
DecoderNeRFNeural RenderingNovel View Synthesis+3AlloSpatial: Agentic Harness Framework for Spatial Reasoning in Foundation Models
Multimodal Foundation Models (MFMs) have made substantial progress, yet remain fragile in spatial reasoning over the physical world. A key bottleneck lies in their inability to transform local egocentric observations int…
Reinforcement LearningSpatial ReasoningA Data-Centric Revisit of Pre-Trained Vision Models for Robot Learning
Pre-trained vision models (PVMs) are fundamental to modern robotics, yet their optimal configuration remains unclear. Through systematic evaluation, we find that while DINO and iBOT outperform MAE across visuomotor contr…
ObjectScene UnderstandingComposing Pre-Trained Object-Centric Representations for Robotics From "What" and "Where" Foundation Models
There have recently been large advances both in pre-training visual representations for robotic control and segmenting unknown category objects in general images. To leverage these for improved robot learning, we propose…
ObjectSystematic Generalization