paper-with-me

Papers

Learning Object-Centric Representation via Reverse Hierarchy Guidance

2024-05-17 · Junhong Zou, Xiangyu Zhu, Zhaoxiang Zhang, Zhen Lei

Object-Centric Learning (OCL) seeks to enable Neural Networks to identify individual objects in visual scenes, which is crucial for interpretable visual comprehension and reasoning. Most existing OCL models adopt auto-encoding structures and learn to decompose visual scenes through specially designed inductive bias, which causes the model to miss small objects during reconstruction. Reverse hierarchy theory proposes that human vision corrects perception errors through a top-down visual pathway that returns to bottom-level neurons and acquires more detailed information, inspired by which we propose Reverse Hierarchy Guided Network (RHGNet) that introduces a top-down pathway that works in different ways in the training and inference processes. This pathway allows for guiding bottom-level features with top-level object representations during training, as well as encompassing information from bottom-level features into perception during inference. Our model achieves SOTA performance on several commonly used datasets including CLEVR, CLEVRTex and MOVi-C. We demonstrate with experiments that our method promotes the discovery of small objects and also generalizes well on complex real-world scenes. Code will be available at https://anonymous.4open.science/r/RHGNet-6CEF.

📄 PDF Abstract BibTeX arXiv:2405.10598

Code (0)

등록된 구현이 없습니다.

Tasks

Inductive BiasObject

Similar Papers 제목 키워드 기반

Object-Centric Image to Video Generation with Language Guidance

2025-02-17 · Angel Villar-Corrales, Gjergj Plepi, Sven Behnke

Accurate and flexible world models are crucial for autonomous systems to understand their environment and predict future events. Object-centric models, with structured latent spaces, have shown promise in modeling object…

Image to Video GenerationObjectVideo Generation

Learning Fine-grained View-Invariant Representations from Unpaired Ego-Exo Videos via Temporal Alignment

2023-06-08 · NeurIPS 2023 11

The egocentric and exocentric viewpoints of a human activity look dramatically different, yet invariant representations to link them are essential for many potential applications in robotics and augmented reality. Prior …

Video Understanding

Slot-guided Volumetric Object Radiance Fields

2024-01-04 · NeurIPS 2023 11 · Di Qi, Tong Yang, Xiangyu Zhang

We present a novel framework for 3D object-centric representation learning. Our approach effectively decomposes complex scenes into individual objects from a single image in an unsupervised fashion. This method, called s…

ObjectRepresentation Learning

Evaluating Disentanglement of Structured Representations

2021-01-11 · Raphaël Dang-Nhu

We introduce the first metric for evaluating disentanglement at individual hierarchy levels of a structured latent representation. Applied to object-centric generative models, this offers a systematic, unified approach t…

DisentanglementObject

Generating Scenes with Latent Object Models

2021-09-29 · Patrick Emami, Pan He, Sanjay Ranka, Anand Rangarajan

We introduce a structured latent variable model that learns the underlying data-generating process for a dataset of scenes. Our goals are to obtain a compositional scene representation and to perform scene generation by …

ObjectRe-RankingRetrievalScene Generation+1