paper-with-me

Papers

Spatially Invariant Unsupervised 3D Object-Centric Learning and Scene Decomposition

2021-06-10 · Tianyu Wang, Miaomiao Liu, Kee Siong Ng

We tackle the problem of object-centric learning on point clouds, which is crucial for high-level relational reasoning and scalable machine intelligence. In particular, we introduce a framework, SPAIR3D, to factorize a 3D point cloud into a spatial mixture model where each component corresponds to one object. To model the spatial mixture model on point clouds, we derive the Chamfer Mixture Loss, which fits naturally into our variational training pipeline. Moreover, we adopt an object-specification scheme that describes each object's location relative to its local voxel grid cell. Such a scheme allows SPAIR3D to model scenes with an arbitrary number of objects. We evaluate our method on the task of unsupervised scene decomposition. Experimental results demonstrate that SPAIR3D has strong scalability and is capable of detecting and segmenting an unknown number of objects from a point cloud in an unsupervised manner.

📄 PDF Abstract BibTeX arXiv:2106.05607

Code (0)

등록된 구현이 없습니다.

Tasks

ObjectRelational ReasoningSemantic Segmentation

Similar Papers 제목 키워드 기반

Variational Inference for Scalable 3D Object-centric Learning

2023-09-25 · Tianyu Wang, Kee Siong Ng, Miaomiao Liu

We tackle the task of scalable unsupervised object-centric representation learning on 3D scenes. Existing approaches to object-centric representation learning show limitations in generalizing to larger scenes as their le…

NeRFObjectRepresentation LearningVariational Inference

SIMONe: View-Invariant, Temporally-Abstracted Object Representations via Unsupervised Video Decomposition

2021-06-07 · NeurIPS 2021 12 · Rishabh Kabra, Daniel Zoran, Goker Erdogan, Loic Matthey 외

To help agents reason about scenes in terms of their building blocks, we wish to extract the compositional structure of any given scene (in particular, the configuration and characteristics of objects comprising the scen…

Instance SegmentationObjectSemantic Segmentation

Exploiting Spatial Invariance for Scalable Unsupervised Object Tracking

2019-11-20 · Eric Crawford, Joelle Pineau

The ability to detect and track objects in the visual world is a crucial skill for any intelligent agent, as it is a necessary precursor to any object-level reasoning process. Moreover, it is important that agents learn …

ObjectObject Tracking

Spatially Prompted Visual Trajectory Prediction for Egocentric Manipulation

2026-05-19 · Yifan Li, Xinyu Zhou, Yunhao Ge, Yu Kong arxiv

Robotic manipulation is often specified through language instructions or task identifiers, yet cluttered environments with similar objects are better handled by spatially indicating what to move and where to place it. Ad…

Trajectory Prediction

Unsupervised Discovery of Object-Centric Neural Fields

2024-02-12 · Rundong Luo, Hong-Xing Yu, Jiajun Wu

We study inferring 3D object-centric scene representations from a single image. While recent methods have shown potential in unsupervised 3D object discovery from simple synthetic images, they fail to generalize to real-…

ObjectObject DiscoverySemantic SegmentationSystematic Generalization+1