Local Neural Descriptor Fields: Locally Conditioned Object Representations for Manipulation

2023-02-07 · Ethan Chun, Yilun Du, Anthony Simeonov, Tomas Lozano-Perez, Leslie Kaelbling

A robot operating in a household environment will see a wide range of unique and unfamiliar objects. While a system could train on many of these, it is infeasible to predict all the objects a robot will see. In this paper, we present a method to generalize object manipulation skills acquired from a limited number of demonstrations, to novel objects from unseen shape categories. Our approach, Local Neural Descriptor Fields (L-NDF), utilizes neural descriptors defined on the local geometry of the object to effectively transfer manipulation demonstrations to novel objects at test time. In doing so, we leverage the local geometry shared between objects to produce a more general manipulation framework. We illustrate the efficacy of our approach in manipulating novel objects in novel poses -- both in simulation and in the real world.

📄 PDF Abstract BibTeX arXiv:2302.03573

Code (0)

등록된 구현이 없습니다.

Tasks

Object

Methods 이 논문이 사용한 방법론

Test 설명 없음

Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimation

2016-07-20 · Wadim Kehl, Fausto Milletari, Federico Tombari, Slobodan Ilic 외

We present a 3D object detection method that uses regressed descriptors of locally-sampled RGB-D patches for 6D vote casting. For regression, we employ a convolutional auto-encoder that has been trained on a large collec…

3D Object Detection 6D Pose Estimation 6D Pose Estimation using RGB Object+4

Locally-Transferred Fisher Vectors for Texture Classification

2017-10-01 · ICCV 2017 10 · Yang Song, Fan Zhang, Qing Li, Heng Huang 외

Texture classification has been extensively studied in computer vision. Recent research shows that the combination of Fisher vector (FV) encoding and convolutional neural network (CNN) provides significant improvement in…

Classification General Classification image-classification Image Classification+1

Dual Advantage Fields

2026-06-02 · Alexey Zemtsov, Maxim Bobrin, Alexander Nikulin, Dmitry V. Dylov 외 arxiv

Offline goal-conditioned reinforcement learning requires both long-horizon reachability estimates and local action comparisons. Dual goal representations provide value fields that capture global goal reachability, but th…

Reinforcement Learning

GeoMix: Descriptor-Free Visual Localization via Global Context and Multi-Detector Training

2026-07-02 · Yejun Zhang, Xinjue Wang, Zihan Wang, Esa Rahtu 외 arxiv

Descriptor-free visual localization eliminates high-dimensional descriptor storage, preserves scene privacy, and simplifies map maintenance, yet its accuracy still lags far behind descriptor-based pipelines. We identify …

Visual Localization

Modeling 3D Surface Manifolds with a Locally Conditioned Atlas

2021-02-11 · Przemysław Spurek, Sebastian Winczowski, Maciej Zięba, Tomasz Trzciński 외

Recently proposed 3D object reconstruction methods represent a mesh with an atlas - a set of planar patches approximating the surface. However, their application in a real-world scenario is limited since the surfaces of …

3D Object Reconstruction Object Object Reconstruction