paper-with-me

Papers

Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimization

2023-03-29 · Dongyu Yan, Jianheng Liu, Fengyu Quan, Haoyao Chen, Mengmeng Fu

Actively planning sensor views during object reconstruction is crucial for autonomous mobile robots. An effective method should be able to strike a balance between accuracy and efficiency. In this paper, we propose a seamless integration of the emerging implicit representation with the active reconstruction task. We build an implicit occupancy field as our geometry proxy. While training, the prior object bounding box is utilized as auxiliary information to generate clean and detailed reconstructions. To evaluate view uncertainty, we employ a sampling-based approach that directly extracts entropy from the reconstructed occupancy probability field as our measure of view information gain. This eliminates the need for additional uncertainty maps or learning. Unlike previous methods that compare view uncertainty within a finite set of candidates, we aim to find the next-best-view (NBV) on a continuous manifold. Leveraging the differentiability of the implicit representation, the NBV can be optimized directly by maximizing the view uncertainty using gradient descent. It significantly enhances the method's adaptability to different scenarios. Simulation and real-world experiments demonstrate that our approach effectively improves reconstruction accuracy and efficiency of view planning in active reconstruction tasks. The proposed system will open source at https://github.com/HITSZ-NRSL/ActiveImplicitRecon.git.

📄 PDF Abstract BibTeX arXiv:2303.16739

Code (1)

hitsz-nrsl/activeimplicitrecon 공식 구현 pytorch

Tasks

Object Reconstruction

Similar Papers 제목 키워드 기반

Uncertainty Guided Policy for Active Robotic 3D Reconstruction using Neural Radiance Fields

2022-09-17 · Soomin Lee, Le Chen, Jiahao Wang, Alexander Liniger 외

In this paper, we tackle the problem of active robotic 3D reconstruction of an object. In particular, we study how a mobile robot with an arm-held camera can select a favorable number of views to recover an object's 3D s…

3D geometry3D Reconstruction

Active Visuo-Haptic Object Shape Completion

2022-03-17 · Lukas Rustler, Jens Lundell, Jan Kristof Behrens, Ville Kyrki 외

Recent advancements in object shape completion have enabled impressive object reconstructions using only visual input. However, due to self-occlusion, the reconstructions have high uncertainty in the occluded object part…

Object

STAIR: Semantic-Targeted Active Implicit Reconstruction

2024-03-17 · Liren Jin, Haofei Kuang, Yue Pan, Cyrill Stachniss 외

Many autonomous robotic applications require object-level understanding when deployed. Actively reconstructing objects of interest, i.e. objects with specific semantic meanings, is therefore relevant for a robot to perfo…

Uncertainty-Driven Active Vision for Implicit Scene Reconstruction

2022-10-03 · Edward J. Smith, Michal Drozdzal, Derek Nowrouzezahrai, David Meger 외

Multi-view implicit scene reconstruction methods have become increasingly popular due to their ability to represent complex scene details. Recent efforts have been devoted to improving the representation of input informa…

Scene Understanding

Active Neural Mapping

2023-08-30 · ICCV 2023 1 · Zike Yan, Haoxiang Yang, Hongbin Zha

We address the problem of active mapping with a continually-learned neural scene representation, namely Active Neural Mapping. The key lies in actively finding the target space to be explored with efficient agent movemen…