Mixing-Denoising Generalizable Occupancy Networks
While current state-of-the-art generalizable implicit neural shape models rely on the inductive bias of convolutions, it is still not entirely clear how properties emerging from such biases are compatible with the task of 3D reconstruction from point cloud. We explore an alternative approach to generalizability in this context. We relax the intrinsic model bias (i.e. using MLPs to encode local features as opposed to convolutions) and constrain the hypothesis space instead with an auxiliary regularization related to the reconstruction task, i.e. denoising. The resulting model is the first only-MLP locally conditioned implicit shape reconstruction from point cloud network with fast feed forward inference. Point cloud borne features and denoising offsets are predicted from an exclusively MLP-made network in a single forward pass. A decoder predicts occupancy probabilities for queries anywhere in space by pooling nearby features from the point cloud order-invariantly, guided by denoised relative positional encoding. We outperform the state-of-the-art convolutional method while using half the number of model parameters.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionDecoderDenoisingInductive BiasSimilar Papers 제목 키워드 기반
GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learning
This paper presents a novel approach for sparse 3D reconstruction by leveraging the expressive power of Neural Radiance Fields (NeRFs) and fast transfer of their features to learn accurate occupancy fields. Existing 3D r…
3D ReconstructionNeRFSurface ReconstructionTransfer LearningTowards Learning a Generalizable 3D Scene Representation from 2D Observations
We introduce a Generalizable Neural Radiance Field approach for predicting 3D workspace occupancy from egocentric robot observations. Unlike prior methods operating in camera-centric coordinates, our model constructs occ…
OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Driving
Existing solutions for 3D semantic occupancy prediction typically treat the task as a one-shot 3D voxel-wise segmentation perception problem. These discriminative methods focus on learning the mapping between the inputs …
3D Semantic Occupancy PredictionAutonomous DrivingDenoisingOccFusion: Depth Estimation Free Multi-sensor Fusion for 3D Occupancy Prediction
3D occupancy prediction based on multi-sensor fusion,crucial for a reliable autonomous driving system, enables fine-grained understanding of 3D scenes. Previous fusion-based 3D occupancy predictions relied on depth estim…
Autonomous DrivingDecoderDepth EstimationPrediction+1Unmixing Diffusion for Self-Supervised Hyperspectral Image Denoising
Hyperspectral images (HSIs) have extensive applications in various fields such as medicine agriculture and industry. Nevertheless acquiring high signal-to-noise ratio HSI poses a challenge due to narrow-band spectral…
DenoisingHyperspectral Image DenoisingImage Denoising