paper-with-me

홈 › Papers

Surface Normal Estimation with Transformers

2024-01-11 · Barry Shichen Hu, Siyun Liang, Johannes Paetzold, Huy H. Nguyen, Isao Echizen, Jiapeng Tang

We propose the use of a Transformer to accurately predict normals from point clouds with noise and density variations. Previous learning-based methods utilize PointNet variants to explicitly extract multi-scale features at different input scales, then focus on a surface fitting method by which local point cloud neighborhoods are fitted to a geometric surface approximated by either a polynomial function or a multi-layer perceptron (MLP). However, fitting surfaces to fixed-order polynomial functions can suffer from overfitting or underfitting, and learning MLP-represented hyper-surfaces requires pre-generated per-point weights. To avoid these limitations, we first unify the design choices in previous works and then propose a simplified Transformer-based model to extract richer and more robust geometric features for the surface normal estimation task. Through extensive experiments, we demonstrate that our Transformer-based method achieves state-of-the-art performance on both the synthetic shape dataset PCPNet, and the real-world indoor scene dataset SceneNN, exhibiting more noise-resilient behavior and significantly faster inference. Most importantly, we demonstrate that the sophisticated hand-designed modules in existing works are not necessary to excel at the task of surface normal estimation.

📄 PDF Abstract BibTeX arXiv:2401.05745

Code (0)

등록된 구현이 없습니다.

Tasks

Surface Normal Estimation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

PanoNormal: Monocular Indoor 360° Surface Normal Estimation

2024-05-29 · Kun Huang, FangLue Zhang, Neil Dodgson

The presence of spherical distortion on the Equirectangular image is an acknowledged challenge in dense regression computer vision tasks, such as surface normal estimation. Recent advances in convolutional neural network…

Surface Normal Estimation

PolyMaX: General Dense Prediction with Mask Transformer

2023-11-09 · Xuan Yang, Liangzhe Yuan, Kimberly Wilber, Astuti Sharma 외

Dense prediction tasks, such as semantic segmentation, depth estimation, and surface normal prediction, can be easily formulated as per-pixel classification (discrete outputs) or regression (continuous outputs). This per…

Depth EstimationMonocular Depth EstimationPredictionSemantic Segmentation+2

GeoNet: Geometric Neural Network for Joint Depth and Surface Normal Estimation

2018-06-01 · CVPR 2018 6 · Xiaojuan Qi, Renjie Liao, Zhengzhe Liu, Raquel Urtasun 외

In this paper, we propose Geometric Neural Network (GeoNet) to jointly predict depth and surface normal maps from a single image. Building on top of two-stream CNNs, our GeoNet incorporates geometric relation between dep…

Depth EstimationSurface Normal Estimation

Fast, Accurate and Object Boundary-Aware Surface Normal Estimation from Depth Maps

2022-09-17 · Saed Moradi, Alireza Memarmoghadam, Denis Laurendeau

This paper proposes a fast and accurate surface normal estimation method which can be directly used on depth maps (organized point clouds). The surface normal estimation process is formulated as a closed-form expression.…

Surface Normal Estimation

Rethinking the Approximation Error in 3D Surface Fitting for Point Cloud Normal Estimation

2023-03-30 · CVPR 2023 1 · Hang Du, Xuejun Yan, Jingjing Wang, Di Xie 외

Most existing approaches for point cloud normal estimation aim to locally fit a geometric surface and calculate the normal from the fitted surface. Recently, learning-based methods have adopted a routine of predicting po…