paper-with-me

홈 › Papers

GridFormer: Point-Grid Transformer for Surface Reconstruction

2024-01-04 · Shengtao Li, Ge Gao, Yudong Liu, Yu-Shen Liu, Ming Gu

Implicit neural networks have emerged as a crucial technology in 3D surface reconstruction. To reconstruct continuous surfaces from discrete point clouds, encoding the input points into regular grid features (plane or volume) has been commonly employed in existing approaches. However, these methods typically use the grid as an index for uniformly scattering point features. Compared with the irregular point features, the regular grid features may sacrifice some reconstruction details but improve efficiency. To take full advantage of these two types of features, we introduce a novel and high-efficiency attention mechanism between the grid and point features named Point-Grid Transformer (GridFormer). This mechanism treats the grid as a transfer point connecting the space and point cloud. Our method maximizes the spatial expressiveness of grid features and maintains computational efficiency. Furthermore, optimizing predictions over the entire space could potentially result in blurred boundaries. To address this issue, we further propose a boundary optimization strategy incorporating margin binary cross-entropy loss and boundary sampling. This approach enables us to achieve a more precise representation of the object structure. Our experiments validate that our method is effective and outperforms the state-of-the-art approaches under widely used benchmarks by producing more precise geometry reconstructions. The code is available at https://github.com/list17/GridFormer.

📄 PDF Abstract BibTeX arXiv:2401.02292

Code (1)

list17/gridformer 공식 구현 pytorch

Tasks

Computational EfficiencySurface Reconstruction

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions

2023-05-29 · Tao Wang, Kaihao Zhang, Ziqian Shao, Wenhan Luo 외

Image restoration in adverse weather conditions is a difficult task in computer vision. In this paper, we propose a novel transformer-based framework called GridFormer which serves as a backbone for image restoration und…

Image RestorationRain Removal

GridFormer: Towards Accurate Table Structure Recognition via Grid Prediction

2023-09-26 · Pengyuan Lyu, Weihong Ma, Hongyi Wang, Yuechen Yu 외

All tables can be represented as grids. Based on this observation, we propose GridFormer, a novel approach for interpreting unconstrained table structures by predicting the vertex and edge of a grid. First, we propose a …

Prediction

TransformerFusion: Monocular RGB Scene Reconstruction using Transformers

2021-07-05 · NeurIPS 2021 12 · Aljaž Božič, Pablo Palafox, Justus Thies, Angela Dai 외

We introduce TransformerFusion, a transformer-based 3D scene reconstruction approach. From an input monocular RGB video, the video frames are processed by a transformer network that fuses the observations into a volumetr…

3D Reconstruction3D Scene ReconstructionDepth EstimationStereo Depth Estimation+1

GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Clouds

2023-08-25 · ICCV 2023 1 · Chao Chen, Yu-Shen Liu, Zhizhong Han

Learning implicit representations has been a widely used solution for surface reconstruction from 3D point clouds. The latest methods infer a distance or occupancy field by overfitting a neural network on a single point …

Surface Reconstruction

From Point Clouds to Mesh Using Regression

2017-10-01 · ICCV 2017 10 · Lubor Ladicky, Olivier Saurer, SoHyeon Jeong, Fabio Maninchedda 외

Surface reconstruction from a point cloud is a standard subproblem in many algorithms for dense 3D reconstruction from RGB images or depth maps. Methods, performing only local operations in the vicinity of individual poi…

3D Reconstructionglobal-optimizationGPUregression+1