paper-with-me

Papers

Adaptive Surface Normal Constraint for Geometric Estimation from Monocular Images

2024-02-08 · Xiaoxiao Long, Yuhang Zheng, Yupeng Zheng, Beiwen Tian, Cheng Lin, Lingjie Liu, Hao Zhao, Guyue Zhou, Wenping Wang

We introduce a novel approach to learn geometries such as depth and surface normal from images while incorporating geometric context. The difficulty of reliably capturing geometric context in existing methods impedes their ability to accurately enforce the consistency between the different geometric properties, thereby leading to a bottleneck of geometric estimation quality. We therefore propose the Adaptive Surface Normal (ASN) constraint, a simple yet efficient method. Our approach extracts geometric context that encodes the geometric variations present in the input image and correlates depth estimation with geometric constraints. By dynamically determining reliable local geometry from randomly sampled candidates, we establish a surface normal constraint, where the validity of these candidates is evaluated using the geometric context. Furthermore, our normal estimation leverages the geometric context to prioritize regions that exhibit significant geometric variations, which makes the predicted normals accurately capture intricate and detailed geometric information. Through the integration of geometric context, our method unifies depth and surface normal estimations within a cohesive framework, which enables the generation of high-quality 3D geometry from images. We validate the superiority of our approach over state-of-the-art methods through extensive evaluations and comparisons on diverse indoor and outdoor datasets, showcasing its efficiency and robustness.

📄 PDF Abstract BibTeX arXiv:2402.05869

Code (0)

등록된 구현이 없습니다.

Tasks

3D geometryDepth Estimation

Similar Papers 제목 키워드 기반

Adaptive Surface Normal Constraint for Depth Estimation

2021-03-29 · ICCV 2021 10 · Xiaoxiao Long, Cheng Lin, Lingjie Liu, Wei Li 외

We present a novel method for single image depth estimation using surface normal constraints. Existing depth estimation methods either suffer from the lack of geometric constraints, or are limited to the difficulty of re…

3D geometryDepth Estimation

GeoNet: Geometric Neural Network for Joint Depth and Surface Normal Estimation

2018-06-01 · CVPR 2018 6 · Xiaojuan Qi, Renjie Liao, Zhengzhe Liu, Raquel Urtasun 외

In this paper, we propose Geometric Neural Network (GeoNet) to jointly predict depth and surface normal maps from a single image. Building on top of two-stream CNNs, our GeoNet incorporates geometric relation between dep…

Depth EstimationSurface Normal Estimation

GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimation

2020-12-13 · Xiaojuan Qi, Zhengzhe Liu, Renjie Liao, Philip H. S. Torr 외

In this paper, we propose a geometric neural network with edge-aware refinement (GeoNet++) to jointly predict both depth and surface normal maps from a single image. Building on top of two-stream CNNs, GeoNet++ captures …

3D ReconstructionDepth EstimationDepth PredictionSurface Normal Estimation

D2NT: A High-Performing Depth-to-Normal Translator

2023-04-24 · Yi Feng, Bohuan Xue, Ming Liu, Qijun Chen 외

Surface normal holds significant importance in visual environmental perception, serving as a source of rich geometric information. However, the state-of-the-art (SoTA) surface normal estimators (SNEs) generally suffer fr…

Surface Normal EstimationVocal Bursts Intensity Prediction

MambaH-Fit: Rethinking Hyper-surface Fitting-based Point Cloud Normal Estimation via State Space Modelling

2025-10-10 · Weijia Wang, Yuanzhi Su, Pei-Gen Ye, Yuan-Gen Wang arxiv

We present MambaH-Fit, a state space modelling framework tailored for hyper-surface fitting-based point cloud normal estimation. Existing normal estimation methods often fall short in modelling fine-grained geometric str…