paper-with-me

홈 › Papers

Joint Depth and Normal Estimation from Real-world Time-of-flight Raw Data

2021-08-08 · Rongrong Gao, Na Fan, Changlin Li, Wentao Liu, Qifeng Chen

We present a novel approach to joint depth and normal estimation for time-of-flight (ToF) sensors. Our model learns to predict the high-quality depth and normal maps jointly from ToF raw sensor data. To achieve this, we meticulously constructed the first large-scale dataset (named ToF-100) with paired raw ToF data and ground-truth high-resolution depth maps provided by an industrial depth camera. In addition, we also design a simple but effective framework for joint depth and normal estimation, applying a robust Chamfer loss via jittering to improve the performance of our model. Our experiments demonstrate that our proposed method can efficiently reconstruct high-resolution depth and normal maps and significantly outperforms state-of-the-art approaches. Our code and data will be available at \url{https://github.com/hkustVisionRr/JointlyDepthNormalEstimation}

📄 PDF Abstract BibTeX arXiv:2108.03649

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimation

2024-03-22 · Under review for Transaction 2024 4 · Mu Hu, Wei Yin, Chi Zhang, Zhipeng Cai 외

We introduce Metric3D v2, a geometric foundation model for zero-shot metric depth and surface normal estimation from a single image, which is crucial for metric 3D recovery. While depth and normal are geometrically relat…

Depth EstimationSurface Normal EstimationZero-shot Generalization

GeoNet: Geometric Neural Network for Joint Depth and Surface Normal Estimation

2018-06-01 · CVPR 2018 6 · Xiaojuan Qi, Renjie Liao, Zhengzhe Liu, Raquel Urtasun 외

In this paper, we propose Geometric Neural Network (GeoNet) to jointly predict depth and surface normal maps from a single image. Building on top of two-stream CNNs, our GeoNet incorporates geometric relation between dep…

Depth EstimationSurface Normal Estimation

GroundNet: Monocular Ground Plane Normal Estimation with Geometric Consistency

2018-11-17 · Yunze Man, Xinshuo Weng, Xi Li, Kris Kitani

We focus on estimating the 3D orientation of the ground plane from a single image. We formulate the problem as an inter-mingled multi-task prediction problem by jointly optimizing for pixel-wise surface normal direction,…

Line DetectionSegmentationSemantic Segmentation

Direction matters: hand pose estimation from local surface normals

2016-04-10 · Chengde Wan, Angela Yao, Luc van Gool

We present a hierarchical regression framework for estimating hand joint positions from single depth images based on local surface normals. The hierarchical regression follows the tree structured topology of hand from wr…

Hand Pose EstimationPose Estimationregression

Cross-Domain Synthetic-to-Real In-the-Wild Depth and Normal Estimation for 3D Scene Understanding

2022-12-09 · Jay Bhanushali, Manivannan Muniyandi, PRANEETH CHAKRAVARTHULA

We present a cross-domain inference technique that learns from synthetic data to estimate depth and normals for in-the-wild omnidirectional 3D scenes encountered in real-world uncontrolled settings. To this end, we intro…

Autonomous DrivingDepth EstimationScene Understanding