paper-with-me

홈 › Papers

RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptions

2023-10-23 · NeurIPS 2023 11 · Lingdong Kong, Shaoyuan Xie, Hanjiang Hu, Lai Xing Ng, Benoit R. Cottereau, Wei Tsang Ooi

Depth estimation from monocular images is pivotal for real-world visual perception systems. While current learning-based depth estimation models train and test on meticulously curated data, they often overlook out-of-distribution (OoD) situations. Yet, in practical settings -- especially safety-critical ones like autonomous driving -- common corruptions can arise. Addressing this oversight, we introduce a comprehensive robustness test suite, RoboDepth, encompassing 18 corruptions spanning three categories: i) weather and lighting conditions; ii) sensor failures and movement; and iii) data processing anomalies. We subsequently benchmark 42 depth estimation models across indoor and outdoor scenes to assess their resilience to these corruptions. Our findings underscore that, in the absence of a dedicated robustness evaluation framework, many leading depth estimation models may be susceptible to typical corruptions. We delve into design considerations for crafting more robust depth estimation models, touching upon pre-training, augmentation, modality, model capacity, and learning paradigms. We anticipate our benchmark will establish a foundational platform for advancing robust OoD depth estimation.

📄 PDF Abstract BibTeX arXiv:2310.15171

Code (1)

ldkong1205/robodepth 공식 구현 pytorch

Tasks

Autonomous DrivingDepth Estimation

Similar Papers 제목 키워드 기반

The RoboDepth Challenge: Methods and Advancements Towards Robust Depth Estimation

2023-07-27 · Lingdong Kong, Yaru Niu, Shaoyuan Xie, Hanjiang Hu 외

Accurate depth estimation under out-of-distribution (OoD) scenarios, such as adverse weather conditions, sensor failure, and noise contamination, is desirable for safety-critical applications. Existing depth estimation s…

Depth EstimationImage RestorationSuper-Resolution

DINO-SD: Champion Solution for ICRA 2024 RoboDepth Challenge

2024-05-27 · Yifan Mao, Ming Li, Jian Liu, Jiayang Liu 외

Surround-view depth estimation is a crucial task aims to acquire the depth maps of the surrounding views. It has many applications in real world scenarios such as autonomous driving, AR/VR and 3D reconstruction, etc. How…

3D ReconstructionAutonomous DrivingDepth Estimation

On Robust Mean Estimation under Coordinate-level Corruption

2020-02-10 · Zifan Liu, Jongho Park, Theodoros Rekatsinas, Christos Tzamos

We study the problem of robust mean estimation and introduce a novel Hamming distance-based measure of distribution shift for coordinate-level corruptions. We show that this measure yields adversary models that capture m…

Matrix Completion

Image Masking for Robust Self-Supervised Monocular Depth Estimation

2022-10-05 · Hemang Chawla, Kishaan Jeeveswaran, Elahe Arani, Bahram Zonooz

Self-supervised monocular depth estimation is a salient task for 3D scene understanding. Learned jointly with monocular ego-motion estimation, several methods have been proposed to predict accurate pixel-wise depth witho…

Autonomous DrivingDepth EstimationMonocular Depth EstimationMotion Estimation+1

Using Synthetic Corruptions to Measure Robustness to Natural Distribution Shifts

2021-07-26 · Alfred Laugros, Alice Caplier, Matthieu Ospici

Synthetic corruptions gathered into a benchmark are frequently used to measure neural network robustness to distribution shifts. However, robustness to synthetic corruption benchmarks is not always predictive of robustne…