paper-with-me

홈 › Papers

The RoboDepth Challenge: Methods and Advancements Towards Robust Depth Estimation

2023-07-27 · Lingdong Kong, Yaru Niu, Shaoyuan Xie, Hanjiang Hu, Lai Xing Ng, Benoit R. Cottereau, Liangjun Zhang, Hesheng Wang, Wei Tsang Ooi, Ruijie Zhu, Ziyang Song, Li Liu, Tianzhu Zhang, Jun Yu, Mohan Jing, Pengwei Li, Xiaohua Qi, Cheng Jin, Yingfeng Chen, Jie Hou, Jie Zhang, Zhen Kan, Qiang Ling, Liang Peng, Minglei Li, Di Xu, Changpeng Yang, Yuanqi Yao, Gang Wu, Jian Kuai, Xianming Liu, Junjun Jiang, Jiamian Huang, Baojun Li, Jiale Chen, Shuang Zhang, Sun Ao, Zhenyu Li, Runze Chen, Haiyong Luo, Fang Zhao, Jingze Yu

Accurate depth estimation under out-of-distribution (OoD) scenarios, such as adverse weather conditions, sensor failure, and noise contamination, is desirable for safety-critical applications. Existing depth estimation systems, however, suffer inevitably from real-world corruptions and perturbations and are struggled to provide reliable depth predictions under such cases. In this paper, we summarize the winning solutions from the RoboDepth Challenge -- an academic competition designed to facilitate and advance robust OoD depth estimation. This challenge was developed based on the newly established KITTI-C and NYUDepth2-C benchmarks. We hosted two stand-alone tracks, with an emphasis on robust self-supervised and robust fully-supervised depth estimation, respectively. Out of more than two hundred participants, nine unique and top-performing solutions have appeared, with novel designs ranging from the following aspects: spatial- and frequency-domain augmentations, masked image modeling, image restoration and super-resolution, adversarial training, diffusion-based noise suppression, vision-language pre-training, learned model ensembling, and hierarchical feature enhancement. Extensive experimental analyses along with insightful observations are drawn to better understand the rationale behind each design. We hope this challenge could lay a solid foundation for future research on robust and reliable depth estimation and beyond. The datasets, competition toolkit, workshop recordings, and source code from the winning teams are publicly available on the challenge website.

📄 PDF Abstract BibTeX arXiv:2307.15061

Code (1)

ldkong1205/robodepth 공식 구현 pytorch

Tasks

Depth EstimationImage RestorationSuper-Resolution

Similar Papers 제목 키워드 기반

DINO-SD: Champion Solution for ICRA 2024 RoboDepth Challenge

2024-05-27 · Yifan Mao, Ming Li, Jian Liu, Jiayang Liu 외

Surround-view depth estimation is a crucial task aims to acquire the depth maps of the surrounding views. It has many applications in real world scenarios such as autonomous driving, AR/VR and 3D reconstruction, etc. How…

3D ReconstructionAutonomous DrivingDepth Estimation

RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptions

2023-10-23 · NeurIPS 2023 11 · Lingdong Kong, Shaoyuan Xie, Hanjiang Hu, Lai Xing Ng 외

Depth estimation from monocular images is pivotal for real-world visual perception systems. While current learning-based depth estimation models train and test on meticulously curated data, they often overlook out-of-dis…

Autonomous DrivingDepth Estimation

Outdoor Monocular Depth Estimation: A Research Review

2022-05-03 · Pulkit Vyas, Chirag Saxena, Anwesh Badapanda, Anurag Goswami

Depth estimation is an important task, applied in various methods and applications of computer vision. While the traditional methods of estimating depth are based on depth cues and require specific equipment such as ster…

Depth EstimationMonocular Depth Estimation

Manydepth2: Motion-Aware Self-Supervised Multi-Frame Monocular Depth Estimation in Dynamic Scenes

2023-12-23 · Kaichen Zhou, Jia-Wang Bian, Jian-Qing Zheng, JiaXing Zhong 외

Despite advancements in self-supervised monocular depth estimation, challenges persist in dynamic scenarios due to the dependence on assumptions about a static world. In this paper, we present Manydepth2, to achieve prec…

Camera Pose EstimationComputational EfficiencyDepth EstimationMonocular Depth Estimation+1

Tech Report: Divide and Conquer 3D Real-Time Reconstruction for Improved IGS

2024-12-31 · Yicheng Zhu

Tracking surgical modifications based on endoscopic videos is technically feasible and of great clinical advantages; however, it still remains challenging. This report presents a modular pipeline to divide and conquer th…

3D ReconstructionDepth Estimation