paper-with-me

홈 › Papers

SeasonDepth: Cross-Season Monocular Depth Prediction Dataset and Benchmark under Multiple Environments

2020-11-09 · Hanjiang Hu, Baoquan Yang, Zhijian Qiao, Shiqi Liu, Jiacheng Zhu, Zuxin Liu, Wenhao Ding, Ding Zhao, Hesheng Wang

Different environments pose a great challenge to the outdoor robust visual perception for long-term autonomous driving, and the generalization of learning-based algorithms on different environments is still an open problem. Although monocular depth prediction has been well studied recently, few works focus on the robustness of learning-based depth prediction across different environments, e.g. changing illumination and seasons, owing to the lack of such a multi-environment real-world dataset and benchmark. To this end, the first cross-season monocular depth prediction dataset and benchmark, SeasonDepth, is introduced to benchmark the depth estimation performance under different environments. We investigate several state-of-the-art representative open-source supervised and self-supervised depth prediction methods using newly-formulated metrics. Through extensive experimental evaluation on the proposed dataset and cross-dataset evaluation with current autonomous driving datasets, the performance and robustness against the influence of multiple environments are analyzed qualitatively and quantitatively. We show that long-term monocular depth prediction is still challenging and believe our work can boost further research on the long-term robustness and generalization for outdoor visual perception. The dataset is available on https://seasondepth.github.io, and the benchmark toolkit is available on https://github.com/ SeasonDepth/SeasonDepth.

📄 PDF Abstract BibTeX arXiv:2011.04408

Code (1)

SeasonDepth/SeasonDepth 공식 구현

Tasks

Autonomous DrivingDepth EstimationDepth PredictionDomain AdaptationPredictionScene UnderstandingVisual Localization

Similar Papers 제목 키워드 기반

Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Driving

2022-05-18 · Jie Xiang, Yun Wang, Lifeng An, Haiyang Liu 외

Although existing monocular depth estimation methods have made great progress, predicting an accurate absolute depth map from a single image is still challenging due to the limited modeling capacity of networks and the s…

Autonomous DrivingDepth EstimationMonocular Depth Estimation

A Multi-modal Approach to Single-modal Visual Place Classification

2023-05-10 · Tomoya Iwasaki, Kanji Tanaka, Kenta Tsukahara

Visual place classification from a first-person-view monocular RGB image is a fundamental problem in long-term robot navigation. A difficulty arises from the fact that RGB image classifiers are often vulnerable to spatia…

ClassificationDepth Estimationimage-classificationImage Classification+3

Deep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometry

2018-07-06 · ECCV 2018 9 · Nan Yang, Rui Wang, Jörg Stückler, Daniel Cremers

Monocular visual odometry approaches that purely rely on geometric cues are prone to scale drift and require sufficient motion parallax in successive frames for motion estimation and 3D reconstruction. In this paper, we …

3D ReconstructionDepth EstimationDepth PredictionMonocular Visual Odometry+2

CNN-SLAM: Real-time dense monocular SLAM with learned depth prediction

2017-04-11 · CVPR 2017 7 · Keisuke Tateno, Federico Tombari, Iro Laina, Nassir Navab

Given the recent advances in depth prediction from Convolutional Neural Networks (CNNs), this paper investigates how predicted depth maps from a deep neural network can be deployed for accurate and dense monocular recons…

Depth EstimationDepth PredictionMonocular ReconstructionPrediction

Self-supervised 3D Object Detection from Monocular Pseudo-LiDAR

2022-09-20 · Curie Kim, Ue-Hwan Kim, Jong-Hwan Kim

There have been attempts to detect 3D objects by fusion of stereo camera images and LiDAR sensor data or using LiDAR for pre-training and only monocular images for testing, but there have been less attempts to use only m…

3D Object DetectionDepth EstimationDepth PredictionObject+3