paper-with-me

홈 › Papers

SynDistNet: Self-Supervised Monocular Fisheye Camera Distance Estimation Synergized with Semantic Segmentation for Autonomous Driving

2020-08-10 · Varun Ravi Kumar, Marvin Klingner, Senthil Yogamani, Stefan Milz, Tim Fingscheidt, Patrick Maeder

State-of-the-art self-supervised learning approaches for monocular depth estimation usually suffer from scale ambiguity. They do not generalize well when applied on distance estimation for complex projection models such as in fisheye and omnidirectional cameras. This paper introduces a novel multi-task learning strategy to improve self-supervised monocular distance estimation on fisheye and pinhole camera images. Our contribution to this work is threefold: Firstly, we introduce a novel distance estimation network architecture using a self-attention based encoder coupled with robust semantic feature guidance to the decoder that can be trained in a one-stage fashion. Secondly, we integrate a generalized robust loss function, which improves performance significantly while removing the need for hyperparameter tuning with the reprojection loss. Finally, we reduce the artifacts caused by dynamic objects violating static world assumptions using a semantic masking strategy. We significantly improve upon the RMSE of previous work on fisheye by 25% reduction in RMSE. As there is little work on fisheye cameras, we evaluated the proposed method on KITTI using a pinhole model. We achieved state-of-the-art performance among self-supervised methods without requiring an external scale estimation.

📄 PDF Abstract BibTeX arXiv:2008.04017

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingDecoderDepth EstimationMonocular Depth EstimationMulti-Task LearningSelf-Supervised LearningSemantic Segmentation

Similar Papers 제목 키워드 기반

FisheyeDistill: Self-Supervised Monocular Depth Estimation with Ordinal Distillation for Fisheye Cameras

2022-05-05 · Qingan Yan, Pan Ji, Nitin Bansal, Yuxin Ma 외

In this paper, we deal with the problem of monocular depth estimation for fisheye cameras in a self-supervised manner. A known issue of self-supervised depth estimation is that it suffers in low-light/over-exposure condi…

Depth EstimationMonocular Depth Estimation

FisheyeDistanceNet: Self-Supervised Scale-Aware Distance Estimation using Monocular Fisheye Camera for Autonomous Driving

2019-10-07 · Varun Ravi Kumar, Sandesh Athni Hiremath, Stefan Milz, Christian Witt 외

Fisheye cameras are commonly used in applications like autonomous driving and surveillance to provide a large field of view ($>180^{\circ}$). However, they come at the cost of strong non-linear distortions which require …

Autonomous DrivingSelf-Supervised Learning

SVDistNet: Self-Supervised Near-Field Distance Estimation on Surround View Fisheye Cameras

2021-04-09 · Varun Ravi Kumar, Marvin Klingner, Senthil Yogamani, Markus Bach 외

A 360{\deg} perception of scene geometry is essential for automated driving, notably for parking and urban driving scenarios. Typically, it is achieved using surround-view fisheye cameras, focusing on the near-field area…

Depth Estimation

Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens

2025-08-06 · Rit Gangopadhyay, Jung-Hee Kim, Xien Chen, Patrick Rim 외 arxiv

We propose a method to extend foundational monocular depth estimators (FMDEs), trained on perspective images, to fisheye images. Despite being trained on tens of millions of images, FMDEs are susceptible to the covariate…

From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation

2026-08-28 · Rit Gangopadhyay, Alex Wong arxiv

Vision foundation models are capable of generalizing across 3-dimensional (3D) scenes with high-fidelity estimates; their empirical success can be attributed to training on large-scale datasets of perspective images. How…

Monocular Depth Estimation