paper-with-me

홈 › Papers

Learning Monocular Depth from Events via Egomotion Compensation

2024-12-26 · Haitao Meng, Chonghao Zhong, Sheng Tang, Lian JunJia, Wenwei Lin, Zhenshan Bing, Yi Chang, Gang Chen, Alois Knoll

Event cameras are neuromorphically inspired sensors that sparsely and asynchronously report brightness changes. Their unique characteristics of high temporal resolution, high dynamic range, and low power consumption make them well-suited for addressing challenges in monocular depth estimation (e.g., high-speed or low-lighting conditions). However, current existing methods primarily treat event streams as black-box learning systems without incorporating prior physical principles, thus becoming over-parameterized and failing to fully exploit the rich temporal information inherent in event camera data. To address this limitation, we incorporate physical motion principles to propose an interpretable monocular depth estimation framework, where the likelihood of various depth hypotheses is explicitly determined by the effect of motion compensation. To achieve this, we propose a Focus Cost Discrimination (FCD) module that measures the clarity of edges as an essential indicator of focus level and integrates spatial surroundings to facilitate cost estimation. Furthermore, we analyze the noise patterns within our framework and improve it with the newly introduced Inter-Hypotheses Cost Aggregation (IHCA) module, where the cost volume is refined through cost trend prediction and multi-scale cost consistency constraints. Extensive experiments on real-world and synthetic datasets demonstrate that our proposed framework outperforms cutting-edge methods by up to 10\% in terms of the absolute relative error metric, revealing superior performance in predicting accuracy.

📄 PDF Abstract BibTeX arXiv:2412.19067

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationMonocular Depth EstimationMotion Compensation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Sparse Representations for Object and Ego-motion Estimation in Dynamic Scenes

2019-03-09 · Hirak J. Kashyap, Charless Fowlkes, Jeffrey L. Krichmar

Dynamic scenes that contain both object motion and egomotion are a challenge for monocular visual odometry (VO). Another issue with monocular VO is the scale ambiguity, i.e. these methods cannot estimate scene depth and …

Depth And Camera MotionMonocular Visual OdometryMotion EstimationObject+3

Self-Supervised Scale Recovery for Monocular Depth and Egomotion Estimation

2020-09-08 · Brandon Wagstaff, Jonathan Kelly

The self-supervised loss formulation for jointly training depth and egomotion neural networks with monocular images is well studied and has demonstrated state-of-the-art accuracy. One of the main limitations of this appr…

Unsupervised Learning of Dense Optical Flow, Depth and Egomotion from Sparse Event Data

2018-09-23 · Chengxi Ye, Anton Mitrokhin, Cornelia Fermüller, James A. Yorke 외

In this work we present a lightweight, unsupervised learning pipeline for \textit{dense} depth, optical flow and egomotion estimation from sparse event output of the Dynamic Vision Sensor (DVS). To tackle this low level …

DecoderGPUOptical Flow Estimation

SelfOdom: Self-supervised Egomotion and Depth Learning via Bi-directional Coarse-to-Fine Scale Recovery

2022-11-16 · Hao Qu, Lilian Zhang, Xiaoping Hu, Xiaofeng He 외

Accurately perceiving location and scene is crucial for autonomous driving and mobile robots. Recent advances in deep learning have made it possible to learn egomotion and depth from monocular images in a self-supervised…

Autonomous DrivingSelf-LearningSelf-Supervised Learning

Driven to Distraction: Self-Supervised Distractor Learning for Robust Monocular Visual Odometry in Urban Environments

2017-11-17 · Dan Barnes, Will Maddern, Geoffrey Pascoe, Ingmar Posner

We present a self-supervised approach to ignoring "distractors" in camera images for the purposes of robustly estimating vehicle motion in cluttered urban environments. We leverage offline multi-session mapping approache…

Monocular Visual OdometryVisual Odometry