A high-precision self-supervised monocular visual odometry in foggy weather based on robust cycled generative adversarial networks and multi-task learning aided depth estimation
This paper proposes a high-precision self-supervised monocular VO, which is specifically designed for navigation in foggy weather. A cycled generative adversarial network is designed to obtain high-quality self-supervised loss via forcing the forward and backward half-cycle to output consistent estimation. Moreover, gradient-based loss and perceptual loss are introduced to eliminate the interference of complex photometric change on self-supervised loss in foggy weather. To solve the ill-posed problem of depth estimation, a self-supervised multi-task learning aided depth estimation module is designed based on the strong correlation between the depth estimation and transmission map calculation of hazy images in foggy weather. The experimental results on the synthetic foggy KITTI dataset show that the proposed self-supervised monocular VO performs better in depth and pose estimation than other state-of-the-art monocular VO in the literature, indicating the designed method is more suitable for foggy weather.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationGenerative Adversarial NetworkMonocular Visual OdometryMulti-Task LearningPose EstimationVisual OdometrySimilar Papers 제목 키워드 기반
Deep Neighbor Layer Aggregation for Lightweight Self-Supervised Monocular Depth Estimation
With the frequent use of self-supervised monocular depth estimation in robotics and autonomous driving, the model's efficiency is becoming increasingly important. Most current approaches apply much larger and more comple…
Autonomous DrivingDecoderDepth EstimationMonocular Depth EstimationMotionHint: Self-Supervised Monocular Visual Odometry with Motion Constraints
We present a novel self-supervised algorithm named MotionHint for monocular visual odometry (VO) that takes motion constraints into account. A key aspect of our approach is to use an appropriate motion model that can hel…
Monocular Visual OdometryVisual OdometryWhat My Motion tells me about Your Pose: A Self-Supervised Monocular 3D Vehicle Detector
The estimation of the orientation of an observed vehicle relative to an Autonomous Vehicle (AV) from monocular camera data is an important building block in estimating its 6 DoF pose. Current Deep Learning based solution…
Autonomous VehiclesDomain AdaptationMonocular Visual Odometryvehicle detection+1Self-supervised Pretraining and Finetuning for Monocular Depth and Visual Odometry
For the task of simultaneous monocular depth and visual odometry estimation, we propose learning self-supervised transformer-based models in two steps. Our first step consists in a generic pretraining to learn 3D geometr…
3D geometryDepth EstimationDepth PredictionVisual OdometryEnhancing self-supervised monocular depth estimation with traditional visual odometry
Estimating depth from a single image represents an attractive alternative to more traditional approaches leveraging multiple cameras. In this field, deep learning yielded outstanding results at the cost of needing large …
Depth And Camera MotionDepth EstimationMonocular Depth EstimationVisual Odometry