Self-supervised Visual-LiDAR Odometry with Flip Consistency

2021-01-05 · Bin Li, Mu Hu, Shuling Wang, Lianghao Wang, Xiaojin Gong

Most learning-based methods estimate ego-motion by utilizing visual sensors, which suffer from dramatic lighting variations and textureless scenarios. In this paper, we incorporate sparse but accurate depth measurements obtained from lidars to overcome the limitation of visual methods. To this end, we design a self-supervised visual-lidar odometry (Self-VLO) framework. It takes both monocular images and sparse depth maps projected from 3D lidar points as input, and produces pose and depth estimations in an end-to-end learning manner, without using any ground truth labels. To effectively fuse two modalities, we design a two-pathway encoder to extract features from visual and depth images and fuse the encoded features with those in decoders at multiple scales by our fusion module. We also adopt a siamese architecture and design an adaptively weighted flip consistency loss to facilitate the self-supervised learning of our VLO. Experiments on the KITTI odometry benchmark show that the proposed approach outperforms all self-supervised visual or lidar odometries. It also performs better than fully supervised VOs, demonstrating the power of fusion.

📄 PDF Abstract BibTeX arXiv:2101.01322

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised Learning

Methods 이 논문이 사용한 방법론

FLIP https://developer.nvidia.com/blog/flip-a-difference-evaluator-for-alternating-images/

Super4DR: 4D Radar-centric Self-supervised Odometry and Gaussian-based Map Optimization

2025-12-10 · Zhiheng Li, Weihua Wang, Qiang Shen, Yichen Zhao 외 arxiv

Conventional odometry and mapping methods using visual or LiDAR data often struggle under poor illumination and adverse weather conditions. Although 4D radar is suited for such environments, its sparse and noisy point cl…

Point Clouds

SelfVoxeLO: Self-supervised LiDAR Odometry with Voxel-based Deep Neural Networks

2020-10-19 · Yan Xu, Zhaoyang Huang, Kwan-Yee Lin, Xinge Zhu 외

Recent learning-based LiDAR odometry methods have demonstrated their competitiveness. However, most methods still face two substantial challenges: 1) the 2D projection representation of LiDAR data cannot effectively enco…

Self-Supervised Learning

D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry

2020-03-02 · CVPR 2020 6 · Nan Yang, Lukas von Stumberg, Rui Wang, Daniel Cremers

We propose D3VO as a novel framework for monocular visual odometry that exploits deep networks on three levels -- deep depth, pose and uncertainty estimation. We first propose a novel self-supervised monocular depth esti…

Depth Estimation Monocular Depth Estimation Monocular Visual Odometry Visual Odometry

Dense-depth map guided deep Lidar-Visual Odometry with Sparse Point Clouds and Images

2025-07-21 · JunYing Huang, Ao Xu, DongSun Yong, KeRen Li 외 arxiv

Odometry is a critical task for autonomous systems for self-localization and navigation. We propose a novel LiDAR-Visual odometry framework that integrates LiDAR point clouds and images for accurate and robust pose estim…

Depth Completion Pose Estimation Visual Odometry Point Clouds

Robust Self-Supervised LiDAR Odometry via Representative Structure Discovery and 3D Inherent Error Modeling

2022-02-27 · Yan Xu, Junyi Lin, Jianping Shi, Guofeng Zhang 외

The correct ego-motion estimation basically relies on the understanding of correspondences between adjacent LiDAR scans. However, given the complex scenarios and the low-resolution LiDAR, finding reliable structures for …

Motion Estimation