An Unsupervised Optical Flow Estimation For LiDAR Image Sequences

2021-05-28 · Xuezhou Guo, Xuhu Lin, Lili Zhao, Zezhi Zhu, Jianwen Chen

In recent years, the LiDAR images, as a 2D compact representation of 3D LiDAR point clouds, are widely applied in various tasks, e.g., 3D semantic segmentation, LiDAR point cloud compression (PCC). Among these works, the optical flow estimation for LiDAR image sequences has become a key issue, especially for the motion estimation of the inter prediction in PCC. However, the existing optical flow estimation models are likely to be unreliable for LiDAR images. In this work, we first propose a light-weight flow estimation model for LiDAR image sequences. The key novelty of our method lies in two aspects. One is that for the different characteristics (with the spatial-variation feature distribution) of the LiDAR images w.r.t. the normal color images, we introduce the attention mechanism into our model to improve the quality of the estimated flow. The other one is that to tackle the lack of large-scale LiDAR-image annotations, we present an unsupervised method, which directly minimizes the inconsistency between the reference image and the reconstructed image based on the estimated optical flow. Extensive experimental results have shown that our proposed model outperforms other mainstream models on the KITTI dataset, with much fewer parameters.

📄 PDF Abstract BibTeX arXiv:2105.13879

Code (0)

등록된 구현이 없습니다.

Tasks

3D Semantic SegmentationMotion EstimationOptical Flow Estimation Semantic Segmentation

3D Scene Flow Estimation on Pseudo-LiDAR: Bridging the Gap on Estimating Point Motion

2022-09-27 · Chaokang Jiang, Guangming Wang, Yanzi Miao, Hesheng Wang

3D scene flow characterizes how the points at the current time flow to the next time in the 3D Euclidean space, which possesses the capacity to infer autonomously the non-rigid motion of all objects in the scene. The pre…

Optical Flow Estimation Scene Flow Estimation Self-Supervised Learning

Hallucinating Dense Optical Flow from Sparse Lidar for Autonomous Vehicles

2018-08-30 · Victor Vaquero, Alberto Sanfeliu, Francesc Moreno-Noguer

In this paper we propose a novel approach to estimate dense optical flow from sparse lidar data acquired on an autonomous vehicle. This is intended to be used as a drop-in replacement of any image-based optical flow syst…

Autonomous Vehicles Optical Flow Estimation

FlowDA: Unsupervised Domain Adaptive Framework for Optical Flow Estimation

2023-12-28 · Miaojie Feng, Longliang Liu, Hao Jia, Gangwei Xu 외

Collecting real-world optical flow datasets is a formidable challenge due to the high cost of labeling. A shortage of datasets significantly constrains the real-world performance of optical flow models. Building virtual …

Dataset Generation Optical Flow Estimation

UnOS: Unified Unsupervised Optical-Flow and Stereo-Depth Estimation by Watching Videos

2019-06-01 · CVPR 2019 6 · Yang Wang, Peng Wang, Zhenheng Yang, Chenxu Luo 외

In this paper, we propose UnOS, an unified system for unsupervised optical flow and stereo depth estimation using convolutional neural network (CNN) by taking advantages of their inherent geometrical consistency based on…

Depth Estimation Motion Segmentation Optical Flow Estimation Stereo Depth Estimation+1

Unsupervised Learning Optical Flow in Multi-frame Dynamic Environment Using Temporal Dynamic Modeling

2023-04-14 · Zitang Sun, Shin'ya Nishida, Zhengbo Luo

For visual estimation of optical flow, a crucial function for many vision tasks, unsupervised learning, using the supervision of view synthesis has emerged as a promising alternative to supervised methods, since ground-t…

Optical Flow Estimation