paper-with-me

Papers

PLIN: A Network for Pseudo-LiDAR Point Cloud Interpolation

2019-09-16 · Haojie Liu, Kang Liao, Chunyu Lin, Yao Zhao, Yulan Guo

LiDAR sensors can provide dependable 3D spatial information at a low frequency (around 10Hz) and have been widely applied in the field of autonomous driving and UAV. However, the camera with a higher frequency (around 20Hz) has to be decreased so as to match with LiDAR in a multi-sensor system. In this paper, we propose a novel Pseudo-LiDAR interpolation network (PLIN) to increase the frequency of LiDAR sensors. PLIN can generate temporally and spatially high-quality point cloud sequences to match the high frequency of cameras. To achieve this goal, we design a coarse interpolation stage guided by consecutive sparse depth maps and motion relationship. We also propose a refined interpolation stage guided by the realistic scene. Using this coarse-to-fine cascade structure, our method can progressively perceive multi-modal information and generate accurate intermediate point clouds. To the best of our knowledge, this is the first deep framework for Pseudo-LiDAR point cloud interpolation, which shows appealing applications in navigation systems equipped with LiDAR and cameras. Experimental results demonstrate that PLIN achieves promising performance on the KITTI dataset, significantly outperforming the traditional interpolation method and the state-of-the-art video interpolation technique.

📄 PDF Abstract BibTeX arXiv:1909.07137

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Similar Papers 제목 키워드 기반

Pseudo-LiDAR Point Cloud Interpolation Based on 3D Motion Representation and Spatial Supervision

2020-06-20 · Haojie Liu, Kang Liao, Chunyu Lin, Yao Zhao 외

Pseudo-LiDAR point cloud interpolation is a novel and challenging task in the field of autonomous driving, which aims to address the frequency mismatching problem between camera and LiDAR. Previous works represent the 3D…

Autonomous DrivingOptical Flow Estimation

PointINet: Point Cloud Frame Interpolation Network

2020-12-18 · Fan Lu, Guang Chen, Sanqing Qu, Zhijun Li 외

LiDAR point cloud streams are usually sparse in time dimension, which is limited by hardware performance. Generally, the frame rates of mechanical LiDAR sensors are 10 to 20 Hz, which is much lower than other commonly us…

3D Point Cloud Interpolation

Pseudo-LiDAR for Visual Odometry

2022-09-04 · Huiying Deng, Guangming Wang, Zhiheng Feng, Chaokang Jiang 외

In the existing methods, LiDAR odometry shows superior performance, but visual odometry is still widely used for its price advantage. Conventionally, the task of visual odometry mainly rely on the input of continuous ima…

Stereo MatchingVisual Odometry

Monocular 3D Object Detection with Pseudo-LiDAR Point Cloud

2019-03-23 · Xinshuo Weng, Kris Kitani

Monocular 3D scene understanding tasks, such as object size estimation, heading angle estimation and 3D localization, is challenging. Successful modern day methods for 3D scene understanding require the use of a 3D senso…

3D Object DetectionDepth EstimationMonocular 3D Object DetectionMonocular Depth Estimation+4

RAI-Net: Range-Adaptive LiDAR Point Cloud Frame Interpolation Network

2021-06-01 · Lili Zhao, Zezhi Zhu, Xuhu Lin, Xuezhou Guo 외

LiDAR point cloud frame interpolation, which synthesizes the intermediate frame between the captured frames, has emerged as an important issue for many applications. Especially for reducing the amounts of point cloud tra…

Video Frame Interpolation