RAI-Net: Range-Adaptive LiDAR Point Cloud Frame Interpolation Network
LiDAR point cloud frame interpolation, which synthesizes the intermediate frame between the captured frames, has emerged as an important issue for many applications. Especially for reducing the amounts of point cloud transmission, it is by predicting the intermediate frame based on the reference frames to upsample data to high frame rate ones. However, due to high-dimensional and sparse characteristics of point clouds, it is more difficult to predict the intermediate frame for LiDAR point clouds than videos. In this paper, we propose a novel LiDAR point cloud frame interpolation method, which exploits range images (RIs) as an intermediate representation with CNNs to conduct the frame interpolation process. Considering the inherited characteristics of RIs differ from that of color images, we introduce spatially adaptive convolutions to extract range features adaptively, while a high-efficient flow estimation method is presented to generate optical flows. The proposed model then warps the input frames and range features, based on the optical flows to synthesize the interpolated frame. Extensive experiments on the KITTI dataset have clearly demonstrated that our method consistently achieves superior frame interpolation results with better perceptual quality to that of using state-of-the-art video frame interpolation methods. The proposed method could be integrated into any LiDAR point cloud compression systems for inter prediction.
Code (0)
등록된 구현이 없습니다.
Tasks
Video Frame InterpolationSimilar Papers 제목 키워드 기반
Fully Convolutional One-Stage 3D Object Detection on LiDAR Range Images
We present a simple yet effective fully convolutional one-stage 3D object detector for LiDAR point clouds of autonomous driving scenes, termed FCOS-LiDAR. Unlike the dominant methods that use the bird-eye view (BEV), our…
3D Object DetectionAutonomous Drivingobject-detectionObject Detection+1SALSA: Swift Adaptive Lightweight Self-Attention for Enhanced LiDAR Place Recognition
Large-scale LiDAR mappings and localization leverage place recognition techniques to mitigate odometry drifts, ensuring accurate mapping. These techniques utilize scene representations from LiDAR point clouds to identify…
3D Place RecognitionUniSeg: A Unified Multi-Modal LiDAR Segmentation Network and the OpenPCSeg Codebase
Point-, voxel-, and range-views are three representative forms of point clouds. All of them have accurate 3D measurements but lack color and texture information. RGB images are a natural complement to these point cloud v…
3D Semantic SegmentationLIDAR Semantic SegmentationPanoptic SegmentationSegmentation+1SRMamba: Mamba for Super-Resolution of LiDAR Point Clouds
In recent years, range-view-based LiDAR point cloud super-resolution techniques attract significant attention as a low-cost method for generating higher-resolution point cloud data. However, due to the sparsity and irreg…
MambaPoint Cloud Super Resolutionpoint cloud upsamplingSuper-ResolutionRangeLDM: Fast Realistic LiDAR Point Cloud Generation
Autonomous driving demands high-quality LiDAR data, yet the cost of physical LiDAR sensors presents a significant scaling-up challenge. While recent efforts have explored deep generative models to address this issue, the…
Autonomous DrivingPoint Cloud Generation