SLPC: a VRNN-based approach for stochastic lidar prediction and completion in autonomous driving

2021-02-19 · George Eskandar, Alexander Braun, Martin Meinke, Karim Armanious, Bin Yang

Predicting future 3D LiDAR pointclouds is a challenging task that is useful in many applications in autonomous driving such as trajectory prediction, pose forecasting and decision making. In this work, we propose a new LiDAR prediction framework that is based on generative models namely Variational Recurrent Neural Networks (VRNNs), titled Stochastic LiDAR Prediction and Completion (SLPC). Our algorithm is able to address the limitations of previous video prediction frameworks when dealing with sparse data by spatially inpainting the depth maps in the upcoming frames. Our contributions can thus be summarized as follows: we introduce the new task of predicting and completing depth maps from spatially sparse data, we present a sparse version of VRNNs and an effective self-supervised training method that does not require any labels. Experimental results illustrate the effectiveness of our framework in comparison to the state of the art methods in video prediction.

📄 PDF Abstract BibTeX arXiv:2102.09883

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving Decision Making Prediction Trajectory Prediction Video Prediction

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Transformers for Object Detection in Large Point Clouds

2022-09-30 · Felicia Ruppel, Florian Faion, Claudius Gläser, Klaus Dietmayer

We present TransLPC, a novel detection model for large point clouds that is based on a transformer architecture. While object detection with transformers has been an active field of research, it has proved difficult to a…

Autonomous Driving Decoder Multi-Object Tracking Object+3

SwinVRNN: A Data-Driven Ensemble Forecasting Model via Learned Distribution Perturbation

2022-05-26 · Yuan Hu, Lei Chen, Zhibin Wang, Hao Li

Data-driven approaches for medium-range weather forecasting are recently shown extraordinarily promising for ensemble forecasting for their fast inference speed compared to traditional numerical weather prediction (NWP) …

Weather Forecasting

Sparse and noisy LiDAR completion with RGB guidance and uncertainty

2019-02-14 · Wouter Van Gansbeke, Davy Neven, Bert de Brabandere, Luc van Gool

This work proposes a new method to accurately complete sparse LiDAR maps guided by RGB images. For autonomous vehicles and robotics the use of LiDAR is indispensable in order to achieve precise depth predictions. A multi…

Autonomous Vehicles Depth Completion Depth Estimation Depth Prediction

EfficientPENet: Real-Time Depth Completion from Sparse LiDAR via Lightweight Multi-Modal Fusion

2026-04-20 · Johny J. Lopez, Md Meftahul Ferdaus, Mahdi Abdelguerfi, Anton Netchaev 외 arxiv

Depth completion from sparse LiDAR measurements and corresponding RGB images is a prerequisite for accurate 3D perception in robotic systems. Existing methods achieve high accuracy on standard benchmarks but rely on heav…

Depth Completion

Sparse and noisy LiDAR completion with RGB guidance anduncertainty

2019-02-14 · arXiv 2019 2 · Wouter Van Gansbeke, Davy Neven, Bert de Brabandere, Luc van Gool

his work proposes a new method to accurately complete sparse LiDAR maps guided by RGB images. For autonomous vehicles and robotics the use of LiDAR is indispensable in order to achieve precise depth predi…