paper-with-me

Papers

Fast LiDAR Upsampling using Conditional Diffusion Models

2024-05-08 · Sander Elias Magnussen Helgesen, Kazuto Nakashima, Jim Tørresen, Ryo Kurazume

The search for refining 3D LiDAR data has attracted growing interest motivated by recent techniques such as supervised learning or generative model-based methods. Existing approaches have shown the possibilities for using diffusion models to generate refined LiDAR data with high fidelity, although the performance and speed of such methods have been limited. These limitations make it difficult to execute in real-time, causing the approaches to struggle in real-world tasks such as autonomous navigation and human-robot interaction. In this work, we introduce a novel approach based on conditional diffusion models for fast and high-quality sparse-to-dense upsampling of 3D scene point clouds through an image representation. Our method employs denoising diffusion probabilistic models trained with conditional inpainting masks, which have been shown to give high performance on image completion tasks. We introduce a series of experiments, including multiple datasets, sampling steps, and conditional masks. This paper illustrates that our method outperforms the baselines in sampling speed and quality on upsampling tasks using the KITTI-360 dataset. Furthermore, we illustrate the generalization ability of our approach by simultaneously training on real-world and synthetic datasets, introducing variance in quality and environments.

📄 PDF Abstract BibTeX arXiv:2405.04889

Code (1)

sander3101/Fast-LiDAR 공식 구현 pytorch

Tasks

Autonomous NavigationDenoising

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Gait Sequence Upsampling using Diffusion Models for Single LiDAR Sensors

2024-10-11 · Jeongho Ahn, Kazuto Nakashima, Koki Yoshino, Yumi Iwashita 외

Recently, 3D LiDAR has emerged as a promising technique in the field of gait-based person identification, serving as an alternative to traditional RGB cameras, due to its robustness under varying lighting conditions and …

Gait RecognitionPerson Identification

ELMO: Enhanced Real-time LiDAR Motion Capture through Upsampling

2024-10-09 · Deok-Kyeong Jang, Dongseok Yang, Deok-Yun Jang, Byeoli Choi 외

This paper introduces ELMO, a real-time upsampling motion capture framework designed for a single LiDAR sensor. Modeled as a conditional autoregressive transformer-based upsampling motion generator, ELMO achieves 60 fps …

Data Augmentation

PVNet: Point-Voxel Interaction LiDAR Scene Upsampling Via Diffusion Models

2025-08-23 · Xianjing Cheng, Lintai Wu, Zuowen Wang, Junhui Hou 외 arxiv

Accurate 3D scene understanding in outdoor environments heavily relies on high-quality point clouds. However, LiDAR-scanned data often suffer from extreme sparsity, severely hindering downstream 3D perception tasks. Exis…

Scene UnderstandingPoint Clouds

Towards Realistic Scene Generation with LiDAR Diffusion Models

2024-03-31 · CVPR 2024 1 · Haoxi Ran, Vitor Guizilini, Yue Wang

Diffusion models (DMs) excel in photo-realistic image synthesis, but their adaptation to LiDAR scene generation poses a substantial hurdle. This is primarily because DMs operating in the point space struggle to preserve …

3D geometryImage GenerationScene Generation

Fast LiDAR Data Generation with Rectified Flows

2024-12-03 · Kazuto Nakashima, Xiaowen Liu, Tomoya Miyawaki, Yumi Iwashita 외

Building LiDAR generative models holds promise as powerful data priors for restoration, scene manipulation, and scalable simulation in autonomous mobile robots. In recent years, approaches using diffusion models have eme…