paper-with-me

Papers

Semantics-aware LiDAR-Only Pseudo Point Cloud Generation for 3D Object Detection

2023-09-16 · Tiago Cortinhal, Idriss Gouigah, Eren Erdal Aksoy

Although LiDAR sensors are crucial for autonomous systems due to providing precise depth information, they struggle with capturing fine object details, especially at a distance, due to sparse and non-uniform data. Recent advances introduced pseudo-LiDAR, i.e., synthetic dense point clouds, using additional modalities such as cameras to enhance 3D object detection. We present a novel LiDAR-only framework that augments raw scans with denser pseudo point clouds by solely relying on LiDAR sensors and scene semantics, omitting the need for cameras. Our framework first utilizes a segmentation model to extract scene semantics from raw point clouds, and then employs a multi-modal domain translator to generate synthetic image segments and depth cues without real cameras. This yields a dense pseudo point cloud enriched with semantic information. We also introduce a new semantically guided projection method, which enhances detection performance by retaining only relevant pseudo points. We applied our framework to different advanced 3D object detection methods and reported up to 2.9% performance upgrade. We also obtained comparable results on the KITTI 3D object detection dataset, in contrast to other state-of-the-art LiDAR-only detectors.

📄 PDF Abstract BibTeX arXiv:2309.08932

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionObjectobject-detectionObject DetectionPoint Cloud Generation

Similar Papers 제목 키워드 기반

Pseudo-LiDAR for Visual Odometry

2022-09-04 · Huiying Deng, Guangming Wang, Zhiheng Feng, Chaokang Jiang 외

In the existing methods, LiDAR odometry shows superior performance, but visual odometry is still widely used for its price advantage. Conventionally, the task of visual odometry mainly rely on the input of continuous ima…

Stereo MatchingVisual Odometry

Systematic Evaluation of Depth Backbones and Semantic Cues for Monocular Pseudo-LiDAR 3D Detection

2026-01-07 · Samson Oseiwe Ajadalu arxiv

Monocular 3D object detection offers a low-cost alternative to LiDAR, yet remains less accurate due to the difficulty of estimating metric depth from a single image. We systematically evaluate how depth backbones and fea…

Monocular 3D Object DetectionInstance SegmentationFeature Engineering

Multi-modal NeRF Self-Supervision for LiDAR Semantic Segmentation

2024-11-05 · Xavier Timoneda, Markus Herb, Fabian Duerr, Daniel Goehring 외

LiDAR Semantic Segmentation is a fundamental task in autonomous driving perception consisting of associating each LiDAR point to a semantic label. Fully-supervised models have widely tackled this task, but they require l…

Autonomous DrivingDomain AdaptationLIDAR Semantic SegmentationNeRF+1

Depth- and Semantics-aware Multi-modal Domain Translation: Generating 3D Panoramic Color Images from LiDAR Point Clouds

2023-02-15 · Tiago Cortinhal, Eren Erdal Aksoy

This work presents a new depth- and semantics-aware conditional generative model, named TITAN-Next, for cross-domain image-to-image translation in a multi-modal setup between LiDAR and camera sensors. The proposed model …

Autonomous VehiclesImage-to-Image Translation

Enhancing Steering Estimation with Semantic-Aware GNNs

2025-03-21 · Fouad Makiyeh, Huy-Dung Nguyen, Patrick Chareyre, Ramin Hasani 외

Steering estimation is a critical task in autonomous driving, traditionally relying on 2D image-based models. In this work, we explore the advantages of incorporating 3D spatial information through hybrid architectures t…

Autonomous Drivinggraph constructionGraph Neural Network