paper-with-me

홈 › Papers

DSCnet: Replicating Lidar Point Clouds with Deep Sensor Cloning

2018-11-17 · Paden Tomasello, Sammy Sidhu, Anting Shen, Matthew W. Moskewicz, Nobie Redmon, Gayatri Joshi, Romi Phadte, Paras Jain, Forrest Iandola

Convolutional neural networks (CNNs) have become increasingly popular for solving a variety of computer vision tasks, ranging from image classification to image segmentation. Recently, autonomous vehicles have created a demand for depth information, which is often obtained using hardware sensors such as Light detection and ranging (LIDAR). Although it can provide precise distance measurements, most LIDARs are still far too expensive to sell in mass-produced consumer vehicles, which has motivated methods to generate depth information from commodity automotive sensors like cameras. In this paper, we propose an approach called Deep Sensor Cloning (DSC). The idea is to use Convolutional Neural Networks in conjunction with inexpensive sensors to replicate the 3D point-clouds that are created by expensive LIDARs. To accomplish this, we develop a new dataset (DSDepth) and a new family of CNN architectures (DSCnets). While previous tasks such as KITTI depth prediction use an interpolated RGB-D images as ground-truth for training, we instead use DSCnets to directly predict LIDAR point-clouds. When we compare the output of our models to a $75,000 LIDAR, we find that our most accurate DSCnet achieves a relative error of 5.77% using a single camera and 4.69% using stereo cameras.

📄 PDF Abstract BibTeX arXiv:1811.07070

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesDepth EstimationDepth Predictionimage-classificationImage ClassificationImage SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

HeLiMOS: A Dataset for Moving Object Segmentation in 3D Point Clouds From Heterogeneous LiDAR Sensors

2024-08-12 · Hyungtae Lim, Seoyeon Jang, Benedikt Mersch, Jens Behley 외

Moving object segmentation (MOS) using a 3D light detection and ranging (LiDAR) sensor is crucial for scene understanding and identification of moving objects. Despite the availability of various types of 3D LiDAR sensor…

Scene UnderstandingSemantic Segmentation

TexLiDAR: Automated Text Understanding for Panoramic LiDAR Data

2025-02-05 · Naor Cohen, Roy Orfaig, Ben-Zion Bobrovsky

Efforts to connect LiDAR data with text, such as LidarCLIP, have primarily focused on embedding 3D point clouds into CLIP text-image space. However, these approaches rely on 3D point clouds, which present challenges in e…

Image Captioningobject-detectionObject Detection

GAN-Based LiDAR Intensity Simulation

2023-11-26 · Richard Marcus, Felix Gabel, Niklas Knoop, Marc Stamminger

Realistic vehicle sensor simulation is an important element in developing autonomous driving. As physics-based implementations of visual sensors like LiDAR are complex in practice, data-based approaches promise solutions…

Autonomous Drivingobject-detectionObject Detection

Unsupervised Neural Sensor Models for Synthetic LiDAR Data Augmentation

2019-11-24 · Ahmad El Sallab, Ibrahim Sobh, Mohamed Zahran, Mohamed Shawky

Data scarcity is a bottleneck to machine learning-based perception modules, usually tackled by augmenting real data with synthetic data from simulators. Realistic models of the vehicle perception sensors are hard to form…

Data Augmentationobject-detectionObject DetectionStyle Transfer

Learning to Simulate Realistic LiDARs

2022-09-22 · Benoit Guillard, Sai Vemprala, Jayesh K. Gupta, Ondrej Miksik 외

Simulating realistic sensors is a challenging part in data generation for autonomous systems, often involving carefully handcrafted sensor design, scene properties, and physics modeling. To alleviate this, we introduce a…