paper-with-me

홈 › Papers

Learning to Simulate Realistic LiDARs

2022-09-22 · Benoit Guillard, Sai Vemprala, Jayesh K. Gupta, Ondrej Miksik, Vibhav Vineet, Pascal Fua, Ashish Kapoor

Simulating realistic sensors is a challenging part in data generation for autonomous systems, often involving carefully handcrafted sensor design, scene properties, and physics modeling. To alleviate this, we introduce a pipeline for data-driven simulation of a realistic LiDAR sensor. We propose a model that learns a mapping between RGB images and corresponding LiDAR features such as raydrop or per-point intensities directly from real datasets. We show that our model can learn to encode realistic effects such as dropped points on transparent surfaces or high intensity returns on reflective materials. When applied to naively raycasted point clouds provided by off-the-shelf simulator software, our model enhances the data by predicting intensities and removing points based on the scene's appearance to match a real LiDAR sensor. We use our technique to learn models of two distinct LiDAR sensors and use them to improve simulated LiDAR data accordingly. Through a sample task of vehicle segmentation, we show that enhancing simulated point clouds with our technique improves downstream task performance.

📄 PDF Abstract BibTeX arXiv:2209.10986

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

LiDARsim: Realistic LiDAR Simulation by Leveraging the Real World

2020-06-16 · CVPR 2020 6 · Sivabalan Manivasagam, Shenlong Wang, Kelvin Wong, Wenyuan Zeng 외

We tackle the problem of producing realistic simulations of LiDAR point clouds, the sensor of preference for most self-driving vehicles. We argue that, by leveraging real data, we can simulate the complex world more real…

Analyzing Infrastructure LiDAR Placement with Realistic LiDAR Simulation Library

2022-11-29 · Xinyu Cai, Wentao Jiang, Runsheng Xu, Wenquan Zhao 외

Recently, Vehicle-to-Everything(V2X) cooperative perception has attracted increasing attention. Infrastructure sensors play a critical role in this research field; however, how to find the optimal placement of infrastruc…

Real-Time Point Cloud Fusion of Multi-LiDAR Infrastructure Sensor Setups with Unknown Spatial Location and Orientation

2020-07-28 · Laurent Kloeker, Christian Kotulla, Lutz Eckstein

The use of infrastructure sensor technology for traffic detection has already been proven several times. However, extrinsic sensor calibration is still a challenge for the operator. While previous approaches are unable t…

Point Cloud Registration

Robust sensor fusion against on-vehicle sensor staleness

2025-06-06 · Meng Fan, Yifan Zuo, Patrick Blaes, Harley Montgomery 외

Sensor fusion is crucial for a performant and robust Perception system in autonomous vehicles, but sensor staleness, where data from different sensors arrives with varying delays, poses significant challenges. Temporal m…

Autonomous VehiclesData AugmentationSensor Fusion

TrajMatch: Towards Automatic Spatio-temporal Calibration for Roadside LiDARs through Trajectory Matching

2023-02-04 · Haojie Ren, Sha Zhang, Sugang Li, Yao Li 외

Recently, it has become popular to deploy sensors such as LiDARs on the roadside to monitor the passing traffic and assist autonomous vehicle perception. Unlike autonomous vehicle systems, roadside sensors are usually af…