paper-with-me

홈 › Papers

Realistic Rainy Weather Simulation for LiDARs in CARLA Simulator

2023-12-20 · Donglin Yang, Zhenfeng Liu, Wentao Jiang, Guohang Yan, Xing Gao, Botian Shi, Si Liu, Xinyu Cai

Employing data augmentation methods to enhance perception performance in adverse weather has attracted considerable attention recently. Most of the LiDAR augmentation methods post-process the existing dataset by physics-based models or machine-learning methods. However, due to the limited environmental annotations and the fixed vehicle trajectories in the existing dataset, it is challenging to edit the scene and expand the diversity of traffic flow and scenario. To this end, we propose a simulator-based physical modeling approach to augment LiDAR data in rainy weather in order to improve the perception performance of LiDAR in this scenario. We complete the modeling task of the rainy weather in the CARLA simulator and establish a pipeline for LiDAR data collection. In particular, we pay special attention to the spray and splash rolled up by the wheels of surrounding vehicles in rain and complete the simulation of this special scenario through the Spray Emitter method we developed. In addition, we examine the influence of different weather conditions on the intensity of the LiDAR echo, develop a prediction network for the intensity of the LiDAR echo, and complete the simulation of 4-feat LiDAR point cloud data. In the experiment, we observe that the model augmented by the synthetic data improves the object detection task's performance in the rainy sequence of the Waymo Open Dataset. Both the code and the dataset will be made publicly available at https://github.com/PJLab-ADG/PCSim#rainypcsim.

📄 PDF Abstract BibTeX arXiv:2312.12772

Code (1)

pjlab-adg/pcsim 공식 구현 pytorch

Tasks

Data Augmentationobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

SPLASH Please enter a description about the method here
Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…
CARLA CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous urban…

Similar Papers 제목 키워드 기반

Enhancing autonomous vehicle safety in rain: a data-centric approach for clear vision

2024-12-29 · Mark A. Seferian, Jidong J. Yang

Autonomous vehicles face significant challenges in navigating adverse weather, particularly rain, due to the visual impairment of camera-based systems. In this study, we leveraged contemporary deep learning techniques to…

Autonomous VehiclesDecoder

Sunshine to Rainstorm: Cross-Weather Knowledge Distillation for Robust 3D Object Detection

2024-02-28 · Xun Huang, Hai Wu, Xin Li, Xiaoliang Fan 외

LiDAR-based 3D object detection models have traditionally struggled under rainy conditions due to the degraded and noisy scanning signals. Previous research has attempted to address this by simulating the noise from rain…

3D Object DetectionKnowledge Distillationobject-detectionObject Detection+1

Adver-City: Open-Source Multi-Modal Dataset for Collaborative Perception Under Adverse Weather Conditions

2024-10-08 · Mateus Karvat, Sidney Givigi

Adverse weather conditions pose a significant challenge to the widespread adoption of Autonomous Vehicles (AVs) by impacting sensors like LiDARs and cameras. Even though Collaborative Perception (CP) improves AV percepti…

Autonomous VehiclesObjectobject-detectionObject Detection+1

CARLA-Round: A Multi-Factor Simulation Dataset for Roundabout Trajectory Prediction

2026-01-17 · Xiaotong Zhou, Zhenhui Yuan, Yi Han, Tianhua Xu 외 arxiv

Accurate trajectory prediction of vehicles at roundabouts is critical for reducing traffic accidents, yet it remains highly challenging due to their circular road geometry, continuous merging and yielding interactions, a…

Trajectory Prediction

Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Driving

2024-06-06 · Xiaosong Jia, Zhenjie Yang, QiFeng Li, Zhiyuan Zhang 외

In an era marked by the rapid scaling of foundation models, autonomous driving technologies are approaching a transformative threshold where end-to-end autonomous driving (E2E-AD) emerges due to its potential of scaling …

Autonomous DrivingBench2DriveBenchmarking