Autonomous Driving using Residual Sensor Fusion and Deep Reinforcement Learning
This paper proposes a novel approach by integrating sensor fusion with deep reinforcement learning, specifically the Soft Actor-Critic (SAC) algorithm, to develop an optimal control policy for self-driving cars. Our system employs a two-branch fusion method for vehicle image and tracking sensor data, leveraging the strengths of residual structures and identity mapping to enhance agent training. Through comprehensive comparisons, we demonstrate the efficacy of information fusion and establish the superiority of our selected algorithm over alternative approaches. Our work advances the field of autonomous driving and demonstrates the potential of reinforcement learning in enabling intelligent vehicle decision-making.
Code (2)
Tasks
Autonomous DrivingDecision MakingDeep Reinforcement Learningreinforcement-learningReinforcement LearningSelf-Driving CarsSensor FusionSimilar Papers 제목 키워드 기반
WAM-Diff: A Masked Diffusion VLA Framework with MoE and Online Reinforcement Learning for Autonomous Driving
End-to-end autonomous driving systems based on vision-language-action (VLA) models integrate multimodal sensor inputs and language instructions to generate planning and control signals. While autoregressive large languag…
Visual Question AnsweringReinforcement LearningAutonomous DrivingMmWave Radar and Vision Fusion for Object Detection in Autonomous Driving: A Review
With autonomous driving developing in a booming stage, accurate object detection in complex scenarios attract wide attention to ensure the safety of autonomous driving. Millimeter wave (mmWave) radar and vision fusion is…
3D Object DetectionAutonomous DrivingObjectobject-detection+2ReconDreamer-RL: Enhancing Reinforcement Learning via Diffusion-based Scene Reconstruction
Reinforcement learning for training end-to-end autonomous driving models in closed-loop simulations is gaining growing attention. However, most simulation environments differ significantly from real-world conditions, cre…
Reinforcement LearningAutonomous DrivingTransformer-Based Sensor Fusion for Autonomous Driving: A Survey
Sensor fusion is an essential topic in many perception systems, such as autonomous driving and robotics. Transformers-based detection head and CNN-based feature encoder to extract features from raw sensor-data has emerge…
3D Object DetectionAutonomous Drivingobject-detectionObject Detection+2Integrating Multi-Modal Sensors: A Review of Fusion Techniques for Intelligent Vehicles
Multi-sensor fusion plays a critical role in enhancing perception for autonomous driving, overcoming individual sensor limitations, and enabling comprehensive environmental understanding. This paper first formalizes mult…
Autonomous DrivingSensor Fusion