CoMamba: Real-time Cooperative Perception Unlocked with State Space Models
Cooperative perception systems play a vital role in enhancing the safety and efficiency of vehicular autonomy. Although recent studies have highlighted the efficacy of vehicle-to-everything (V2X) communication techniques in autonomous driving, a significant challenge persists: how to efficiently integrate multiple high-bandwidth features across an expanding network of connected agents such as vehicles and infrastructure. In this paper, we introduce CoMamba, a novel cooperative 3D detection framework designed to leverage state-space models for real-time onboard vehicle perception. Compared to prior state-of-the-art transformer-based models, CoMamba enjoys being a more scalable 3D model using bidirectional state space models, bypassing the quadratic complexity pain-point of attention mechanisms. Through extensive experimentation on V2X/V2V datasets, CoMamba achieves superior performance compared to existing methods while maintaining real-time processing capabilities. The proposed framework not only enhances object detection accuracy but also significantly reduces processing time, making it a promising solution for next-generation cooperative perception systems in intelligent transportation networks.
Code (1)
Tasks
Autonomous Drivingobject-detectionObject DetectionState Space ModelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
V2X-ReaLO: An Open Online Framework and Dataset for Cooperative Perception in Reality
Cooperative perception enabled by Vehicle-to-Everything (V2X) communication holds significant promise for enhancing the perception capabilities of autonomous vehicles, allowing them to overcome occlusions and extend thei…
Autonomous VehiclesV2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perception
Modern perception systems of autonomous vehicles are known to be sensitive to occlusions and lack the capability of long perceiving range. It has been one of the key bottlenecks that prevents Level 5 autonomy. Recent res…
3D Object Detection3D Object TrackingAutonomous DrivingAutonomous Vehicles+4EI-Drive: A Platform for Cooperative Perception with Realistic Communication Models
The growing interest in autonomous driving calls for realistic simulation platforms capable of accurately simulating cooperative perception process in realistic traffic scenarios. Existing studies for cooperative percept…
Autonomous DrivingS2R-ViT for Multi-Agent Cooperative Perception: Bridging the Gap from Simulation to Reality
Due to the lack of enough real multi-agent data and time-consuming of labeling, existing multi-agent cooperative perception algorithms usually select the simulated sensor data for training and validating. However, the pe…
3D Object Detectionobject-detectionObject DetectionTransfer LearningEnhancing Indoor Mobility with Connected Sensor Nodes: A Real-Time, Delay-Aware Cooperative Perception Approach
This paper presents a novel real-time, delay-aware cooperative perception system designed for intelligent mobility platforms operating in dynamic indoor environments. The system contains a network of multi-modal sensor n…