paper-with-me

Papers

CoMamba: Real-time Cooperative Perception Unlocked with State Space Models

2024-09-16 · Jinlong Li, Xinyu Liu, Baolu Li, Runsheng Xu, Jiachen Li, Hongkai Yu, Zhengzhong Tu

Cooperative perception systems play a vital role in enhancing the safety and efficiency of vehicular autonomy. Although recent studies have highlighted the efficacy of vehicle-to-everything (V2X) communication techniques in autonomous driving, a significant challenge persists: how to efficiently integrate multiple high-bandwidth features across an expanding network of connected agents such as vehicles and infrastructure. In this paper, we introduce CoMamba, a novel cooperative 3D detection framework designed to leverage state-space models for real-time onboard vehicle perception. Compared to prior state-of-the-art transformer-based models, CoMamba enjoys being a more scalable 3D model using bidirectional state space models, bypassing the quadratic complexity pain-point of attention mechanisms. Through extensive experimentation on V2X/V2V datasets, CoMamba achieves superior performance compared to existing methods while maintaining real-time processing capabilities. The proposed framework not only enhances object detection accuracy but also significantly reduces processing time, making it a promising solution for next-generation cooperative perception systems in intelligent transportation networks.

📄 PDF Abstract BibTeX arXiv:2409.10699

Code (1)

jinlong17/CoMamba pytorch

Tasks

Autonomous Drivingobject-detectionObject DetectionState Space Models

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

V2X-ReaLO: An Open Online Framework and Dataset for Cooperative Perception in Reality

2025-03-13 · Hao Xiang, Zhaoliang Zheng, Xin Xia, Seth Z. Zhao 외

Cooperative perception enabled by Vehicle-to-Everything (V2X) communication holds significant promise for enhancing the perception capabilities of autonomous vehicles, allowing them to overcome occlusions and extend thei…

Autonomous Vehicles

V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perception

2023-03-14 · CVPR 2023 1 · Runsheng Xu, Xin Xia, Jinlong Li, Hanzhao Li 외

Modern perception systems of autonomous vehicles are known to be sensitive to occlusions and lack the capability of long perceiving range. It has been one of the key bottlenecks that prevents Level 5 autonomy. Recent res…

3D Object Detection3D Object TrackingAutonomous DrivingAutonomous Vehicles+4

EI-Drive: A Platform for Cooperative Perception with Realistic Communication Models

2024-12-13 · Hanchu Zhou, Edward Xie, Wei Shao, Dechen Gao 외

The growing interest in autonomous driving calls for realistic simulation platforms capable of accurately simulating cooperative perception process in realistic traffic scenarios. Existing studies for cooperative percept…

Autonomous Driving

S2R-ViT for Multi-Agent Cooperative Perception: Bridging the Gap from Simulation to Reality

2023-07-16 · Jinlong Li, Runsheng Xu, Xinyu Liu, Baolu Li 외

Due to the lack of enough real multi-agent data and time-consuming of labeling, existing multi-agent cooperative perception algorithms usually select the simulated sensor data for training and validating. However, the pe…

3D Object Detectionobject-detectionObject DetectionTransfer Learning

Enhancing Indoor Mobility with Connected Sensor Nodes: A Real-Time, Delay-Aware Cooperative Perception Approach

2024-11-04 · Minghao Ning, Yaodong Cui, Yufeng Yang, Shucheng Huang 외

This paper presents a novel real-time, delay-aware cooperative perception system designed for intelligent mobility platforms operating in dynamic indoor environments. The system contains a network of multi-modal sensor n…