paper-with-me

Papers

Self-Localized Collaborative Perception

2024-06-18 · Zhenyang Ni, Zixing Lei, Yifan Lu, Dingju Wang, Chen Feng, Yanfeng Wang, Siheng Chen

Collaborative perception has garnered considerable attention due to its capacity to address several inherent challenges in single-agent perception, including occlusion and out-of-range issues. However, existing collaborative perception systems heavily rely on precise localization systems to establish a consistent spatial coordinate system between agents. This reliance makes them susceptible to large pose errors or malicious attacks, resulting in substantial reductions in perception performance. To address this, we propose~$\mathtt{CoBEVGlue}$, a novel self-localized collaborative perception system, which achieves more holistic and robust collaboration without using an external localization system. The core of~$\mathtt{CoBEVGlue}$ is a novel spatial alignment module, which provides the relative poses between agents by effectively matching co-visible objects across agents. We validate our method on both real-world and simulated datasets. The results show that i) $\mathtt{CoBEVGlue}$ achieves state-of-the-art detection performance under arbitrary localization noises and attacks; and ii) the spatial alignment module can seamlessly integrate with a majority of previous methods, enhancing their performance by an average of $57.7\%$. Code is available at https://github.com/VincentNi0107/CoBEVGlue

📄 PDF Abstract BibTeX arXiv:2406.12712

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

DOLPHINS: Dataset for Collaborative Perception enabled Harmonious and Interconnected Self-driving

2022-07-15 · Ruiqing Mao, Jingyu Guo, Yukuan Jia, Yuxuan Sun 외

Vehicle-to-Everything (V2X) network has enabled collaborative perception in autonomous driving, which is a promising solution to the fundamental defect of stand-alone intelligence including blind zones and long-range per…

Autonomous DrivingObject Detection

LPAC: Learnable Perception-Action-Communication Loops with Applications to Coverage Control

2024-01-10 · Saurav Agarwal, Ramya Muthukrishnan, Walker Gosrich, Vijay Kumar 외

Coverage control is the problem of navigating a robot swarm to collaboratively monitor features or a phenomenon of interest not known a priori. The problem is challenging in decentralized settings with robots that have l…

Graph Neural NetworkImitation Learning

Leveraging V2X for Collaborative HD Maps Construction Using Scene Graph Generation

2025-02-14 · Gamal Elghazaly, Raphael Frank

High-Definition (HD) maps play a crucial role in autonomous vehicle navigation, complementing onboard perception sensors for improved accuracy and safety. Traditional HD map generation relies on dedicated mapping vehicle…

Graph GenerationScene Graph Generation

Uncertainty Quantification of Collaborative Detection for Self-Driving

2022-09-16 · Sanbao Su, Yiming Li, Sihong He, Songyang Han 외

Sharing information between connected and autonomous vehicles (CAVs) fundamentally improves the performance of collaborative object detection for self-driving. However, CAVs still have uncertainties on object detection d…

Autonomous VehiclesObjectobject-detectionObject Detection+1

SafeGuard: A Multi-Agent Perception-Reasoning Framework for Social-Risk AI-Generated Video Detection

2026-07-03 · Wenlin Wu, Sheng Zhou, Peipei Song, Wenhao Wang 외 arxiv

As video generation paradigms evolve from localized manipulation to full-scene synthesis, AI-generated video detection becomes increasingly challenging, as forgeries exhibit coherent global structure and high perceptual …

Video Generation