Adaptive Communications in Collaborative Perception with Domain Alignment for Autonomous Driving
Collaborative perception among multiple connected and autonomous vehicles can greatly enhance perceptive capabilities by allowing vehicles to exchange supplementary information via communications. Despite advances in previous approaches, challenges still remain due to channel variations and data heterogeneity among collaborative vehicles. To address these issues, we propose ACC-DA, a channel-aware collaborative perception framework to dynamically adjust the communication graph and minimize the average transmission delay while mitigating the side effects from the data heterogeneity. Our novelties lie in three aspects. We first design a transmission delay minimization method, which can construct the communication graph and minimize the transmission delay according to different channel information state. We then propose an adaptive data reconstruction mechanism, which can dynamically adjust the rate-distortion trade-off to enhance perception efficiency. Moreover, it minimizes the temporal redundancy during data transmissions. Finally, we conceive a domain alignment scheme to align the data distribution from different vehicles, which can mitigate the domain gap between different vehicles and improve the performance of the target task. Comprehensive experiments demonstrate the effectiveness of our method in comparison to the existing state-of-the-art works.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingAutonomous VehiclesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
When Large Language Model Agents Meet 6G Networks: Perception, Grounding, and Alignment
AI agents based on multimodal large language models (LLMs) are expected to revolutionize human-computer interaction and offer more personalized assistant services across various domains like healthcare, education, manufa…
Integrated sensing and communicationLanguage ModelingLanguage ModellingLarge Language ModelNegoCollab: A Common Representation Negotiation Approach for Heterogeneous Collaborative Perception
Collaborative perception improves task performance by expanding the perception range through information sharing among agents. . Immutable heterogeneity poses a significant challenge in collaborative perception, as parti…
CoDS: Enhancing Collaborative Perception in Heterogeneous Scenarios via Domain Separation
Collaborative perception has been proven to improve individual perception in autonomous driving through multi-agent interaction. Nevertheless, most methods often assume identical encoders for all agents, which does not h…
Autonomous DrivingDomain AdaptationBeyond BEV: Optimizing Point-Level Tokens for Collaborative Perception
Collaborative perception allows agents to enhance their perceptual capabilities by exchanging intermediate features. Existing methods typically organize these intermediate features as 2D bird's-eye-view (BEV) representat…
Object RecognitionV2X-DGPE: Addressing Domain Gaps and Pose Errors for Robust Collaborative 3D Object Detection
In V2X collaborative perception, the domain gaps between heterogeneous nodes pose a significant challenge for effective information fusion. Pose errors arising from latency and GPS localization noise further exacerbate t…
3D Object DetectionKnowledge Distillationobject-detectionObject Detection