EEPNet: Efficient Edge Pixel-based Matching Network for Cross-Modal Dynamic Registration between LiDAR and Camera
Multisensor fusion is essential for autonomous vehicles to accurately perceive, analyze, and plan their trajectories within complex environments. This typically involves the integration of data from LiDAR sensors and cameras, which necessitates high-precision and real-time registration. Current methods for registering LiDAR point clouds with images face significant challenges due to inherent modality differences and computational overhead. To address these issues, we propose EEPNet, an advanced network that leverages reflectance maps obtained from point cloud projections to enhance registration accuracy. The introduction of point cloud projections substantially mitigates cross-modality differences at the network input level, while the inclusion of reflectance data improves performance in scenarios with limited spatial information of point cloud within the camera's field of view. Furthermore, by employing edge pixels for feature matching and incorporating an efficient matching optimization layer, EEPNet markedly accelerates real-time registration tasks. Experimental validation demonstrates that EEPNet achieves superior accuracy and efficiency compared to state-of-the-art methods. Our contributions offer significant advancements in autonomous perception systems, paving the way for robust and efficient sensor fusion in real-world applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesSensor FusionSimilar Papers 제목 키워드 기반
MC2SleepNet: Multi-modal Cross-masking with Contrastive Learning for Sleep Stage Classification
Sleep profoundly affects our health, and sleep deficiency or disorders can cause physical and mental problems. Despite significant findings from previous studies, challenges persist in optimizing deep learning models, es…
Contrastive LearningEEGSleep Stage DetectionULW-SleepNet: An Ultra-Lightweight Network for Multimodal Sleep Stage Scoring
Automatic sleep stage scoring is crucial for the diagnosis and treatment of sleep disorders. Although deep learning models have advanced the field, many existing models are computationally demanding and designed for sing…
SalientSleepNet: Multimodal Salient Wave Detection Network for Sleep Staging
Sleep staging is fundamental for sleep assessment and disease diagnosis. Although previous attempts to classify sleep stages have achieved high classification performance, several challenges remain open: 1) How to effect…
object-detectionObject DetectionSalient Object DetectionSleep StagingToward Foundational Model for Sleep Analysis Using a Multimodal Hybrid Self-Supervised Learning Framework
Sleep is essential for maintaining human health and quality of life. Analyzing physiological signals during sleep is critical in assessing sleep quality and diagnosing sleep disorders. However, manual diagnoses by clinic…
Contrastive LearningDiagnosticEEGElectroencephalogram (EEG)+6DistillMatch: Leveraging Knowledge Distillation from Vision Foundation Model for Multimodal Image Matching
Multimodal image matching seeks pixel-level correspondences between images of different modalities, crucial for cross-modal perception, fusion and analysis. However, the significant appearance differences between modalit…
Knowledge DistillationData AugmentationImage Matching