paper-with-me

홈 › Papers

LEAR: Learning Edge-Aware Representations for Event-to-LiDAR Localization

2026-03-02 · Kuangyi Chen, Jun Zhang, Yuxi Hu, Yi Zhou, Friedrich Fraundorfer arxiv

Event cameras offer high-temporal-resolution sensing that remains reliable under high-speed motion and challenging lighting, making them promising for localization from LiDAR point clouds in GPS-denied and visually degraded environments. However, aligning sparse, asynchronous events with dense LiDAR maps is fundamentally ill-posed, as direct correspondence estimation suffers from modality gaps. We propose LEAR, a dual-task learning framework that jointly estimates edge structures and dense event-depth flow fields to bridge the sensing-modality divide. Instead of treating edges as a post-hoc aid, LEAR couples them with flow estimation through a cross-modal fusion mechanism that injects modality-invariant geometric cues into the motion representation, and an iterative refinement strategy that enforces mutual consistency between the two tasks over multiple update steps. This synergy produces edge-aware, depth-aligned flow fields that enable more robust and accurate pose recovery via Perspective-n-Point (PnP) solvers. On several popular and challenging datasets, LEAR achieves superior performance over the best prior method. The source code, trained models, and demo videos are made publicly available online.

📄 PDF Abstract BibTeX arXiv:2603.01839

Code (0)

등록된 구현이 없습니다.

Tasks

Point Clouds

Similar Papers 제목 키워드 기반

$x^2$-Fusion: Cross-Modality and Cross-Dimension Flow Estimation in Event Edge Space

2026-03-17 · Ruishan Guo, Ciyu Ruan, Haoyang Wang, Zihang Gong 외 arxiv

Estimating dense 2D optical flow and 3D scene flow is essential for dynamic scene understanding. Recent work combines images, LiDAR, and event data to jointly predict 2D and 3D motion, yet most approaches operate in sepa…

Scene Understanding

Comprehensive Event Representations using Event Knowledge Graphs and Natural Language Processing

2023-03-08 · Tin Kuculo

Recent work has utilised knowledge-aware approaches to natural language understanding, question answering, recommendation systems, and other tasks. These approaches rely on well-constructed and large-scale knowledge grap…

Event ExtractionKnowledge Graph CompletionKnowledge GraphsNatural Language Understanding+3

LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detector

2021-08-18 · ICCV 2021 10 · Xiaoyang Guo, Shaoshuai Shi, Xiaogang Wang, Hongsheng Li

Stereo-based 3D detection aims at detecting 3D object bounding boxes from stereo images using intermediate depth maps or implicit 3D geometry representations, which provides a low-cost solution for 3D perception. However…

3D geometry3D Object Detection From Stereo ImagesStereo Matching

Bring Event into RGB and LiDAR: Hierarchical Visual-Motion Fusion for Scene Flow

2024-03-12 · CVPR 2024 1 · Hanyu Zhou, Yi Chang, Zhiwei Shi, Luxin Yan

Single RGB or LiDAR is the mainstream sensor for the challenging scene flow, which relies heavily on visual features to match motion features. Compared with single modality, existing methods adopt a fusion strategy to di…

IMKD: Intensity-Aware Multi-Level Knowledge Distillation for Camera-Radar Fusion

2025-12-17 · Shashank Mishra, Karan Patil, Didier Stricker, Jason Rambach arxiv

High-performance Radar-Camera 3D object detection can be achieved by leveraging knowledge distillation without using LiDAR at inference time. However, existing distillation methods typically transfer modality-specific fe…

Knowledge Distillation3D Object Detection