On the Geometry of Learned Representations in Event-Based Multi-Modal Egomotion Estimation
Classical approaches to event-based egomotion estimation, including those adopted by the top-performing teams of the ELOPE challenge, rely on geometric optimization frameworks such as contrast maximization, homography estimation, or dense optical flow combined with analytic motion inversion. This work investigates the geometric structure that emerges inside a multi-modal network for egomotion estimation. Event tensors, inertial measurements, and range signals are fused through a cross-modal attention architecture and trained in a batch setting. We analyze the latent space geometry and attention dynamics, showing that (i) embeddings lie on low-dimensional manifolds aligned with motion variables, (ii) attention weights adapt with angular excitation and visual reliability, and (iii) the fused representation recovers classical observability cues. These results bridge analytical estimation theory and modern data-driven fusion.
Code (0)
등록된 구현이 없습니다.
Tasks
Homography EstimationSimilar Papers 제목 키워드 기반
Multimodal Sparse Coding for Event Detection
Unsupervised feature learning methods have proven effective for classification tasks based on a single modality. We present multimodal sparse coding for learning feature representations shared across multiple modalities.…
ClassificationEvent DetectionGeneral ClassificationDiverse via bounded Agreement: Geometric Regularization for Multimodal Fusion
Multimodal fusion is often treated as an optimization-balancing problem, where training signals are adjusted to prevent one modality from dominating the others. However, balanced optimization does not fully determine the…
Representation LearningEfficient Multi-Timescale Event Representations for Feed-Forward Object Detection
Autonomous systems require robust low-latency perception under rapidly changing scene dynamics and challenging illumination. In event cameras object detection commonly relies on recurrent architectures to accumulate spar…
Object DetectionxModel-KD: Cross-modal Knowledge Distillation for 3D Scene Perception using LiDAR
Point cloud segmentation is a fundamental task in 3D scene understanding. Its progress is constrained by the high cost and time required for dense 3D annotations, making labeled samples difficult to obtain. Beyond annota…
Point Cloud SegmentationKnowledge DistillationScene UnderstandingPoint CloudsEventFace: Event-Based Face Recognition via Structure-Driven Spatiotemporal Modeling
Event cameras offer a promising sensing modality for face recognition due to their inherent advantages in illumination robustness and privacy-friendliness. However, because event streams lack the stable photometric appea…
Face Recognition