DEVO: Depth-Event Camera Visual Odometry in Challenging Conditions
We present a novel real-time visual odometry framework for a stereo setup of a depth and high-resolution event camera. Our framework balances accuracy and robustness against computational efficiency towards strong performance in challenging scenarios. We extend conventional edge-based semi-dense visual odometry towards time-surface maps obtained from event streams. Semi-dense depth maps are generated by warping the corresponding depth values of the extrinsically calibrated depth camera. The tracking module updates the camera pose through efficient, geometric semi-dense 3D-2D edge alignment. Our approach is validated on both public and self-collected datasets captured under various conditions. We show that the proposed method performs comparable to state-of-the-art RGB-D camera-based alternatives in regular conditions, and eventually outperforms in challenging conditions such as high dynamics or low illumination.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyVisual OdometrySimilar Papers 제목 키워드 기반
Deep Visual Odometry for Stereo Event Cameras
Event-based cameras are bio-inspired sensors with pixels that independently and asynchronously respond to brightness changes at microsecond resolution, offering the potential to handle state estimation tasks involving mo…
Optical Flow EstimationDepth EstimationPose EstimationVisual OdometryDeep Event Visual Odometry
Event cameras offer the exciting possibility of tracking the camera's pose during high-speed motion and in adverse lighting conditions. Despite this promise, existing event-based monocular visual odometry (VO) approaches…
Monocular Visual OdometryPose TrackingVisual OdometryExtending Deep Event Visual Odometry with Sparse Point-Cloud Export
Event cameras are well suited for visual odometry under high-speed motion and challenging lighting conditions due to their low latency, high temporal resolution, and high dynamic range. Deep Event Visual Odometry (DEVO) …
Visual OdometryEdged USLAM: Edge-Aware Event-Based SLAM with Learning-Based Depth Priors
Conventional visual simultaneous localization and mapping (SLAM) algorithms often fail under rapid motion, low illumination, or abrupt lighting transitions due to motion blur and limited dynamic range. Event cameras miti…
Visual OdometryEvent-based Stereo Visual Odometry
Event-based cameras are bio-inspired vision sensors whose pixels work independently from each other and respond asynchronously to brightness changes, with microsecond resolution. Their advantages make it possible to tack…
3D ReconstructionCamera Pose EstimationCPUPose Estimation+1