Visual Odometry with an Event Camera Using Continuous Ray Warping and Volumetric Contrast Maximization
We present a new solution to tracking and mapping with an event camera. The motion of the camera contains both rotation and translation, and the displacements happen in an arbitrarily structured environment. As a result, the image matching may no longer be represented by a low-dimensional homographic warping, thus complicating an application of the commonly used Image of Warped Events (IWE). We introduce a new solution to this problem by performing contrast maximization in 3D. The 3D location of the rays cast for each event is smoothly varied as a function of a continuous-time motion parametrization, and the optimal parameters are found by maximizing the contrast in a volumetric ray density field. Our method thus performs joint optimization over motion and structure. The practical validity of our approach is supported by an application to AGV motion estimation and 3D reconstruction with a single vehicle-mounted event camera. The method approaches the performance obtained with regular cameras, and eventually outperforms in challenging visual conditions.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionMotion EstimationTranslationVisual OdometrySimilar Papers 제목 키워드 기반
DEVO: Depth-Event Camera Visual Odometry in Challenging Conditions
We present a novel real-time visual odometry framework for a stereo setup of a depth and high-resolution event camera. Our framework balances accuracy and robustness against computational efficiency towards strong perfor…
Computational EfficiencyVisual OdometryContinuous-Time Visual-Inertial Odometry for Event Cameras
Event cameras are bio-inspired vision sensors that output pixel-level brightness changes instead of standard intensity frames. They offer significant advantages over standard cameras, namely a very high dynamic range, no…
Visual OdometryEvent-based Sensor Fusion and Application on Odometry: A Survey
Event cameras, inspired by biological vision, are asynchronous sensors that detect changes in brightness, offering notable advantages in environments characterized by high-speed motion, low lighting, or wide dynamic rang…
Sensor FusionSurveyEvent-based Stereo Visual Odometry with Native Temporal Resolution via Continuous-time Gaussian Process Regression
Event-based cameras asynchronously capture individual visual changes in a scene. This makes them more robust than traditional frame-based cameras to highly dynamic motions and poor illumination. It also means that every …
regressionVisual OdometryAsynchronous Optimisation for Event-based Visual Odometry
Event cameras open up new possibilities for robotic perception due to their low latency and high dynamic range. On the other hand, developing effective event-based vision algorithms that fully exploit the beneficial prop…
Event-based visionVisual Odometry