Tracking 6-DoF Object Motion from Events and Frames
Event cameras are promising devices for lowlatency tracking and high-dynamic range imaging. In this paper,we propose a novel approach for 6 degree-of-freedom (6-DoF)object motion tracking that combines measurements of eventand frame-based cameras. We formulate tracking from highrate events with a probabilistic generative model of the eventmeasurement process of the object. On a second layer, we refinethe object trajectory in slower rate image frames through directimage alignment. We evaluate the accuracy of our approach inseveral object tracking scenarios with synthetic data, and alsoperform experiments with real data.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectObject TrackingSimilar Papers 제목 키워드 기반
End-to-end Learning of Object Motion Estimation from Retinal Events for Event-based Object Tracking
Event cameras, which are asynchronous bio-inspired vision sensors, have shown great potential in computer vision and artificial intelligence. However, the application of event cameras to object-level motion estimation or…
Motion EstimationObjectObject TrackingregressionTETO: Tracking Events with Teacher Observation for Motion Estimation and Frame Interpolation
Event cameras capture per-pixel brightness changes with microsecond resolution, offering continuous motion information lost between RGB frames. However, existing event-based motion estimators depend on large-scale synthe…
Knowledge DistillationPoint TrackingTAPFormer: Robust Arbitrary Point Tracking via Transient Asynchronous Fusion of Frames and Events
Tracking any point (TAP) is a fundamental yet challenging task in computer vision, requiring high precision and long-term motion reasoning. Recent attempts to combine RGB frames and event streams have shown promise, yet …
Point TrackingAsynchronous Tracking-by-Detection on Adaptive Time Surfaces for Event-based Object Tracking
Event cameras, which are asynchronous bio-inspired vision sensors, have shown great potential in a variety of situations, such as fast motion and low illumination scenes. However, most of the event-based object tracking …
ObjectObject TrackingTimeTracker: Event-based Continuous Point Tracking for Video Frame Interpolation with Non-linear Motion
Video frame interpolation (VFI) that leverages the bio-inspired event cameras as guidance has recently shown better performance and memory efficiency than the frame-based methods, thanks to the event cameras' advantages,…
Motion EstimationOptical Flow EstimationPoint TrackingVideo Frame Interpolation