Continuous-Time Gaussian Process Motion-Compensation for Event-vision Pattern Tracking with Distance Fields
This work addresses the issue of motion compensation and pattern tracking in event camera data. An event camera generates asynchronous streams of events triggered independently by each of the pixels upon changes in the observed intensity. Providing great advantages in low-light and rapid-motion scenarios, such unconventional data present significant research challenges as traditional vision algorithms are not directly applicable to this sensing modality. The proposed method decomposes the tracking problem into a local SE(2) motion-compensation step followed by a homography registration of small motion-compensated event batches. The first component relies on Gaussian Process (GP) theory to model the continuous occupancy field of the events in the image plane and embed the camera trajectory in the covariance kernel function. In doing so, estimating the trajectory is done similarly to GP hyperparameter learning by maximising the log marginal likelihood of the data. The continuous occupancy fields are turned into distance fields and used as templates for homography-based registration. By benchmarking the proposed method against other state-of-the-art techniques, we show that our open-source implementation performs high-accuracy motion compensation and produces high-quality tracks in real-world scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingMotion CompensationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Gaussian Splatting on the Move: Blur and Rolling Shutter Compensation for Natural Camera Motion
High-quality scene reconstruction and novel view synthesis based on Gaussian Splatting (3DGS) typically require steady, high-quality photographs, often impractical to capture with handheld cameras. We present a method th…
3DGSNovel View SynthesisExit Incentives for Carbon Emissive Firms
We develop a continuous-time model of incentives for carbon emissive firms to exit the market based on a compensation payment identical to all firms. In our model, firms enjoy profits from production modeled as a simple …
Real-Time Video Deblurring via Lightweight Motion Compensation
While motion compensation greatly improves video deblurring quality, separately performing motion compensation and video deblurring demands huge computational overhead. This paper proposes a real-time video deblurring fr…
DeblurringMotion CompensationVideo DeblurringProbabilistic prediction of the heave motions of a semi-submersible by a deep learning problem model
The real-time motion prediction of a floating offshore platform refers to forecasting its motions in the following one- or two-wave cycles, which helps improve the performance of a motion compensation system and provides…
Motion Compensationmotion predictionTime SeriesTime Series Analysis4D-MoDe: Towards Editable and Scalable Volumetric Streaming via Motion-Decoupled 4D Gaussian Compression
Volumetric video has emerged as a key medium for immersive telepresence and augmented/virtual reality, enabling six-degrees-of-freedom (6DoF) navigation and realistic spatial interactions. However, delivering high-qualit…