Continuous Parametric Optical Flow
In this paper, we present continuous parametric optical flow, a parametric representation of dense and continuous motion over arbitrary time interval. In contrast to existing discrete-time representations (i.e., flow in between consecutive frames), this new representation transforms the frame-to-frame pixel correspondences to dense continuous flow. In particular, we present a temporal-parametric model that employs B-splines to fit point trajectories using a limited number of frames. To further improve the stability and robustness of the trajectories, we also add an encoder with a neural ordinary differential equation (ODE) to represent features associated with specific times. We also contribute a synthetic dataset and introduce two evaluation perspectives to measure the accuracy and robustness of continuous flow estimation. Benefiting from the combination of explicit parametric modeling and implicit feature optimization, our model focuses on motion continuity and outperforms than the flow-based and point-tracking approaches for fitting long-term and variable sequences.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Dense, Accurate Optical Flow Estimation With Piecewise Parametric Model
This paper proposes a simple method for estimating dense and accurate optical flow field. It revitalizes an early idea of piecewise parametric flow model. A key innovation is that, we fit a flow field piecewise to a vari…
Optical Flow EstimationLearning Dense and Continuous Optical Flow from an Event Camera
Event cameras such as DAVIS can simultaneously output high temporal resolution events and low frame-rate intensity images, which own great potential in capturing scene motion, such as optical flow estimation. Most of the…
Optical Flow EstimationAggregation of local parametric candidates with exemplar-based occlusion handling for optical flow
Handling all together large displacements, motion details and occlusions remains an open issue for reliable computation of optical flow in a video sequence. We propose a two-step aggregation paradigm to address this prob…
Occlusion HandlingOptical Flow EstimationDense Continuous-Time Optical Flow from Events and Frames
We present a method for estimating dense continuous-time optical flow from event data. Traditional dense optical flow methods compute the pixel displacement between two images. Due to missing information, these approache…
Optical Flow EstimationEM-driven unsupervised learning for efficient motion segmentation
In this paper, we present a CNN-based fully unsupervised method for motion segmentation from optical flow. We assume that the input optical flow can be represented as a piecewise set of parametric motion models, typicall…
Data AugmentationMotion SegmentationOptical Flow EstimationSegmentation+1