Accurate Optical Flow via Direct Cost Volume Processing
We present an optical flow estimation approach that operates on the full four-dimensional cost volume. This direct approach shares the structural benefits of leading stereo matching pipelines, which are known to yield high accuracy. To this day, such approaches have been considered impractical due to the size of the cost volume. We show that the full four-dimensional cost volume can be constructed in a fraction of a second due to its regularity. We then exploit this regularity further by adapting semi-global matching to the four-dimensional setting. This yields a pipeline that achieves significantly higher accuracy than state-of-the-art optical flow methods while being faster than most. Our approach outperforms all published general-purpose optical flow methods on both Sintel and KITTI 2015 benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Optical Flow EstimationStereo MatchingStereo Matching HandSimilar Papers 제목 키워드 기반
LiteFlowNet3: Resolving Correspondence Ambiguity for More Accurate Optical Flow Estimation
Deep learning approaches have achieved great success in addressing the problem of optical flow estimation. The keys to success lie in the use of cost volume and coarse-to-fine flow inference. However, the matching proble…
Optical Flow EstimationScene Flow EstimationDisplacement-Invariant Matching Cost Learning for Accurate Optical Flow Estimation
Learning matching costs has been shown to be critical to the success of the state-of-the-art deep stereo matching methods, in which 3D convolutions are applied on a 4D feature volume to learn a 3D cost volume. However, t…
Optical Flow EstimationStereo MatchingLearning Optical Flow from a Few Matches
State-of-the-art neural network models for optical flow estimation require a dense correlation volume at high resolutions for representing per-pixel displacement. Although the dense correlation volume is informative for …
Optical Flow EstimationRemoving Cost Volumes from Optical Flow Estimators
Cost volumes are used in every modern optical flow estimator, but due to their computational and space complexity, they are often a limiting factor regarding both processing speed and the resolution of input frames. Moti…
OAS-Net: Occlusion Aware Sampling Network for Accurate Optical Flow
Optical flow estimation is an essential step for many real-world computer vision tasks. Existing deep networks have achieved satisfactory results by mostly employing a pyramidal coarse-to-fine paradigm, where a key proce…
DecoderOptical Flow Estimation