Devon: Deformable Volume Network for Learning Optical Flow
State-of-the-art neural network models estimate large displacement optical flow in multi-resolution and use warping to propagate the estimation between two resolutions. Despite their impressive results, it is known that there are two problems with the approach. First, the multi-resolution estimation of optical flow fails in situations where small objects move fast. Second, warping creates artifacts when occlusion or dis-occlusion happens. In this paper, we propose a new neural network module, Deformable Cost Volume, which alleviates the two problems. Based on this module, we designed the Deformable Volume Network (Devon) which can estimate multi-scale optical flow in a single high resolution. Experiments show Devon is more suitable in handling small objects moving fast and achieves comparable results to the state-of-the-art methods in public benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Optical Flow EstimationSimilar Papers 제목 키워드 기반
PDWN: Pyramid Deformable Warping Network for Video Interpolation
Video interpolation aims to generate a non-existent intermediate frame given the past and future frames. Many state-of-the-art methods achieve promising results by estimating the optical flow between the known frames and…
Optical Flow EstimationFDAN: Flow-guided Deformable Alignment Network for Video Super-Resolution
Most Video Super-Resolution (VSR) methods enhance a video reference frame by aligning its neighboring frames and mining information on these frames. Recently, deformable alignment has drawn extensive attention in VSR com…
Optical Flow EstimationSuper-ResolutionVideo Super-ResolutionFlowReg: Fast Deformable Unsupervised Medical Image Registration using Optical Flow
We propose FlowReg, a deep learning-based framework for unsupervised image registration for neuroimaging applications. The system is composed of two architectures that are trained sequentially: FlowReg-A which affinely c…
AnatomyImage RegistrationMedical Image RegistrationOptical Flow Estimation+1Let Occ Flow: Self-Supervised 3D Occupancy Flow Prediction
Accurate perception of the dynamic environment is a fundamental task for autonomous driving and robot systems. This paper introduces Let Occ Flow, the first self-supervised work for joint 3D occupancy and occupancy flow …
Autonomous DrivingOptical Flow EstimationPredictionDeformable Non-local Network for Video Super-Resolution
The video super-resolution (VSR) task aims to restore a high-resolution (HR) video frame by using its corresponding low-resolution (LR) frame and multiple neighboring frames. At present, many deep learning-based VSR meth…
Optical Flow EstimationSuper-ResolutionVideo Super-Resolution