Layered Optical Flow Estimation Using a Deep Neural Network with a Soft Mask
Using a layered representation for motion estimation has the advantage of being able to cope with discontinuities and occlusions. In this paper, we learn to estimate optical flow by combining a layered motion representation with deep learning. Instead of pre-segmenting the image to layers, the proposed approach automatically generates a layered representation of optical flow using the proposed soft-mask module. The essential components of the soft-mask module are maxout and fuse operations, which enable a disjoint layered representation of optical flow and more accurate flow estimation. We show that by using masks the motion estimate results in a quadratic function of input features in the output layer. The proposed soft-mask module can be added to any existing optical flow estimation networks by replacing their flow output layer. In this work, we use FlowNet as the base network to which we add the soft-mask module. The resulting network is tested on three well-known benchmarks with both supervised and unsupervised flow estimation tasks. Evaluation results show that the proposed network achieve better results compared with the original FlowNet.
Code (0)
등록된 구현이 없습니다.
Tasks
Motion EstimationOptical Flow EstimationSimilar Papers 제목 키워드 기반
Efficient Sparse-to-Dense Optical Flow Estimation Using a Learned Basis and Layers
We address the elusive goal of estimating optical flow both accurately and efficiently by adopting a sparse-to-dense approach. Given a set of sparse matches, we regress to dense optical flow using a learned set of full-f…
CPUOptical Flow EstimationMaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Mask
Feature warping is a core technique in optical flow estimation; however, the ambiguity caused by occluded areas during warping is a major problem that remains unsolved. In this paper, we propose an asymmetric occlusion-a…
Optical Flow EstimationLayered RGBD Scene Flow Estimation
As consumer depth sensors become widely available, estimating scene flow from RGBD sequences has received increasing attention. Although the depth information allows the recovery of 3D motion from a single view, it poses…
Optical Flow EstimationScene Flow EstimationScene SegmentationAmodal Optical Flow
Optical flow estimation is very challenging in situations with transparent or occluded objects. In this work, we address these challenges at the task level by introducing Amodal Optical Flow, which integrates optical flo…
DecoderOptical Flow EstimationPanoptic TrackingLayeredFlow: A Real-World Benchmark for Non-Lambertian Multi-Layer Optical Flow
Achieving 3D understanding of non-Lambertian objects is an important task with many useful applications, but most existing algorithms struggle to deal with such objects. One major obstacle towards progress in this field …
DiversityOptical Flow Estimation