Imposing Consistency for Optical Flow Estimation
Imposing consistency through proxy tasks has been shown to enhance data-driven learning and enable self-supervision in various tasks. This paper introduces novel and effective consistency strategies for optical flow estimation, a problem where labels from real-world data are very challenging to derive. More specifically, we propose occlusion consistency and zero forcing in the forms of self-supervised learning and transformation consistency in the form of semi-supervised learning. We apply these consistency techniques in a way that the network model learns to describe pixel-level motions better while requiring no additional annotations. We demonstrate that our consistency strategies applied to a strong baseline network model using the original datasets and labels provide further improvements, attaining the state-of-the-art results on the KITTI-2015 scene flow benchmark in the non-stereo category. Our method achieves the best foreground accuracy (4.33% in Fl-all) over both the stereo and non-stereo categories, even though using only monocular image inputs.
Code (0)
등록된 구현이 없습니다.
Tasks
Optical Flow EstimationSelf-Supervised LearningSimilar Papers 제목 키워드 기반
UnOS: Unified Unsupervised Optical-Flow and Stereo-Depth Estimation by Watching Videos
In this paper, we propose UnOS, an unified system for unsupervised optical flow and stereo depth estimation using convolutional neural network (CNN) by taking advantages of their inherent geometrical consistency based on…
Depth EstimationMotion SegmentationOptical Flow EstimationStereo Depth Estimation+1Self-Supervised Flow Estimation using Geometric Regularization with Applications to Camera Image and Grid Map Sequences
We present a self-supervised approach to estimate flow in camera image and top-view grid map sequences using fully convolutional neural networks in the domain of automated driving. We extend existing approaches for self-…
Optical Flow EstimationScene Flow EstimationEvery Frame Counts: Joint Learning of Video Segmentation and Optical Flow
A major challenge for video semantic segmentation is the lack of labeled data. In most benchmark datasets, only one frame of a video clip is annotated, which makes most supervised methods fail to utilize information from…
Optical Flow EstimationSegmentationSemantic SegmentationVideo Segmentation+1$\mathrm{F^2Depth}$: Self-supervised Indoor Monocular Depth Estimation via Optical Flow Consistency and Feature Map Synthesis
Self-supervised monocular depth estimation methods have been increasingly given much attention due to the benefit of not requiring large, labelled datasets. Such self-supervised methods require high-quality salient featu…
Depth EstimationIndoor Monocular Depth EstimationMonocular Depth EstimationOptical Flow Estimation+1OCAI: Improving Optical Flow Estimation by Occlusion and Consistency Aware Interpolation
The scarcity of ground-truth labels poses one major challenge in developing optical flow estimation models that are both generalizable and robust. While current methods rely on data augmentation, they have yet to fully e…
Data AugmentationMissing ValuesOptical Flow Estimation