What Matters in Unsupervised Optical Flow
We systematically compare and analyze a set of key components in unsupervised optical flow to identify which photometric loss, occlusion handling, and smoothness regularization is most effective. Alongside this investigation we construct a number of novel improvements to unsupervised flow models, such as cost volume normalization, stopping the gradient at the occlusion mask, encouraging smoothness before upsampling the flow field, and continual self-supervision with image resizing. By combining the results of our investigation with our improved model components, we are able to present a new unsupervised flow technique that significantly outperforms the previous unsupervised state-of-the-art and performs on par with supervised FlowNet2 on the KITTI 2015 dataset, while also being significantly simpler than related approaches.
Code (5)
Tasks
Occlusion HandlingOptical Flow EstimationSimilar Papers 제목 키워드 기반
FlowDA: Unsupervised Domain Adaptive Framework for Optical Flow Estimation
Collecting real-world optical flow datasets is a formidable challenge due to the high cost of labeling. A shortage of datasets significantly constrains the real-world performance of optical flow models. Building virtual …
Dataset GenerationOptical Flow EstimationNccFlow: Unsupervised Learning of Optical Flow With Non-occlusion from Geometry
Optical flow estimation is a fundamental problem of computer vision and has many applications in the fields of robot learning and autonomous driving. This paper reveals novel geometric laws of optical flow based on the i…
Autonomous DrivingBlockingOptical Flow EstimationGuess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motion
Motion, measured via optical flow, provides a powerful cue to discover and learn objects in images and videos. However, compared to using appearance, it has some blind spots, such as the fact that objects become invisibl…
Image SegmentationOptical Flow EstimationSegmentationSemantic Segmentation+4Joint Unsupervised Learning of Optical Flow and Egomotion with Bi-Level Optimization
We address the problem of joint optical flow and camera motion estimation in rigid scenes by incorporating geometric constraints into an unsupervised deep learning framework. Unlike existing approaches which rely on brig…
Motion EstimationOptical Flow EstimationCoT-AMFlow: Adaptive Modulation Network with Co-Teaching Strategy for Unsupervised Optical Flow Estimation
The interpretation of ego motion and scene change is a fundamental task for mobile robots. Optical flow information can be employed to estimate motion in the surroundings. Recently, unsupervised optical flow estimation h…
Optical Flow Estimation