ScopeFlow: Dynamic Scene Scoping for Optical Flow
We propose to modify the common training protocols of optical flow, leading to sizable accuracy improvements without adding to the computational complexity of the training process. The improvement is based on observing the bias in sampling challenging data that exists in the current training protocol, and improving the sampling process. In addition, we find that both regularization and augmentation should decrease during the training protocol. Using an existing low parameters architecture, the method is ranked first on the MPI Sintel benchmark among all other methods, improving the best two frames method accuracy by more than 10%. The method also surpasses all similar architecture variants by more than 12% and 19.7% on the KITTI benchmarks, achieving the lowest Average End-Point Error on KITTI2012 among two-frame methods, without using extra datasets.
Code (1)
Tasks
Optical Flow EstimationSimilar Papers 제목 키워드 기반
Upgrading Optical Flow to 3D Scene Flow Through Optical Expansion
We describe an approach for upgrading 2D optical flow to 3D scene flow. Our key insight is that dense optical expansion - which can be reliably inferred from monocular frame pairs - reveals changes in depth of scene elem…
Depth EstimationOptical Flow EstimationOptical flow and scene flow estimation: A survey
Motion analysis is one of the most fundamental and challenging problems in the field of computer vision, which can be widely applied in many areas, such as autonomous driving, action recognition, scene understanding, and…
Action RecognitionAutonomous DrivingDeep LearningOptical Flow Estimation+3Generalized Video Deblurring for Dynamic Scenes
Several state-of-the-art video deblurring methods are based on a strong assumption that the captured scenes are static. These methods fail to deblur blurry videos in dynamic scenes. We propose a video deblurring method t…
DeblurringOptical Flow EstimationVideo DeblurringSSTM: Spatiotemporal Recurrent Transformers for Multi-frame Optical Flow Estimation
Inaccurate optical flow estimates in and near occluded regions, and out-of-boundary regions are two of the current significant limitations of optical flow estimation algorithms. Recent state-of-the-art optical flow estim…
Optical Flow EstimationLearning Residual Flow as Dynamic Motion from Stereo Videos
We present a method for decomposing the 3D scene flow observed from a moving stereo rig into stationary scene elements and dynamic object motion. Our unsupervised learning framework jointly reasons about the camera motio…
Depth And Camera MotionMotion EstimationOptical Flow EstimationStereo Matching+2