PatchBatch: a Batch Augmented Loss for Optical Flow
We propose a new pipeline for optical flow computation, based on Deep Learning techniques. We suggest using a Siamese CNN to independently, and in parallel, compute the descriptors of both images. The learned descriptors are then compared efficiently using the L2 norm and do not require network processing of patch pairs. The success of the method is based on an innovative loss function that computes higher moments of the loss distributions for each training batch. Combined with an Approximate Nearest Neighbor patch matching method and a flow interpolation technique, state of the art performance is obtained on the most challenging and competitive optical flow benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Optical Flow EstimationPatch MatchingSimilar Papers 제목 키워드 기반
MARS: Motion-Augmented RGB Stream for Action Recognition
Most state-of-the-art methods for action recognition consist of a two-stream architecture with 3D convolutions: an appearance stream for RGB frames and a motion stream for optical flow frames. Although combining flow wi…
Action ClassificationAction RecognitionOptical Flow EstimationTemporal Action LocalizationEvolvement Constrained Adversarial Learning for Video Style Transfer
Video style transfer is a useful component for applications such as augmented reality, non-photorealistic rendering, and interactive games. Many existing methods use optical flow to preserve the temporal smoothness of th…
Generative Adversarial NetworkOptical Flow EstimationStyle TransferVideo Style TransferOptical Flow in Dense Foggy Scenes using Semi-Supervised Learning
In dense foggy scenes, existing optical flow methods are erroneous. This is due to the degradation caused by dense fog particles that break the optical flow basic assumptions such as brightness and gradient constancy. To…
Optical Flow EstimationNccFlow: Unsupervised Learning of Optical Flow With Non-occlusion from Geometry
Optical flow estimation is a fundamental problem of computer vision and has many applications in the fields of robot learning and autonomous driving. This paper reveals novel geometric laws of optical flow based on the i…
Autonomous DrivingBlockingOptical Flow EstimationStreamFlow: Streamlined Multi-Frame Optical Flow Estimation for Video Sequences
Occlusions between consecutive frames have long posed a significant challenge in optical flow estimation. The inherent ambiguity introduced by occlusions directly violates the brightness constancy constraint and consider…
Optical Flow Estimation