UPFlow: Upsampling Pyramid for Unsupervised Optical Flow Learning
We present an unsupervised learning approach for optical flow estimation by improving the upsampling and learning of pyramid network. We design a self-guided upsample module to tackle the interpolation blur problem caused by bilinear upsampling between pyramid levels. Moreover, we propose a pyramid distillation loss to add supervision for intermediate levels via distilling the finest flow as pseudo labels. By integrating these two components together, our method achieves the best performance for unsupervised optical flow learning on multiple leading benchmarks, including MPI-SIntel, KITTI 2012 and KITTI 2015. In particular, we achieve EPE=1.4 on KITTI 2012 and F1=9.38% on KITTI 2015, which outperform the previous state-of-the-art methods by 22.2% and 15.7%, respectively.
Code (2)
Tasks
Optical Flow EstimationSimilar Papers 제목 키워드 기반
ASFlow: Unsupervised Optical Flow Learning with Adaptive Pyramid Sampling
We present an unsupervised optical flow estimation method by proposing an adaptive pyramid sampling in the deep pyramid network. Specifically, in the pyramid downsampling, we propose an Content Aware Pooling (CAP) module…
Optical Flow EstimationNormalized Convolution Upsampling for Refined Optical Flow Estimation
Optical flow is a regression task where convolutional neural networks (CNNs) have led to major breakthroughs. However, this comes at major computational demands due to the use of cost-volumes and pyramidal representation…
Optical Flow EstimationSTC-Flow: Spatio-temporal Context-aware Optical Flow Estimation
In this paper, we propose a spatio-temporal contextual network, STC-Flow, for optical flow estimation. Unlike previous optical flow estimation approaches with local pyramid feature extraction and multi-level correlation,…
Optical Flow EstimationUnsupervised Learning for Optical Flow Estimation Using Pyramid Convolution LSTM
Most of current Convolution Neural Network (CNN) based methods for optical flow estimation focus on learning optical flow on synthetic datasets with groundtruth, which is not practical. In this paper, we propose an unsup…
Action RecognitionOptical Flow EstimationWhat Matters in Unsupervised Optical Flow
We systematically compare and analyze a set of key components in unsupervised optical flow to identify which photometric loss, occlusion handling, and smoothness regularization is most effective. Alongside this investiga…
Occlusion HandlingOptical Flow Estimation