paper-with-me

Papers

Finding Correspondences for Optical Flow and Disparity Estimations using a Sub-pixel Convolution-based Encoder-Decoder Network

2018-10-07 · Juan Luis Gonzalez, Muhammad Sarmad, Hyunjoo J. Lee, Munchurl Kim

Deep convolutional neural networks (DCNN) have recently shown promising results in low-level computer vision problems such as optical flow and disparity estimation, but still, have much room to further improve their performance. In this paper, we propose a novel sub-pixel convolution-based encoder-decoder network for optical flow and disparity estimations, which can extend FlowNetS and DispNet by replacing the deconvolution layers with sup-pixel convolution blocks. By using sub-pixel refinement and estimation on the decoder stages instead of deconvolution, we can significantly improve the estimation accuracy for optical flow and disparity, even with reduced numbers of parameters. We show a supervised end-to-end training of our proposed networks for optical flow and disparity estimations, and an unsupervised end-to-end training for monocular depth and pose estimations. In order to verify the effectiveness of our proposed networks, we perform intensive experiments for (i) optical flow and disparity estimations, and (ii) monocular depth and pose estimations. Throughout the extensive experiments, our proposed networks outperform the baselines such as FlowNetS and DispNet in terms of estimation accuracy and training times.

📄 PDF Abstract BibTeX arXiv:1810.03155

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderDisparity EstimationOptical Flow Estimation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Freespace Optical Flow Modeling for Automated Driving

2023-07-29 · Yi Feng, Ruge Zhang, Jiayuan Du, Qijun Chen 외

Optical flow and disparity are two informative visual features for autonomous driving perception. They have been used for a variety of applications, such as obstacle and lane detection. The concept of "U-V-Disparity" has…

Autonomous DrivingLane DetectionOptical Flow Estimation

Skin the sheep not only once: Reusing Various Depth Datasets to Drive the Learning of Optical Flow

2023-10-03 · Sheng-Chi Huang, Wei-Chen Chiu

Optical flow estimation is crucial for various applications in vision and robotics. As the difficulty of collecting ground truth optical flow in real-world scenarios, most of the existing methods of learning optical flow…

Depth EstimationOptical Flow EstimationStereo Matching

Spherical-to-ERP Epipolar Rectification for Single-Axis Disparity in 360 Stereo

2026-06-23 · Sahereh Obeidavi, Dieter Landes arxiv

Omnidirectional stereo images provide full-surround perception but violate the geometric assumptions of classical disparity estimation: in spherical or fisheye views, epipolar correspondences follow curved great-circle p…

Disparity Estimation

Aggregation of local parametric candidates with exemplar-based occlusion handling for optical flow

2014-07-22 · Denis Fortun, Patrick Bouthemy, Charles Kervrann

Handling all together large displacements, motion details and occlusions remains an open issue for reliable computation of optical flow in a video sequence. We propose a two-step aggregation paradigm to address this prob…

Occlusion HandlingOptical Flow Estimation

A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation

2015-12-07 · CVPR 2016 6 · Nikolaus Mayer, Eddy Ilg, Philip Häusser, Philipp Fischer 외

Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synt…

Disparity EstimationOptical Flow EstimationScene Flow Estimation