Weakly-Supervised Optical Flow Estimation for Time-of-Flight
Indirect Time-of-Flight (iToF) cameras are a widespread type of 3D sensor, which perform multiple captures to obtain depth values of the captured scene. While recent approaches to correct iToF depths achieve high performance when removing multi-path-interference and sensor noise, little research has been done to tackle motion artifacts. In this work we propose a training algorithm, which allows to supervise Optical Flow (OF) networks directly on the reconstructed depth, without the need of having ground truth flows. We demonstrate that this approach enables the training of OF networks to align raw iToF measurements and compensate motion artifacts in the iToF depth images. The approach is evaluated for both single- and multi-frequency sensors as well as multi-tap sensors, and is able to outperform other motion compensation techniques.
Code (1)
Tasks
Motion CompensationOptical Flow EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
FlowDA: Unsupervised Domain Adaptive Framework for Optical Flow Estimation
Collecting real-world optical flow datasets is a formidable challenge due to the high cost of labeling. A shortage of datasets significantly constrains the real-world performance of optical flow models. Building virtual …
Dataset GenerationOptical Flow EstimationTowards Anytime Optical Flow Estimation with Event Cameras
Event cameras respond to changes in log-brightness at the millisecond level, making them ideal for optical flow estimation. However, existing datasets from event cameras provide only low frame rate ground truth for optic…
Autonomous DrivingMotion EstimationOptical Flow EstimationSelFlow: Self-Supervised Learning of Optical Flow
We present a self-supervised learning approach for optical flow. Our method distills reliable flow estimations from non-occluded pixels, and uses these predictions as ground truth to learn optical flow for hallucinated o…
Optical Flow EstimationSelf-Supervised LearningSpatio-temporal video autoencoder with differentiable memory
We describe a new spatio-temporal video autoencoder, based on a classic spatial image autoencoder and a novel nested temporal autoencoder. The temporal encoder is represented by a differentiable visual memory composed of…
DecoderMotion EstimationOptical Flow EstimationSemantic Segmentation+2Finding Correspondences for Optical Flow and Disparity Estimations using a Sub-pixel Convolution-based Encoder-Decoder Network
Deep convolutional neural networks (DCNN) have recently shown promising results in low-level computer vision problems such as optical flow and disparity estimation, but still, have much room to further improve their perf…
DecoderDisparity EstimationOptical Flow Estimation