Unsupervised Deep Epipolar Flow for Stationary or Dynamic Scenes
Unsupervised deep learning for optical flow computation has achieved promising results. Most existing deep-net based methods rely on image brightness consistency and local smoothness constraint to train the networks. Their performance degrades at regions where repetitive textures or occlusions occur. In this paper, we propose Deep Epipolar Flow, an unsupervised optical flow method which incorporates global geometric constraints into network learning. In particular, we investigate multiple ways of enforcing the epipolar constraint in flow estimation. To alleviate a "chicken-and-egg" type of problem encountered in dynamic scenes where multiple motions may be present, we propose a low-rank constraint as well as a union-of-subspaces constraint for training. Experimental results on various benchmarking datasets show that our method achieves competitive performance compared with supervised methods and outperforms state-of-the-art unsupervised deep-learning methods.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingDeep LearningOptical Flow EstimationSimilar Papers 제목 키워드 기반
Epipolar Geometry Improves Video Generation Models
Video generation models have advanced significantly through the latent diffusion transformers trained with rectified flow techniques. Yet these models still struggle with geometric inconsistencies, unstable motion, and v…
Video GenerationJoint Unsupervised Learning of Optical Flow and Egomotion with Bi-Level Optimization
We address the problem of joint optical flow and camera motion estimation in rigid scenes by incorporating geometric constraints into an unsupervised deep learning framework. Unlike existing approaches which rely on brig…
Motion EstimationOptical Flow EstimationRoMo: Robust Motion Segmentation Improves Structure from Motion
There has been extensive progress in the reconstruction and generation of 4D scenes from monocular casually-captured video. While these tasks rely heavily on known camera poses, the problem of finding such poses using st…
Camera CalibrationMotion SegmentationOptical Flow EstimationSegmentation+2Fundamental Matrices from Moving Objects Using Line Motion Barcodes
Computing the epipolar geometry between cameras with very different viewpoints is often very difficult. The appearance of objects can vary greatly, and it is difficult to find corresponding feature points. Prior methods …
Dense Monocular Depth Estimation in Complex Dynamic Scenes
We present an approach to dense depth estimation from a single monocular camera that is moving through a dynamic scene. The approach produces a dense depth map from two consecutive frames. Moving objects are reconstructe…
Depth EstimationMonocular Depth EstimationMotion SegmentationOptical Flow Estimation