paper-with-me

홈 › Papers

Guided Optical Flow Learning

2017-02-08 · Yi Zhu, Zhenzhong Lan, Shawn Newsam, Alexander G. Hauptmann

We study the unsupervised learning of CNNs for optical flow estimation using proxy ground truth data. Supervised CNNs, due to their immense learning capacity, have shown superior performance on a range of computer vision problems including optical flow prediction. They however require the ground truth flow which is usually not accessible except on limited synthetic data. Without the guidance of ground truth optical flow, unsupervised CNNs often perform worse as they are naturally ill-conditioned. We therefore propose a novel framework in which proxy ground truth data generated from classical approaches is used to guide the CNN learning. The models are further refined in an unsupervised fashion using an image reconstruction loss. Our guided learning approach is competitive with or superior to state-of-the-art approaches on three standard benchmark datasets yet is completely unsupervised and can run in real time.

📄 PDF Abstract BibTeX arXiv:1702.02295

Code (0)

등록된 구현이 없습니다.

Tasks

Image ReconstructionOptical Flow Estimation

Similar Papers 제목 키워드 기반

SRFlow: A Dataset and Regularization Model for High-Resolution Facial Optical Flow via Splatting Rasterization

2026-01-10 · JiaLin Zhang, Dong Li arxiv

Facial optical flow supports a wide range of tasks in facial motion analysis. However, the lack of high-resolution facial optical flow datasets has hindered progress in this area. In this paper, we introduce Splatting Ra…

Micro-Expression RecognitionOptical Flow Estimation

GyroFlow: Gyroscope-Guided Unsupervised Optical Flow Learning

2021-03-25 · ICCV 2021 10 · Haipeng Li, Kunming Luo, Shuaicheng Liu

Existing optical flow methods are erroneous in challenging scenes, such as fog, rain, and night because the basic optical flow assumptions such as brightness and gradient constancy are broken. To address this problem, we…

Optical Flow Estimation

Flow-guided Semi-supervised Video Object Segmentation

2023-01-25 · Yushan Zhang, Andreas Robinson, Maria Magnusson, Michael Felsberg

We propose an optical flow-guided approach for semi-supervised video object segmentation. Optical flow is usually exploited as additional guidance information in unsupervised video object segmentation. However, its relev…

DecoderObjectOptical Flow EstimationSegmentation+5

Optical Flow Guided Feature: A Fast and Robust Motion Representation for Video Action Recognition

2017-11-29 · CVPR 2018 6 · Shuyang Sun, Zhanghui Kuang, Wanli Ouyang, Lu Sheng 외

Motion representation plays a vital role in human action recognition in videos. In this study, we introduce a novel compact motion representation for video action recognition, named Optical Flow guided Feature (OFF), whi…

Action RecognitionAction Recognition In VideosOptical Flow EstimationTemporal Action Localization

Learning Task-Oriented Flows to Mutually Guide Feature Alignment in Synthesized and Real Video Denoising

2022-08-25 · JieZhang Cao, Qin Wang, Jingyun Liang, Yulun Zhang 외

Video denoising aims at removing noise from videos to recover clean ones. Some existing works show that optical flow can help the denoising by exploiting the additional spatial-temporal clues from nearby frames. However,…

DenoisingOptical Flow EstimationVideo Denoising