Optical Flow Estimation from a Single Motion-blurred Image
In most of computer vision applications, motion blur is regarded as an undesirable artifact. However, it has been shown that motion blur in an image may have practical interests in fundamental computer vision problems. In this work, we propose a novel framework to estimate optical flow from a single motion-blurred image in an end-to-end manner. We design our network with transformer networks to learn globally and locally varying motions from encoded features of a motion-blurred input, and decode left and right frame features without explicit frame supervision. A flow estimator network is then used to estimate optical flow from the decoded features in a coarse-to-fine manner. We qualitatively and quantitatively evaluate our model through a large set of experiments on synthetic and real motion-blur datasets. We also provide in-depth analysis of our model in connection with related approaches to highlight the effectiveness and favorability of our approach. Furthermore, we showcase the applicability of the flow estimated by our method on deblurring and moving object segmentation tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringOptical Flow EstimationSemantic SegmentationSimilar Papers 제목 키워드 기반
MoTDiff: High-resolution Motion Trajectory estimation from a single blurred image using Diffusion models
Accurate estimation of motion information is crucial in diverse computational imaging and computer vision applications. Researchers have investigated various methods to extract motion information from a single blurred im…
Image DeblurringSingle Image Optical Flow Estimation with an Event Camera
Event cameras are bio-inspired sensors that asynchronously report intensity changes in microsecond resolution. DAVIS can capture high dynamics of a scene and simultaneously output high temporal resolution events and low …
DeblurringImage DeblurringOptical Flow EstimationMotion-blurred Video Interpolation and Extrapolation
Abrupt motion of camera or objects in a scene result in a blurry video, and therefore recovering high quality video requires two types of enhancements: visual enhancement and temporal upsampling. A broad range of researc…
DeblurringOptical Flow EstimationOptical Flow Super-Resolution Based on Image Guidence Using Convolutional Neural Network
The convolutional neural network model for optical flow estimation usually outputs a low-resolution(LR) optical flow field. To obtain the corresponding full image resolution,interpolation and variational approach are the…
Image Super-ResolutionOptical Flow EstimationSuper-ResolutionEstimating Nonplanar Flow from 2D Motion-blurred Widefield Microscopy Images via Deep Learning
Optical flow is a method aimed at predicting the movement velocity of any pixel in the image and is used in medicine and biology to estimate flow of particles in organs or organelles. However, a precise optical flow meas…
Optical Flow Estimation