MoTDiff: High-resolution Motion Trajectory estimation from a single blurred image using Diffusion models
Accurate estimation of motion information is crucial in diverse computational imaging and computer vision applications. Researchers have investigated various methods to extract motion information from a single blurred image, including blur kernels and optical flow. However, existing motion representations are often of low quality, i.e., coarse-grained and inaccurate. In this paper, we propose the first high-resolution (HR) Motion Trajectory estimation framework using Diffusion models (MoTDiff). Different from existing motion representations, we aim to estimate an HR motion trajectory with high-quality from a single motion-blurred image. The proposed MoTDiff consists of two key components: 1) a new conditional diffusion framework that uses multi-scale feature maps extracted from a single blurred image as a condition, and 2) a new training method that can promote precise identification of a fine-grained motion trajectory, consistent estimation of overall shape and position of a motion path, and pixel connectivity along a motion trajectory. Our experiments demonstrate that the proposed MoTDiff can outperform state-of-the-art methods in both blind image deblurring and coded exposure photography applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Image DeblurringSimilar Papers 제목 키워드 기반
Image-Space Gridding for Nonrigid Motion-Corrected MR Image Reconstruction
Motion remains a major challenge in magnetic resonance (MR) imaging, particularly in free-breathing cardiac MR imaging, where data are acquired over multiple heartbeats at varying respiratory phases. We adopt a model-bas…
Image ReconstructionMotion EstimationHighly efficient non-rigid registration in k-space with application to cardiac Magnetic Resonance Imaging
In Magnetic Resonance Imaging (MRI), high temporal-resolved motion can be useful for image acquisition and reconstruction, MR-guided radiotherapy, dynamic contrast-enhancement, flow and perfusion imaging, and functional …
Motion DetectionMotion EstimationMotion Estimation and Compensation in Automotive MIMO SAR
With the advent of self-driving vehicles, autonomous driving systems will have to rely on a vast number of heterogeneous sensors to perform dynamic perception of the surrounding environment. Synthetic Aperture Radar (SAR…
Autonomous DrivingMotion EstimationA Multi-spectral Dataset for Evaluating Motion Estimation Systems
Visible images have been widely used for motion estimation. Thermal images, in contrast, are more challenging to be used in motion estimation since they typically have lower resolution, less texture, and more noise. In t…
Motion EstimationStereo MatchingFusion of Inverse Synthetic Aperture Radar and Camera Images for Automotive Target Tracking
Automotive targets undergoing turns in road junctions offer large synthetic apertures over short dwell times to automotive radars that can be exploited for obtaining fine cross-range resolution. Likewise, the wide bandwi…
Motion CompensationObject RecognitionSensor Fusion