Temporal Spatial-Adaptive Interpolation with Deformable Refinement for Electron Microscopic Images
Recently, flow-based methods have achieved promising success in video frame interpolation. However, electron microscopic (EM) images suffer from unstable image quality, low PSNR, and disorderly deformation. Existing flow-based interpolation methods cannot precisely compute optical flow for EM images since only predicting each position's unique offset. To overcome these problems, we propose a novel interpolation framework for EM images that progressively synthesizes interpolated features in a coarse-to-fine manner. First, we extract missing intermediate features by the proposed temporal spatial-adaptive (TSA) interpolation module. The TSA interpolation module aggregates temporal contexts and then adaptively samples the spatial-related features with the proposed residual spatial adaptive block. Second, we introduce a stacked deformable refinement block (SDRB) further enhance the reconstruction quality, which is aware of the matching positions and relevant features from input frames with the feedback mechanism. Experimental results demonstrate the superior performance of our approach compared to previous works, both quantitatively and qualitatively.
Code (0)
등록된 구현이 없습니다.
Tasks
Optical Flow EstimationVideo Frame InterpolationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
STDAN: Deformable Attention Network for Space-Time Video Super-Resolution
The target of space-time video super-resolution (STVSR) is to increase the spatial-temporal resolution of low-resolution (LR) and low frame rate (LFR) videos. Recent approaches based on deep learning have made significan…
Space-time Video Super-resolutionSuper-ResolutionVideo Super-ResolutionSpatial-Temporal Consistency Refinement Network for Dynamic Point Cloud Frame Interpolation
Point cloud frame interpolation aims to improve the frame rate of a point cloud sequence by synthesising intermediate frames between consecutive frames. Most of the existing works only use the scene flow or features, not…
3D Point Cloud InterpolationMotion EstimationPDWN: Pyramid Deformable Warping Network for Video Interpolation
Video interpolation aims to generate a non-existent intermediate frame given the past and future frames. Many state-of-the-art methods achieve promising results by estimating the optical flow between the known frames and…
Optical Flow EstimationVideo Frame Interpolation via Generalized Deformable Convolution
Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be…
Video Frame InterpolationMultiple Video Frame Interpolation via Enhanced Deformable Separable Convolution
Generating non-existing frames from a consecutive video sequence has been an interesting and challenging problem in the video processing field. Typical kernel-based interpolation methods predict pixels with a single conv…
Motion EstimationOptical Flow EstimationVideo Frame Interpolation