paper-with-me

Papers

Temporal Spatial-Adaptive Interpolation with Deformable Refinement for Electron Microscopic Images

2021-01-17 · Zejin Wang, Guodong Sun, Lina Zhang, Guoqing Li, Hua Han

Recently, flow-based methods have achieved promising success in video frame interpolation. However, electron microscopic (EM) images suffer from unstable image quality, low PSNR, and disorderly deformation. Existing flow-based interpolation methods cannot precisely compute optical flow for EM images since only predicting each position's unique offset. To overcome these problems, we propose a novel interpolation framework for EM images that progressively synthesizes interpolated features in a coarse-to-fine manner. First, we extract missing intermediate features by the proposed temporal spatial-adaptive (TSA) interpolation module. The TSA interpolation module aggregates temporal contexts and then adaptively samples the spatial-related features with the proposed residual spatial adaptive block. Second, we introduce a stacked deformable refinement block (SDRB) further enhance the reconstruction quality, which is aware of the matching positions and relevant features from input frames with the feedback mechanism. Experimental results demonstrate the superior performance of our approach compared to previous works, both quantitatively and qualitatively.

📄 PDF Abstract BibTeX arXiv:2101.06771

Code (0)

등록된 구현이 없습니다.

Tasks

Optical Flow EstimationVideo Frame Interpolation

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

STDAN: Deformable Attention Network for Space-Time Video Super-Resolution

2022-03-14 · Hai Wang, Xiaoyu Xiang, Yapeng Tian, Wenming Yang 외

The target of space-time video super-resolution (STVSR) is to increase the spatial-temporal resolution of low-resolution (LR) and low frame rate (LFR) videos. Recent approaches based on deep learning have made significan…

Space-time Video Super-resolutionSuper-ResolutionVideo Super-Resolution

Spatial-Temporal Consistency Refinement Network for Dynamic Point Cloud Frame Interpolation

2023-08-28 · 2023 IEEE International Conference on Multimedia and Expo Workshops (ICMEW) 2023 8 · Lancao Ren, Lili Zhao, Zhuoqun Sun, Zhipeng Zhang 외

Point cloud frame interpolation aims to improve the frame rate of a point cloud sequence by synthesising intermediate frames between consecutive frames. Most of the existing works only use the scene flow or features, not…

3D Point Cloud InterpolationMotion Estimation

PDWN: Pyramid Deformable Warping Network for Video Interpolation

2021-04-04 · Zhiqi Chen, Ran Wang, Haojie Liu, Yao Wang

Video interpolation aims to generate a non-existent intermediate frame given the past and future frames. Many state-of-the-art methods achieve promising results by estimating the optical flow between the known frames and…

Optical Flow Estimation

Video Frame Interpolation via Generalized Deformable Convolution

2020-08-24 · Zhihao Shi, Xiaohong Liu, Kangdi Shi, Linhui Dai 외

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be…

Video Frame Interpolation

Multiple Video Frame Interpolation via Enhanced Deformable Separable Convolution

2020-06-15 · Xianhang Cheng, Zhenzhong Chen

Generating non-existing frames from a consecutive video sequence has been an interesting and challenging problem in the video processing field. Typical kernel-based interpolation methods predict pixels with a single conv…

Motion EstimationOptical Flow EstimationVideo Frame Interpolation