Z-upscaling: Optical Flow Guided Frame Interpolation for Isotropic Reconstruction of 3D EM Volumes
We propose a novel optical flow based approach to enhance the axial resolution of anisotropic 3D EM volumes to achieve isotropic 3D reconstruction. Assuming spatial continuity of 3D biological structures in well aligned EM volumes, we reasoned that optical flow estimation techniques, often applied for temporal resolution enhancement in videos, can be utilized. Pixel level motion is estimated between neighboring 2D slices along z, using spatial gradient flow estimates to interpolate and generate new 2D slices resulting in isotropic voxels. We leverage recent state-of-the-art learning methods for video frame interpolation and transfer learning techniques, and demonstrate the success of our approach on publicly available ultrastructure EM volumes.
Code (1)
Tasks
3D ReconstructionOptical Flow EstimationTransfer LearningVideo Frame InterpolationSimilar Papers 제목 키워드 기반
SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation
We propose Symmetric Nonlinear Motion-guided Generative Video Frame Interpolation (SNM-VFI), a training-free framework for motion-controllable generative video frame interpolation with pre-trained optical flow and video …
Video Frame InterpolationA Unified Pyramid Recurrent Network for Video Frame Interpolation
Flow-guided synthesis provides a common framework for frame interpolation, where optical flow is estimated to guide the synthesis of intermediate frames between consecutive inputs. In this paper, we present UPR-Net, a no…
Optical Flow EstimationVideo Frame InterpolationVideo Interpolation by Event-driven Anisotropic Adjustment of Optical Flow
Video frame interpolation is a challenging task due to the ever-changing real-world scene. Previous methods often calculate the bi-directional optical flows and then predict the intermediate optical flows under the linea…
Optical Flow EstimationVideo Frame InterpolationFeatureFlow: Robust Video Interpolation via Structure-to-Texture Generation
Video interpolation aims to synthesize non-existent frames between two consecutive frames. Although existing optical flow based methods have achieved promising results, they still face great challenges in dealing with th…
Optical Flow EstimationTexture SynthesisVideo Frame InterpolationHierarchical Flow Diffusion for Efficient Frame Interpolation
Most recent diffusion-based methods still show a large gap compared to non-diffusion methods for video frame interpolation, in both accuracy and efficiency. Most of them formulate the problem as a denoising procedure…
DenoisingOptical Flow EstimationVideo Frame Interpolation