Data-Efficient Unsupervised Interpolation Without Any Intermediate Frame for 4D Medical Images
4D medical images, which represent 3D images with temporal information, are crucial in clinical practice for capturing dynamic changes and monitoring long-term disease progression. However, acquiring 4D medical images poses challenges due to factors such as radiation exposure and imaging duration, necessitating a balance between achieving high temporal resolution and minimizing adverse effects. Given these circumstances, not only is data acquisition challenging, but increasing the frame rate for each dataset also proves difficult. To address this challenge, this paper proposes a simple yet effective Unsupervised Volumetric Interpolation framework, UVI-Net. This framework facilitates temporal interpolation without the need for any intermediate frames, distinguishing it from the majority of other existing unsupervised methods. Experiments on benchmark datasets demonstrate significant improvements across diverse evaluation metrics compared to unsupervised and supervised baselines. Remarkably, our approach achieves this superior performance even when trained with a dataset as small as one, highlighting its exceptional robustness and efficiency in scenarios with sparse supervision. This positions UVI-Net as a compelling alternative for 4D medical imaging, particularly in settings where data availability is limited. The source code is available at https://github.com/jungeun122333/UVI-Net.
Code (1)
Tasks
3D Video Frame InterpolationMedical Image GenerationUnsupervised Video Frame InterpolationSimilar Papers 제목 키워드 기반
STint: Self-supervised Temporal Interpolation for Geospatial Data
Supervised and unsupervised techniques have demonstrated the potential for temporal interpolation of video data. Nevertheless, most prevailing temporal interpolation techniques hinge on optical flow, which encodes the mo…
Optical Flow EstimationUnsupervised Video Interpolation Using Cycle Consistency
Learning to synthesize high frame rate videos via interpolation requires large quantities of high frame rate training videos, which, however, are scarce, especially at high resolutions. Here, we propose unsupervised tech…
TripletVideo Frame InterpolationCoupled Video Frame Interpolation and Encoding with Hybrid Event Cameras for Low-Power High-Framerate Video
Every generation of mobile devices strives to capture video at higher resolution and frame rate than previous ones. This quality increase also requires additional power and computation to capture and encode high-quality …
Event-based visionVideo Frame InterpolationRobust Unsupervised Cross-Lingual Word Embedding using Domain Flow Interpolation
This paper investigates an unsupervised approach towards deriving a universal, cross-lingual word embedding space, where words with similar semantics from different languages are close to one another. Previous adversaria…
Cross-Lingual Natural Language InferenceNatural Language InferenceReFIn: A Refinement Approach for Video Frame Interpolation
Video Frame Interpolation is an important video enhancement problem which aims to generate one or multiple frames between consecutive frames in video. Optical flow-based frame interpolation approaches estimate intermedia…
Optical Flow EstimationVideo EnhancementVideo Frame Interpolation