Reducing Annotation Burden: Exploiting Image Knowledge for Few-Shot Medical Video Object Segmentation via Spatiotemporal Consistency Relearning
Few-shot video object segmentation aims to reduce annotation costs; however, existing methods still require abundant dense frame annotations for training, which are scarce in the medical domain. We investigate an extremely low-data regime that utilizes annotations from only a few video frames and leverages existing labeled images to minimize costly video annotations. Specifically, we propose a two-phase framework. First, we learn a few-shot segmentation model using labeled images. Subsequently, to improve performance without full supervision, we introduce a spatiotemporal consistency relearning approach on medical videos that enforces consistency between consecutive frames. Constraints are also enforced between the image model and relearning model at both feature and prediction levels. Experiments demonstrate the superiority of our approach over state-of-the-art few-shot segmentation methods. Our model bridges the gap between abundant annotated medical images and scarce, sparsely labeled medical videos to achieve strong video segmentation performance in this low data regime. Code is available at https://github.com/MedAITech/RAB.
Code (1)
Tasks
SegmentationSemantic SegmentationVideo Object SegmentationVideo SegmentationVideo Semantic SegmentationSimilar Papers 제목 키워드 기반
Learning Generalized Medical Image Representations through Image-Graph Contrastive Pretraining
Medical image interpretation using deep learning has shown promise but often requires extensive expert-annotated datasets. To reduce this annotation burden, we develop an Image-Graph Contrastive Learning framework that p…
Contrastive LearningDiagnosticKnowledge GraphsLinear evaluationExemplar-FreeSOLO: Enhancing Unsupervised Instance Segmentation With Exemplars
Instance segmentation seeks to identify and segment each object from images, which often relies on a large number of dense annotations for model training. To alleviate this burden, unsupervised instance segmentation …
Instance SegmentationSegmentationSemantic SegmentationUnsupervised Instance SegmentationSYRAC: Synthesize, Rank, and Count
Crowd counting is a critical task in computer vision, with several important applications. However, existing counting methods rely on labor-intensive density map annotations, necessitating the manual localization of each…
Crowd CountingAugmenting Image Annotation: A Human-LMM Collaborative Framework for Efficient Object Selection and Label Generation
Traditional image annotation tasks rely heavily on human effort for object selection and label assignment, making the process time-consuming and prone to decreased efficiency as annotators experience fatigue after extens…
Object RecognitionReducing Annotation Need in Self-Explanatory Models for Lung Nodule Diagnosis
Feature-based self-explanatory methods explain their classification in terms of human-understandable features. In the medical imaging community, this semantic matching of clinical knowledge adds significantly to the trus…
Clinical KnowledgeContrastive Learning