paper-with-me

홈 › Papers

One-Shot Medical Video Object Segmentation via Temporal Contrastive Memory Networks

2025-03-19 · Yaxiong Chen, Junjian Hu, Chunlei Li, Zixuan Zheng, Jingliang Hu, Yilei Shi, Shengwu Xiong, Xiao Xiang Zhu, Lichao Mou

Video object segmentation is crucial for the efficient analysis of complex medical video data, yet it faces significant challenges in data availability and annotation. We introduce the task of one-shot medical video object segmentation, which requires separating foreground and background pixels throughout a video given only the mask annotation of the first frame. To address this problem, we propose a temporal contrastive memory network comprising image and mask encoders to learn feature representations, a temporal contrastive memory bank that aligns embeddings from adjacent frames while pushing apart distant ones to explicitly model inter-frame relationships and stores these features, and a decoder that fuses encoded image features and memory readouts for segmentation. We also collect a diverse, multi-source medical video dataset spanning various modalities and anatomies to benchmark this task. Extensive experiments demonstrate state-of-the-art performance in segmenting both seen and unseen structures from a single exemplar, showing ability to generalize from scarce labels. This highlights the potential to alleviate annotation burdens for medical video analysis. Code is available at https://github.com/MedAITech/TCMN.

📄 PDF Abstract BibTeX arXiv:2503.14979

Code (1)

medaitech/tcmn 공식 구현 pytorch

Tasks

DecoderSegmentationSemantic SegmentationVideo Object SegmentationVideo Semantic Segmentation

Methods 이 논문이 사용한 방법론

Memory Network 설명 없음

Similar Papers 제목 키워드 기반

Reducing Annotation Burden: Exploiting Image Knowledge for Few-Shot Medical Video Object Segmentation via Spatiotemporal Consistency Relearning

2025-03-19 · Zixuan Zheng, Yilei Shi, Chunlei Li, Jingliang Hu 외

Few-shot video object segmentation aims to reduce annotation costs; however, existing methods still require abundant dense frame annotations for training, which are scarce in the medical domain. We investigate an extreme…

SegmentationSemantic SegmentationVideo Object SegmentationVideo Segmentation+1

One-Shot Video Object Segmentation

2016-11-16 · CVPR 2017 7 · Sergi Caelles, Kevis-Kokitsi Maninis, Jordi Pont-Tuset, Laura Leal-Taixé 외

This paper tackles the task of semi-supervised video object segmentation, i.e., the separation of an object from the background in a video, given the mask of the first frame. We present One-Shot Video Object Segmentation…

Foreground SegmentationObjectSegmentationSemi-Supervised Video Object Segmentation+3

Video Object Segmentation Without Temporal Information

2017-09-18 · Kevis-Kokitsi Maninis, Sergi Caelles, Yu-Hua Chen, Jordi Pont-Tuset 외

Video Object Segmentation, and video processing in general, has been historically dominated by methods that rely on the temporal consistency and redundancy in consecutive video frames. When the temporal smoothness is sud…

Foreground SegmentationObjectSegmentationSemantic Segmentation+4

Multi-grained Temporal Prototype Learning for Few-shot Video Object Segmentation

2023-09-20 · ICCV 2023 1 · Nian Liu, Kepan Nan, Wangbo Zhao, Yuanwei Liu 외

Few-Shot Video Object Segmentation (FSVOS) aims to segment objects in a query video with the same category defined by a few annotated support images. However, this task was seldom explored. In this work, based on IPMT, a…

Image SegmentationSegmentationSemantic SegmentationVideo Object Segmentation+1

RVOS: End-to-End Recurrent Network for Video Object Segmentation

2019-03-13 · CVPR 2019 6 · Carles Ventura, Miriam Bellver, Andreu Girbau, Amaia Salvador 외

Multiple object video object segmentation is a challenging task, specially for the zero-shot case, when no object mask is given at the initial frame and the model has to find the objects to be segmented along the sequenc…

GPUObjectOne-shot visual object segmentationSegmentation+4