paper-with-me

홈 › Papers

SAM-I2I: Unleash the Power of Segment Anything Model for Medical Image Translation

2024-11-13 · Jiayu Huo, Sebastien Ourselin, Rachel Sparks

Medical image translation is crucial for reducing the need for redundant and expensive multi-modal imaging in clinical field. However, current approaches based on Convolutional Neural Networks (CNNs) and Transformers often fail to capture fine-grain semantic features, resulting in suboptimal image quality. To address this challenge, we propose SAM-I2I, a novel image-to-image translation framework based on the Segment Anything Model 2 (SAM2). SAM-I2I utilizes a pre-trained image encoder to extract multiscale semantic features from the source image and a decoder, based on the mask unit attention module, to synthesize target modality images. Our experiments on multi-contrast MRI datasets demonstrate that SAM-I2I outperforms state-of-the-art methods, offering more efficient and accurate medical image translation.

📄 PDF Abstract BibTeX arXiv:2411.12755

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderImage-to-Image TranslationTranslation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

SAM3D: Zero-Shot 3D Object Detection via Segment Anything Model

2023-06-04 · Dingyuan Zhang, Dingkang Liang, Hongcheng Yang, Zhikang Zou 외

With the development of large language models, many remarkable linguistic systems like ChatGPT have thrived and achieved astonishing success on many tasks, showing the incredible power of foundation models. In the spirit…

3D Object DetectionImage SegmentationObjectobject-detection+2

Unleashing the Potential of SAM2 for Biomedical Images and Videos: A Survey

2024-08-23 · Yichi Zhang, Zhenrong Shen

The unprecedented developments in segmentation foundational models have become a dominant force in the field of computer vision, introducing a multitude of previously unexplored capabilities in a wide range of natural im…

Image SegmentationSegmentationSemantic SegmentationVideo Segmentation+2

When SAM Meets Medical Images: An Investigation of Segment Anything Model (SAM) on Multi-phase Liver Tumor Segmentation

2023-04-17 · Chuanfei Hu, Tianyi Xia, Shenghong Ju, Xinde Li

Learning to segmentation without large-scale samples is an inherent capability of human. Recently, Segment Anything Model (SAM) performs the significant zero-shot image segmentation, attracting considerable attention fro…

Image SegmentationMedical Image AnalysisMedical Image SegmentationSegmentation+2

HRMedSeg: Unlocking High-resolution Medical Image segmentation via Memory-efficient Attention Modeling

2025-04-08 · Qing Xu, Zhenye Lou, Chenxin Li, Xiangjian He 외

High-resolution segmentation is critical for precise disease diagnosis by extracting micro-imaging information from medical images. Existing transformer-based encoder-decoder frameworks have demonstrated remarkable versa…

DecoderGPUImage SegmentationMedical Image Segmentation+2

Unleashing the Power of Prompt-driven Nucleus Instance Segmentation

2023-11-27 · Zhongyi Shui, Yunlong Zhang, Kai Yao, Chenglu Zhu 외

Nucleus instance segmentation in histology images is crucial for a broad spectrum of clinical applications. Current dominant algorithms rely on regression of nuclear proxy maps. Distinguishing nucleus instances from the …

Image SegmentationInstance SegmentationMedical Image SegmentationSegmentation+1