paper-with-me

홈 › Papers

CriDiff: Criss-cross Injection Diffusion Framework via Generative Pre-train for Prostate Segmentation

2024-06-20 · TingWei Liu, Miao Zhang, Leiye Liu, Jialong Zhong, Shuyao Wang, Yongri Piao, Huchuan Lu

Recently, the Diffusion Probabilistic Model (DPM)-based methods have achieved substantial success in the field of medical image segmentation. However, most of these methods fail to enable the diffusion model to learn edge features and non-edge features effectively and to inject them efficiently into the diffusion backbone. Additionally, the domain gap between the images features and the diffusion model features poses a great challenge to prostate segmentation. In this paper, we proposed CriDiff, a two-stage feature injecting framework with a Crisscross Injection Strategy (CIS) and a Generative Pre-train (GP) approach for prostate segmentation. The CIS maximizes the use of multi-level features by efficiently harnessing the complementarity of high and low-level features. To effectively learn multi-level of edge features and non-edge features, we proposed two parallel conditioners in the CIS: the Boundary Enhance Conditioner (BEC) and the Core Enhance Conditioner (CEC), which discriminatively model the image edge regions and non-edge regions, respectively. Moreover, the GP approach eases the inconsistency between the images features and the diffusion model without adding additional parameters. Extensive experiments on four benchmark datasets demonstrate the effectiveness of the proposed method and achieve state-of-the-art performance on four evaluation metrics.

📄 PDF Abstract BibTeX arXiv:2406.14186

Code (1)

LiuTingWed/CriDiff 공식 구현 pytorch

Tasks

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

CCNet: Criss-Cross Attention for Semantic Segmentation

2018-11-28 · ICCV 2019 10 · Zilong Huang, Xinggang Wang, Yunchao Wei, Lichao Huang 외

Contextual information is vital in visual understanding problems, such as semantic segmentation and object detection. We propose a Criss-Cross Network (CCNet) for obtaining full-image contextual information in a very eff…

Computational EfficiencyGPUHuman ParsingInstance Segmentation+7

Self-Supervised Audio-Visual Representation Learning with Relaxed Cross-Modal Synchronicity

2021-11-09 · Pritam Sarkar, Ali Etemad

We present CrissCross, a self-supervised framework for learning audio-visual representations. A novel notion is introduced in our framework whereby in addition to learning the intra-modal and standard 'synchronous' cross…

Audio ClassificationRetrievalSelf-Supervised Action RecognitionSelf-Supervised Audio Classification+4

XLSor: A Robust and Accurate Lung Segmentor on Chest X-Rays Using Criss-Cross Attention and Customized Radiorealistic Abnormalities Generation

2019-04-19 · Youbao Tang, Yu-Xing Tang, Jing Xiao, Ronald M. Summers

This paper proposes a novel framework for lung segmentation in chest X-rays. It consists of two key contributions, a criss-cross attention based segmentation network and radiorealistic chest X-ray image synthesis (i.e. a…

Data AugmentationImage GenerationImage-to-Image TranslationSegmentation+1

Structure-Preserving Zero-Shot Image Editing via Stage-Wise Latent Injection in Diffusion Models

2025-04-22 · Dasol Jeong, Donggoo Kang, Jiwon Park, Hyebean Lee 외

We propose a diffusion-based framework for zero-shot image editing that unifies text-guided and reference-guided approaches without requiring fine-tuning. Our method leverages diffusion inversion and timestep-specific nu…

Attribute

A Densely Connected Criss-Cross Attention Network for Document-level Relation Extraction

2022-03-26 · Liang Zhang, Yidong Cheng

Document-level relation extraction (RE) aims to identify relations between two entities in a given document. Compared with its sentence-level counterpart, document-level RE requires complex reasoning. Previous research n…

Document-level Relation ExtractionLogical ReasoningRelationRelation Extraction+1