paper-with-me

홈 › Papers

Text-guided multi-stage cross-perception network for medical image segmentation

2025-06-09 · Gaoyu Chen

Medical image segmentation plays a crucial role in clinical medicine, serving as a tool for auxiliary diagnosis, treatment planning, and disease monitoring, thus facilitating physicians in the study and treatment of diseases. However, existing medical image segmentation methods are limited by the weak semantic expression of the target segmentation regions, which is caused by the low contrast between the target and non-target segmentation regions. To address this limitation, text prompt information has greast potential to capture the lesion location. However, existing text-guided methods suffer from insufficient cross-modal interaction and inadequate cross-modal feature expression. To resolve these issues, we propose the Text-guided Multi-stage Cross-perception network (TMC). In TMC, we introduce a multistage cross-attention module to enhance the model's understanding of semantic details and a multi-stage alignment loss to improve the consistency of cross-modal semantics. The results of the experiments demonstrate that our TMC achieves a superior performance with Dice of 84.77%, 78.50%, 88.73% in three public datasets (QaTa-COV19, MosMedData and Breast), outperforming UNet based networks and text-guided methods.

📄 PDF Abstract BibTeX arXiv:2506.07475

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

DLWM: Dual Latent World Models enable Holistic Gaussian-centric Pre-training in Autonomous Driving

2026-04-01 · Yiyao Zhu, Ying Xue, Haiming Zhang, Guangfeng Jiang 외 arxiv

Vision-based autonomous driving has gained much attention due to its low costs and excellent performance. Compared with dense BEV (Bird's Eye View) or sparse query models, Gaussian-centric method is a comprehensive yet s…

Autonomous DrivingMotion Planning

VTPerception-R1: Enhancing Multimodal Reasoning via Explicit Visual and Textual Perceptual Grounding

2025-09-29 · Yizhuo Ding, Mingkang Chen, Zhibang Feng, Tong Xiao 외 arxiv

Multimodal large language models (MLLMs) often struggle to ground reasoning in perceptual evidence. We present a systematic study of perception strategies-explicit, implicit, visual, and textual-across four multimodal be…

Reinforcement LearningMultimodal Reasoning

Human De-occlusion: Invisible Perception and Recovery for Humans

2021-03-22 · CVPR 2021 1 · Qiang Zhou, Shiyin Wang, Yitong Wang, Zilong Huang 외

In this paper, we tackle the problem of human de-occlusion which reasons about occluded segmentation masks and invisible appearance content of humans. In particular, a two-stage framework is proposed to estimate the invi…

Human ParsingInstance SegmentationSemantic Segmentation

Tabletop Transparent Scene Reconstruction via Epipolar-Guided Optical Flow with Monocular Depth Completion Prior

2023-10-15 · Xiaotong Chen, Zheming Zhou, Zhuo Deng, Omid Ghasemalizadeh 외

Reconstructing transparent objects using affordable RGB-D cameras is a persistent challenge in robotic perception due to inconsistent appearances across views in the RGB domain and inaccurate depth readings in each singl…

3D ReconstructionDepth CompletionOptical Flow EstimationSemantic Segmentation+1

VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perception

2025-09-25 · Ziang Yan, Xinhao Li, Yinan He, Zhengrong Yue 외 arxiv

Inducing reasoning in multimodal large language models (MLLMs) is critical for achieving human-level perception and understanding. Existing methods mainly leverage LLM reasoning to analyze parsed visuals, often limited b…

Reinforcement LearningMultimodal Reasoning