paper-with-me

홈 › Papers

DM-QPMNET: Dual-modality fusion network for cell segmentation in quantitative phase microscopy

2025-10-31 · Rajatsubhra Chakraborty, Ana Espinosa-Momox, Riley Haskin, Depeng Xu, Rosario Porras-Aguilar arxiv

Cell segmentation in single-shot quantitative phase microscopy (ssQPM) faces challenges from traditional thresholding methods that are sensitive to noise and cell density, while deep learning approaches using simple channel concatenation fail to exploit the complementary nature of polarized intensity images and phase maps. We introduce DM-QPMNet, a dual-encoder network that treats these as distinct modalities with separate encoding streams. Our architecture fuses modality-specific features at intermediate depth via multi-head attention, enabling polarized edge and texture representations to selectively integrate complementary phase information. This content-aware fusion preserves training stability while adding principled multi-modal integration through dual-source skip connections and per-modality normalization at minimal overhead. Our approach demonstrates substantial improvements over monolithic concatenation and single-modality baselines, showing that modality-specific encoding with learnable fusion effectively exploits ssQPM's simultaneous capture of complementary illumination and phase cues for robust cell segmentation.

📄 PDF Abstract BibTeX arXiv:2511.00218

Code (0)

등록된 구현이 없습니다.

Tasks

Cell Segmentation

Similar Papers 제목 키워드 기반

Tractography-Guided Dual-Label Collaborative Learning for Multi-Modal Cranial Nerves Parcellation

2025-08-03 · Lei Xie, Junxiong Huang, Yuanjing Feng, Qingrun Zeng arxiv

The parcellation of Cranial Nerves (CNs) serves as a crucial quantitative methodology for evaluating the morphological characteristics and anatomical pathways of specific CNs. Multi-modal CNs parcellation networks have a…

A Tri-attention Fusion Guided Multi-modal Segmentation Network

2021-11-02 · Tongxue Zhou, Su Ruan, Pierre Vera, Stéphane Canu

In the field of multimodal segmentation, the correlation between different modalities can be considered for improving the segmentation results. Considering the correlation between different MR modalities, in this paper, …

Brain Tumor SegmentationSegmentationTumor Segmentation

Residual Spatial Fusion Network for RGB-Thermal Semantic Segmentation

2023-06-17 · Ping Li, Junjie Chen, Binbin Lin, Xianghua Xu

Semantic segmentation plays an important role in widespread applications such as autonomous driving and robotic sensing. Traditional methods mostly use RGB images which are heavily affected by lighting conditions, \eg, d…

Autonomous DrivingSaliency DetectionSegmentationSemantic Segmentation+1

Deep feature selection-and-fusion for RGB-D semantic segmentation

2021-05-10 · Yuejiao Su, Yuan Yuan, Zhiyu Jiang

Scene depth information can help visual information for more accurate semantic segmentation. However, how to effectively integrate multi-modality information into representative features is still an open problem. Most of…

feature selectionSegmentationSemantic Segmentation

RFBNet: Deep Multimodal Networks with Residual Fusion Blocks for RGB-D Semantic Segmentation

2019-06-29 · Liuyuan Deng, Ming Yang, Tianyi Li, Yuesheng He 외

RGB-D semantic segmentation methods conventionally use two independent encoders to extract features from the RGB and depth data. However, there lacks an effective fusion mechanism to bridge the encoders, for the purpose …

Semantic Segmentation