DM-QPMNET: Dual-modality fusion network for cell segmentation in quantitative phase microscopy
Cell segmentation in single-shot quantitative phase microscopy (ssQPM) faces challenges from traditional thresholding methods that are sensitive to noise and cell density, while deep learning approaches using simple channel concatenation fail to exploit the complementary nature of polarized intensity images and phase maps. We introduce DM-QPMNet, a dual-encoder network that treats these as distinct modalities with separate encoding streams. Our architecture fuses modality-specific features at intermediate depth via multi-head attention, enabling polarized edge and texture representations to selectively integrate complementary phase information. This content-aware fusion preserves training stability while adding principled multi-modal integration through dual-source skip connections and per-modality normalization at minimal overhead. Our approach demonstrates substantial improvements over monolithic concatenation and single-modality baselines, showing that modality-specific encoding with learnable fusion effectively exploits ssQPM's simultaneous capture of complementary illumination and phase cues for robust cell segmentation.
Code (0)
등록된 구현이 없습니다.
Tasks
Cell SegmentationSimilar Papers 제목 키워드 기반
Tractography-Guided Dual-Label Collaborative Learning for Multi-Modal Cranial Nerves Parcellation
The parcellation of Cranial Nerves (CNs) serves as a crucial quantitative methodology for evaluating the morphological characteristics and anatomical pathways of specific CNs. Multi-modal CNs parcellation networks have a…
A Tri-attention Fusion Guided Multi-modal Segmentation Network
In the field of multimodal segmentation, the correlation between different modalities can be considered for improving the segmentation results. Considering the correlation between different MR modalities, in this paper, …
Brain Tumor SegmentationSegmentationTumor SegmentationResidual Spatial Fusion Network for RGB-Thermal Semantic Segmentation
Semantic segmentation plays an important role in widespread applications such as autonomous driving and robotic sensing. Traditional methods mostly use RGB images which are heavily affected by lighting conditions, \eg, d…
Autonomous DrivingSaliency DetectionSegmentationSemantic Segmentation+1Deep feature selection-and-fusion for RGB-D semantic segmentation
Scene depth information can help visual information for more accurate semantic segmentation. However, how to effectively integrate multi-modality information into representative features is still an open problem. Most of…
feature selectionSegmentationSemantic SegmentationRFBNet: Deep Multimodal Networks with Residual Fusion Blocks for RGB-D Semantic Segmentation
RGB-D semantic segmentation methods conventionally use two independent encoders to extract features from the RGB and depth data. However, there lacks an effective fusion mechanism to bridge the encoders, for the purpose …
Semantic Segmentation